2024-09-15T22:11:16.977 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:11:17.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:11:17.088 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906245' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqH19lQi2P7F1fBQoIEI6jQeCHa/h20bARL3uzKpU99bJkWoaqx1LxdEgF6L87Lqt5LtDZ24gKqOPqlKJ7Ent4= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBvCehe1qDeWToYC6xLWzZUa77DhY0st3mYFYnTABlDqjs4n6NFISejSef8tlyJ17q7ClB3l/L0JRVp16d1o9d8= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH72w43r5MTT+NbxuuC+nyAXVkR4XnGzSHhvIVaie3P4w50rtVEyAj42y6cybdiGDA99sFOVAQv/LE9Cu2ZwHx4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:11:17.088 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:11:17.089 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:11:17.089 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:11:17.091 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:11:17.113 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:11:17.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:11:17.113 INFO:teuthology.packaging:ref: None 2024-09-15T22:11:17.113 INFO:teuthology.packaging:tag: None 2024-09-15T22:11:17.113 INFO:teuthology.packaging:branch: squid 2024-09-15T22:11:17.113 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:11:17.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T22:11:17.328 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T22:11:17.330 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:11:17.338 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:11:17.339 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:11:17.352 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:11:17.372 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:11:17.383 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:11:17.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:06:16.933833', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqH19lQi2P7F1fBQoIEI6jQeCHa/h20bARL3uzKpU99bJkWoaqx1LxdEgF6L87Lqt5LtDZ24gKqOPqlKJ7Ent4='} 2024-09-15T22:11:17.433 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:06:16.931809', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBvCehe1qDeWToYC6xLWzZUa77DhY0st3mYFYnTABlDqjs4n6NFISejSef8tlyJ17q7ClB3l/L0JRVp16d1o9d8='} 2024-09-15T22:11:17.457 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:06:16.935557', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH72w43r5MTT+NbxuuC+nyAXVkR4XnGzSHhvIVaie3P4w50rtVEyAj42y6cybdiGDA99sFOVAQv/LE9Cu2ZwHx4='} 2024-09-15T22:11:17.458 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:11:17.464 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T22:11:17.465 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T22:11:17.465 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T22:11:17.465 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:11:17.549 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f253ea33520>, signals=[15]) 2024-09-15T22:11:17.549 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:11:17.556 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:11:17.556 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:11:17.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:11:17.637 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-15T22:11:17.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:11:17.714 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T22:11:17.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:11:17.790 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:11:17.796 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-09-15T22:11:17.815 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-09-15T22:11:17.815 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-09-15T22:11:17.872 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:11:17.873 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:11:17.874 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-09-15T22:11:17.891 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-15T22:11:17.909 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-15T22:11:17.910 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-15T22:11:17.967 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-09-15T22:11:17.967 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-09-15T22:11:17.967 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-09-15T22:11:17.967 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:11:17.967 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:11:17.968 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:11:17.968 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-15T22:11:17.991 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-15T22:11:18.009 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-15T22:11:18.009 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-15T22:11:18.067 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-15T22:11:18.067 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-15T22:11:18.067 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-15T22:11:18.067 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:11:18.067 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:11:18.068 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:11:18.069 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-15T22:11:18.091 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:11:18.100 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:11:18.108 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:11:18.108 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:11:18.111 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:11:18.113 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:11:18.129 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:11:18.136 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:11:18.136 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:11:18.168 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:11:18.170 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:11:18.286 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:11:18.363 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:11:18.377 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:11:18.377 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-15T22:11:18.378 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-15T22:11:18.378 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:11:18.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:11:18.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-15T22:11:18.561 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:11:18.561 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-15T22:11:18.562 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-15T22:11:18.579 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:11:18.580 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:11:18.580 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-15T22:11:18.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum upgrade -y linux-firmware 2024-09-15T22:11:21.090 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.2 MB 00:00 2024-09-15T22:11:24.416 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-15T22:11:28.775 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-15T22:11:30.242 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-15T22:11:31.330 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-15T22:11:37.027 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-15T22:11:39.340 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-15T22:11:39.341 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-09-15T22:11:39.341 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-15T22:11:39.442 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T22:11:39.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:11:39.592 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-15T22:11:39.592 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-15T22:11:39.595 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi022.front.sepia.ceph.com to complete... 2024-09-15T22:11:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15 22:11:47 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-15T22:11:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:FINISHED --2024-09-15 22:11:47-- 2024-09-15T22:11:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:Total wall clock time: 7.8s 2024-09-15T22:11:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Downloaded: 1 files, 343M in 7.6s (45.4 MB/s) 2024-09-15T22:11:47.474 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T22:11:47.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-15T22:11:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying... ######################################## 2024-09-15T22:11:49.835 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing... ######################################## 2024-09-15T22:11:49.968 INFO:teuthology.orchestra.run.smithi022.stdout:Updating / installing... 2024-09-15T22:11:58.374 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-15T22:12:38.666 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-15T22:12:38.667 DEBUG:teuthology.orchestra.run.smithi022:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-15T22:12:38.766 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.766 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.766 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.766 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-15T22:12:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-15T22:12:38.768 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-15T22:12:38.769 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-15T22:12:38.770 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-15T22:12:38.773 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-15T22:12:38.774 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-15T22:12:38.775 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-15T22:12:38.776 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-15T22:12:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-15T22:12:38.778 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-15T22:12:38.779 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-15T22:12:38.780 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-15T22:12:38.781 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-15T22:12:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-15T22:12:38.783 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-15T22:12:38.784 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-15T22:12:38.785 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-15T22:12:38.786 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-15T22:12:38.787 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-15T22:12:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-15T22:12:38.789 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-15T22:12:38.790 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-15T22:12:38.791 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-15T22:12:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-15T22:12:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-15T22:12:38.794 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-15T22:12:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-15T22:12:38.796 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-15T22:12:38.797 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-15T22:12:38.798 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-15T22:12:38.799 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-15T22:12:38.800 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-15T22:12:38.801 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-15T22:12:38.802 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-15T22:12:38.803 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-15T22:12:38.804 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-15T22:12:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-15T22:12:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-15T22:12:38.807 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-15T22:12:38.808 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-15T22:12:38.809 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-15T22:12:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-15T22:12:38.811 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-15T22:12:38.812 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-15T22:12:38.813 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-15T22:12:38.814 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-15T22:12:38.815 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-15T22:12:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-15T22:12:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-15T22:12:38.818 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-15T22:12:38.819 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-15T22:12:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-15T22:12:38.821 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-15T22:12:38.822 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-15T22:12:38.823 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-15T22:12:38.824 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-15T22:12:38.825 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-15T22:12:38.826 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-15T22:12:38.827 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-15T22:12:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-15T22:12:38.829 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-15T22:12:38.830 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-15T22:12:38.831 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-15T22:12:38.832 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-15T22:12:38.833 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-15T22:12:38.834 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-15T22:12:38.835 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-15T22:12:38.835 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-15T22:12:38.835 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-15T22:12:38.835 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-15T22:12:38.835 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-15T22:12:38.836 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-15T22:12:38.837 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-15T22:12:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-15T22:12:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-15T22:12:38.840 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-15T22:12:38.841 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-15T22:12:38.842 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-15T22:12:38.843 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-15T22:12:38.844 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-15T22:12:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-15T22:12:38.846 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-15T22:12:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-15T22:12:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-15T22:12:38.849 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-15T22:12:38.850 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-15T22:12:38.851 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-15T22:12:38.852 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-15T22:12:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-15T22:12:38.854 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-15T22:12:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-15T22:12:38.856 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-15T22:12:38.857 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-15T22:12:38.858 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-15T22:12:38.859 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-15T22:12:38.860 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-15T22:12:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-15T22:12:38.862 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-15T22:12:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-15T22:12:38.864 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-15T22:12:38.865 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-15T22:12:38.866 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-15T22:12:38.867 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-15T22:12:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-15T22:12:38.869 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-15T22:12:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-15T22:12:38.871 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-15T22:12:38.872 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-15T22:12:38.873 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-15T22:12:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-15T22:12:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-15T22:12:38.876 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-15T22:12:38.877 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-15T22:12:38.878 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-15T22:12:38.879 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-15T22:12:38.880 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-15T22:12:38.881 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-15T22:12:38.882 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-15T22:12:38.883 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-15T22:12:38.884 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-15T22:12:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-15T22:12:38.886 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-15T22:12:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-15T22:12:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-15T22:12:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-15T22:12:38.890 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-15T22:12:38.891 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-15T22:12:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-15T22:12:38.893 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-15T22:12:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-15T22:12:38.895 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-15T22:12:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-15T22:12:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-15T22:12:38.898 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-15T22:12:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-15T22:12:38.900 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-15T22:12:38.901 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-15T22:12:38.902 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-15T22:12:38.903 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-15T22:12:38.904 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-15T22:12:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-15T22:12:38.906 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-15T22:12:38.907 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-15T22:12:38.908 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-15T22:12:38.909 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-15T22:12:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-15T22:12:38.911 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-15T22:12:38.912 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-15T22:12:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-15T22:12:38.914 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-15T22:12:38.915 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-15T22:12:38.919 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.919 DEBUG:teuthology.orchestra.run.smithi022:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-15T22:12:38.942 INFO:teuthology.orchestra.run.smithi022.stdout:postinstall scriptlet (using /bin/sh): 2024-09-15T22:12:38.942 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-15T22:12:38.942 INFO:teuthology.orchestra.run.smithi022.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-15T22:12:38.942 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-09-15T22:12:38.942 INFO:teuthology.orchestra.run.smithi022.stdout:for file in vmlinuz System.map config; do 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: fi 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:done 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-15T22:12:38.943 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-15T22:12:38.944 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:38.944 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2024-09-15T22:12:38.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-09-15T22:12:39.022 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 82.el9 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8274670 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:12:39.023 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:12:39.024 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:12:39.025 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:12:39.025 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:39.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:12:39.714 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-09-15T22:12:41.055 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:12:41.088 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-09-15T22:12:41.091 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-09-15T22:12:41.106 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.Q0HuT7Ewn4 2024-09-15T22:12:41.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Q0HuT7Ewn4 2024-09-15T22:12:41.172 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.Q0HuT7Ewn4 2024-09-15T22:12:41.410 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.Q0HuT7Ewn4 is 6KB 2024-09-15T22:12:41.459 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.Q0HuT7Ewn4 2024-09-15T22:12:41.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:12:41.541 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:12:41.541 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:12:41.541 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:12:41.541 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-15T22:12:41.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:12:41.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-09-15T22:13:11.709 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T22:13:11.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-15T22:13:11.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:14:11.713 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:14:20.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-15T22:14:20.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:14:21.150 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-15T22:14:21.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-15T22:14:21.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-15T22:14:21.620 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-15T22:14:21.654 INFO:teuthology.orchestra.run.smithi022.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:14:21.655 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:14:21.655 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:14:21.655 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:14:22.658 DEBUG:teuthology.parallel:result is None 2024-09-15T22:14:22.658 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:14:22.666 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:14:22.666 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:14:22.670 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:14:22.672 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:14:22.701 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:14:22.707 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:14:22.769 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:14:22.769 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:14:22.774 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:14:22.777 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:14:22.890 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:14:22.902 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:14:22.902 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:14:22.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:14:22.919 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:14:22.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:14:22.937 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:14:22.941 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:14:22.963 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:14:23.002 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:14:23.022 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:14:23.035 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:14:23.055 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:14:23.066 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:14:23.117 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:14:23.120 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:14:23.129 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:14:23.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:14:23.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:14:23.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:14:23.186 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:14:23.195 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:14:23.195 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:14:23.199 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:14:23.205 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:14:23.230 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:14:23.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:14:23.414 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:14:23.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:14:23.554 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:14:23.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:14:23.645 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:14:23.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:14:23.747 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:14:23.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:14:23.878 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:14:23.878 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:14:23.946 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:14:23.987 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:14:24.048 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:14:24.129 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:14:24.176 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:14:24.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:14:24.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-09-15T22:14:24.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-15T22:14:24.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-15T22:14:24.286 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:14:24.318 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:14:24.328 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:14:24.743 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:14:24.751 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:14:24.751 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:14:24.767 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:14:24.783 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T22:14:24.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-09-15T22:14:24.888 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-09-15T22:14:24.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-09-15T22:14:24.964 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-09-15T22:14:24.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-15T22:14:25.024 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-15T22:14:25.025 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:14:25.026 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-09-15T22:14:25.067 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-09-15T22:14:25.067 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-09-15T22:14:25.090 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-09-15T22:14:25.090 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-15T22:14:25.114 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-15T22:14:25.115 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2024-09-15T22:14:25.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:14:25.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:14:25.176 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:14:25.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:14:25.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:14:25.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:14:25.237 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:14:25.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:14:25.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:14:25.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:14:25.483 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:14:25.493 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T22:14:25.496 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T22:14:25.610 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:14:25.621 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:14:25.622 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi110.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:19:11.016 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-09-15T22:19:11.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-15T22:19:11.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:19:11.108 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-15T22:19:11.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-15T22:19:11.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-15T22:19:11.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:19:11.293 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-15T22:19:11.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-15T22:19:11.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:19:11.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:19:11.445 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:19:11.525 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:19:11.540 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:19:11.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:19:11.545 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:19:11.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:19:11.548 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:19:11.548 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:19:11.575 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:19:11.590 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:19:11.596 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:19:11.608 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:19:11.611 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:19:11.614 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-09-15T22:19:11.625 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-09-15T22:19:11.636 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-15T22:19:11.639 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:19:11.640 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:19:11.647 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-15T22:19:11.654 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:19:11.661 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:19:11.676 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:19:11.693 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-09-15T22:19:11.714 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:19:11.718 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:19:11.718 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-15T22:19:11.718 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.718 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.719 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.719 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.719 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-09-15T22:19:11.735 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:19:11.738 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:19:11.738 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-15T22:19:11.738 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.738 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.739 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.739 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.747 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:19:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:19:11.875 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:19:11.882 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:19:11.882 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-15T22:19:11.882 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.883 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.883 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.883 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:19:11.884 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:19:11.892 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:19:11.893 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:19:11.893 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:19:11.893 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:19:11.898 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:19:11.898 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:19:11.898 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:19:11.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:19:11.900 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:19:11.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:19:11.902 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:19:11.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:19:12.044 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:19:12.044 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:19:12.059 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:19:12.059 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:19:12.062 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:19:12.062 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:19:12.154 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:19:12.154 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:19:12.154 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:19:12.166 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:19:12.166 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:19:12.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:19:12.175 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:19:12.175 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:19:12.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:19:12.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:19:12.192 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:19:12.201 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:19:12.201 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:19:12.211 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:19:12.211 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:19:12.257 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:19:12.266 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:19:12.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:19:12.333 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:19:12.342 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:19:12.388 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:19:12.397 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-15T22:19:12.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-15T22:19:12.406 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-09-15T22:19:12.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-09-15T22:19:12.443 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-09-15T22:19:12.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-09-15T22:19:12.624 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-15T22:19:12.633 INFO:teuthology.orchestra.run.smithi110.stdout:45 files removed 2024-09-15T22:19:12.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:19:12.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:19:12.761 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-09-15T22:19:12.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:19:13.199 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 305 kB/s | 83 kB 00:00 2024-09-15T22:19:13.223 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 292 kB/s | 83 kB 00:00 2024-09-15T22:19:13.484 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:19:13.507 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-15T22:19:13.511 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 275 kB/s | 83 kB 00:00 2024-09-15T22:19:13.851 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-09-15T22:19:13.933 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-09-15T22:19:13.996 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-09-15T22:19:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-09-15T22:19:14.507 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-15T22:19:14.888 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-15T22:19:16.417 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-15T22:19:16.842 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-15T22:19:16.973 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-15T22:19:18.585 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-15T22:19:20.843 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-15T22:19:22.336 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-15T22:19:22.827 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-15T22:19:23.215 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-15T22:19:23.365 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-15T22:19:24.187 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-15T22:19:25.199 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 19 kB 00:00 2024-09-15T22:19:25.365 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-15T22:19:26.337 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-15T22:19:28.821 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-15T22:19:30.747 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T22:19:31.089 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:19:31.090 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:19:31.102 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:19:31.103 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:19:31.103 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:19:31.104 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:19:31.106 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:19:31.108 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:19:31.109 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:19:31.173 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-15T22:19:31.192 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-15T22:19:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-15T22:19:31.193 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-15T22:19:31.193 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-15T22:19:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:19:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:19:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:19:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:19:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:19:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:19:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:19:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:19:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:19:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:19:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:19:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:19:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:19:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:19:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:19:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:19:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:19:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:19:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:19:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:19:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:19:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:19:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:19:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:19:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:19:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:19:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:19:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:19:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:19:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:19:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:19:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:19:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:19:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:19:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:19:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:19:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:19:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout:Install 148 Packages 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 8 Packages 2024-09-15T22:19:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:19:31.211 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 226 M 2024-09-15T22:19:31.211 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-15T22:19:31.522 INFO:teuthology.orchestra.run.smithi110.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-15T22:19:31.731 INFO:teuthology.orchestra.run.smithi110.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.2 MB/s | 896 kB 00:00 2024-09-15T22:19:31.781 INFO:teuthology.orchestra.run.smithi110.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.8 MB/s | 145 kB 00:00 2024-09-15T22:19:31.965 INFO:teuthology.orchestra.run.smithi110.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.2 MB/s | 5.4 MB 00:00 2024-09-15T22:19:32.024 INFO:teuthology.orchestra.run.smithi110.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-15T22:19:32.124 INFO:teuthology.orchestra.run.smithi110.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-15T22:19:32.449 INFO:teuthology.orchestra.run.smithi110.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-15T22:19:32.825 INFO:teuthology.orchestra.run.smithi110.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-15T22:19:32.866 INFO:teuthology.orchestra.run.smithi110.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 606 kB/s | 25 kB 00:00 2024-09-15T22:19:32.992 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:19:32.993 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:19:33.006 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:19:33.007 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:19:33.008 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:19:33.009 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:19:33.011 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:19:33.013 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:19:33.014 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:19:33.017 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-15T22:19:33.075 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:19:33.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:19:33.107 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:19:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:19:33.109 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:19:33.110 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:19:33.111 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:19:33.112 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:19:33.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:19:33.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:19:33.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:19:33.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:19:33.117 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout:Install 148 Packages 2024-09-15T22:19:33.118 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 8 Packages 2024-09-15T22:19:33.119 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:19:33.119 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 226 M 2024-09-15T22:19:33.119 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-15T22:19:33.142 INFO:teuthology.orchestra.run.smithi110.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 17 MB/s | 17 MB 00:01 2024-09-15T22:19:33.284 INFO:teuthology.orchestra.run.smithi110.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T22:19:33.309 INFO:teuthology.orchestra.run.smithi110.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.3 MB/s | 228 kB 00:00 2024-09-15T22:19:33.334 INFO:teuthology.orchestra.run.smithi110.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 540 kB/s | 27 kB 00:00 2024-09-15T22:19:33.359 INFO:teuthology.orchestra.run.smithi110.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 631 kB/s | 32 kB 00:00 2024-09-15T22:19:33.410 INFO:teuthology.orchestra.run.smithi110.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-15T22:19:33.435 INFO:teuthology.orchestra.run.smithi110.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.1 MB/s | 163 kB 00:00 2024-09-15T22:19:33.460 INFO:teuthology.orchestra.run.smithi110.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:19:33.495 INFO:teuthology.orchestra.run.smithi110.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 8.4 MB/s | 506 kB 00:00 2024-09-15T22:19:33.561 INFO:teuthology.orchestra.run.smithi110.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 678 kB/s | 45 kB 00:00 2024-09-15T22:19:33.628 INFO:teuthology.orchestra.run.smithi110.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.0 MB/s | 136 kB 00:00 2024-09-15T22:19:33.720 INFO:teuthology.orchestra.run.smithi110.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.7 MB/s | 161 kB 00:00 2024-09-15T22:19:33.828 INFO:teuthology.orchestra.run.smithi110.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-15T22:19:33.853 INFO:teuthology.orchestra.run.smithi110.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 2.3 MB/s | 320 kB 00:00 2024-09-15T22:19:33.887 INFO:teuthology.orchestra.run.smithi110.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T22:19:33.904 INFO:teuthology.orchestra.run.smithi110.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:19:33.938 INFO:teuthology.orchestra.run.smithi110.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:19:33.964 INFO:teuthology.orchestra.run.smithi112.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-15T22:19:34.013 INFO:teuthology.orchestra.run.smithi110.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-15T22:19:34.147 INFO:teuthology.orchestra.run.smithi110.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-15T22:19:34.180 INFO:teuthology.orchestra.run.smithi110.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 191 kB/s | 32 kB 00:00 2024-09-15T22:19:34.206 INFO:teuthology.orchestra.run.smithi110.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.5 MB/s | 146 kB 00:00 2024-09-15T22:19:34.473 INFO:teuthology.orchestra.run.smithi110.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 12 MB/s | 3.6 MB 00:00 2024-09-15T22:19:34.540 INFO:teuthology.orchestra.run.smithi112.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.5 MB/s | 896 kB 00:00 2024-09-15T22:19:34.640 INFO:teuthology.orchestra.run.smithi110.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-15T22:19:34.640 INFO:teuthology.orchestra.run.smithi112.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.4 MB/s | 145 kB 00:00 2024-09-15T22:19:34.665 INFO:teuthology.orchestra.run.smithi110.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 1.3 MB/s | 249 kB 00:00 2024-09-15T22:19:34.690 INFO:teuthology.orchestra.run.smithi110.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 983 kB/s | 49 kB 00:00 2024-09-15T22:19:34.716 INFO:teuthology.orchestra.run.smithi110.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 325 kB/s | 16 kB 00:00 2024-09-15T22:19:34.741 INFO:teuthology.orchestra.run.smithi110.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.5 MB/s | 285 kB 00:00 2024-09-15T22:19:34.775 INFO:teuthology.orchestra.run.smithi110.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 550 kB/s | 18 kB 00:00 2024-09-15T22:19:35.217 INFO:teuthology.orchestra.run.smithi110.stdout:(38/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 21 MB/s | 49 MB 00:02 2024-09-15T22:19:35.259 INFO:teuthology.orchestra.run.smithi110.stdout:(39/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-15T22:19:35.349 INFO:teuthology.orchestra.run.smithi112.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-09-15T22:19:35.401 INFO:teuthology.orchestra.run.smithi110.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 127 kB/s | 80 kB 00:00 2024-09-15T22:19:35.559 INFO:teuthology.orchestra.run.smithi110.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 637 kB/s | 191 kB 00:00 2024-09-15T22:19:35.585 INFO:teuthology.orchestra.run.smithi110.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-15T22:19:35.621 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:19:35.622 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:19:35.634 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:19:35.635 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:19:35.636 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:19:35.636 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:19:35.638 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:19:35.641 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:19:35.641 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:19:35.668 INFO:teuthology.orchestra.run.smithi110.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-15T22:19:35.710 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-15T22:19:35.716 INFO:teuthology.orchestra.run.smithi112.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 4.2 MB/s | 1.5 MB 00:00 2024-09-15T22:19:35.718 INFO:teuthology.orchestra.run.smithi110.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:19:35.727 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:19:35.728 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:19:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:19:35.730 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:19:35.731 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:19:35.732 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:19:35.733 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:19:35.734 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:19:35.735 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:19:35.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:19:35.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:19:35.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:19:35.739 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout:Install 148 Packages 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2024-09-15T22:19:35.740 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:19:35.741 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 226 M 2024-09-15T22:19:35.741 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-15T22:19:35.744 INFO:teuthology.orchestra.run.smithi110.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-15T22:19:35.794 INFO:teuthology.orchestra.run.smithi110.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-15T22:19:35.869 INFO:teuthology.orchestra.run.smithi110.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-15T22:19:35.903 INFO:teuthology.orchestra.run.smithi110.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.6 MB/s | 1.2 MB 00:00 2024-09-15T22:19:35.958 INFO:teuthology.orchestra.run.smithi112.stdout:(6/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 2.5 MB/s | 5.4 MB 00:02 2024-09-15T22:19:36.252 INFO:teuthology.orchestra.run.smithi022.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-15T22:19:36.427 INFO:teuthology.orchestra.run.smithi022.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 5.0 MB/s | 896 kB 00:00 2024-09-15T22:19:36.428 INFO:teuthology.orchestra.run.smithi110.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 204 kB/s | 107 kB 00:00 2024-09-15T22:19:36.486 INFO:teuthology.orchestra.run.smithi022.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.4 MB/s | 145 kB 00:00 2024-09-15T22:19:36.553 INFO:teuthology.orchestra.run.smithi110.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 174 kB/s | 22 kB 00:00 2024-09-15T22:19:36.720 INFO:teuthology.orchestra.run.smithi110.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 744 kB/s | 689 kB 00:00 2024-09-15T22:19:36.745 INFO:teuthology.orchestra.run.smithi022.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-15T22:19:36.775 INFO:teuthology.orchestra.run.smithi112.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 4.4 MB/s | 4.7 MB 00:01 2024-09-15T22:19:36.788 INFO:teuthology.orchestra.run.smithi110.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-15T22:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:(5/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 7.7 MB/s | 5.4 MB 00:00 2024-09-15T22:19:36.838 INFO:teuthology.orchestra.run.smithi110.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-15T22:19:36.937 INFO:teuthology.orchestra.run.smithi022.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.9 MB/s | 1.5 MB 00:00 2024-09-15T22:19:36.963 INFO:teuthology.orchestra.run.smithi110.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 766 kB/s | 313 kB 00:00 2024-09-15T22:19:36.988 INFO:teuthology.orchestra.run.smithi110.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 18 kB 00:00 2024-09-15T22:19:37.080 INFO:teuthology.orchestra.run.smithi110.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-15T22:19:37.114 INFO:teuthology.orchestra.run.smithi110.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-15T22:19:37.170 INFO:teuthology.orchestra.run.smithi022.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-15T22:19:37.197 INFO:teuthology.orchestra.run.smithi110.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-15T22:19:37.248 INFO:teuthology.orchestra.run.smithi110.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.5 MB/s | 3.0 MB 00:00 2024-09-15T22:19:37.364 INFO:teuthology.orchestra.run.smithi110.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 210 kB/s | 24 kB 00:00 2024-09-15T22:19:37.423 INFO:teuthology.orchestra.run.smithi110.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-15T22:19:37.481 INFO:teuthology.orchestra.run.smithi110.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-15T22:19:37.549 INFO:teuthology.orchestra.run.smithi110.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-15T22:19:37.607 INFO:teuthology.orchestra.run.smithi110.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-15T22:19:37.633 INFO:teuthology.orchestra.run.smithi110.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-15T22:19:37.658 INFO:teuthology.orchestra.run.smithi110.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-15T22:19:37.762 INFO:teuthology.orchestra.run.smithi022.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 21 MB 00:01 2024-09-15T22:19:37.804 INFO:teuthology.orchestra.run.smithi022.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 607 kB/s | 25 kB 00:00 2024-09-15T22:19:37.963 INFO:teuthology.orchestra.run.smithi022.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T22:19:38.013 INFO:teuthology.orchestra.run.smithi022.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 4.5 MB/s | 228 kB 00:00 2024-09-15T22:19:38.025 INFO:teuthology.orchestra.run.smithi110.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-09-15T22:19:38.067 INFO:teuthology.orchestra.run.smithi112.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 5.0 MB/s | 21 MB 00:04 2024-09-15T22:19:38.117 INFO:teuthology.orchestra.run.smithi112.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 508 kB/s | 25 kB 00:00 2024-09-15T22:19:38.167 INFO:teuthology.orchestra.run.smithi110.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-15T22:19:38.238 INFO:teuthology.orchestra.run.smithi022.stdout:(12/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 13 MB/s | 17 MB 00:01 2024-09-15T22:19:38.256 INFO:teuthology.orchestra.run.smithi022.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 112 kB/s | 27 kB 00:00 2024-09-15T22:19:38.281 INFO:teuthology.orchestra.run.smithi022.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 751 kB/s | 32 kB 00:00 2024-09-15T22:19:38.300 INFO:teuthology.orchestra.run.smithi110.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-15T22:19:38.322 INFO:teuthology.orchestra.run.smithi022.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-15T22:19:38.356 INFO:teuthology.orchestra.run.smithi022.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.1 MB/s | 163 kB 00:00 2024-09-15T22:19:38.381 INFO:teuthology.orchestra.run.smithi022.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T22:19:38.423 INFO:teuthology.orchestra.run.smithi022.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-15T22:19:38.482 INFO:teuthology.orchestra.run.smithi022.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 777 kB/s | 45 kB 00:00 2024-09-15T22:19:38.565 INFO:teuthology.orchestra.run.smithi022.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-15T22:19:38.658 INFO:teuthology.orchestra.run.smithi022.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-15T22:19:38.691 INFO:teuthology.orchestra.run.smithi022.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.3 MB/s | 161 kB 00:00 2024-09-15T22:19:38.741 INFO:teuthology.orchestra.run.smithi022.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 3.8 MB/s | 320 kB 00:00 2024-09-15T22:19:38.767 INFO:teuthology.orchestra.run.smithi022.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 3.9 MB/s | 300 kB 00:00 2024-09-15T22:19:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:19:38.817 INFO:teuthology.orchestra.run.smithi022.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:19:38.868 INFO:teuthology.orchestra.run.smithi110.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-15T22:19:38.885 INFO:teuthology.orchestra.run.smithi022.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-15T22:19:38.960 INFO:teuthology.orchestra.run.smithi022.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-15T22:19:38.985 INFO:teuthology.orchestra.run.smithi022.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 319 kB/s | 32 kB 00:00 2024-09-15T22:19:39.011 INFO:teuthology.orchestra.run.smithi022.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.8 MB/s | 146 kB 00:00 2024-09-15T22:19:39.133 INFO:teuthology.orchestra.run.smithi112.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 4.5 MB/s | 11 MB 00:02 2024-09-15T22:19:39.268 INFO:teuthology.orchestra.run.smithi110.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-09-15T22:19:39.353 INFO:teuthology.orchestra.run.smithi022.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 9.7 MB/s | 3.6 MB 00:00 2024-09-15T22:19:39.359 INFO:teuthology.orchestra.run.smithi112.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.0 MB/s | 228 kB 00:00 2024-09-15T22:19:39.417 INFO:teuthology.orchestra.run.smithi112.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 463 kB/s | 27 kB 00:00 2024-09-15T22:19:39.459 INFO:teuthology.orchestra.run.smithi112.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 764 kB/s | 32 kB 00:00 2024-09-15T22:19:39.486 INFO:teuthology.orchestra.run.smithi022.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-15T22:19:39.509 INFO:teuthology.orchestra.run.smithi110.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 362 kB/s | 87 kB 00:00 2024-09-15T22:19:39.511 INFO:teuthology.orchestra.run.smithi022.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 1.5 MB/s | 249 kB 00:00 2024-09-15T22:19:39.537 INFO:teuthology.orchestra.run.smithi022.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 983 kB/s | 49 kB 00:00 2024-09-15T22:19:39.562 INFO:teuthology.orchestra.run.smithi022.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T22:19:39.587 INFO:teuthology.orchestra.run.smithi022.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T22:19:39.618 INFO:teuthology.orchestra.run.smithi112.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 4.6 MB/s | 751 kB 00:00 2024-09-15T22:19:39.629 INFO:teuthology.orchestra.run.smithi022.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 441 kB/s | 18 kB 00:00 2024-09-15T22:19:39.687 INFO:teuthology.orchestra.run.smithi022.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-15T22:19:39.701 INFO:teuthology.orchestra.run.smithi112.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.9 MB/s | 163 kB 00:00 2024-09-15T22:19:39.752 INFO:teuthology.orchestra.run.smithi112.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:19:39.796 INFO:teuthology.orchestra.run.smithi022.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-15T22:19:39.872 INFO:teuthology.orchestra.run.smithi022.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-15T22:19:39.930 INFO:teuthology.orchestra.run.smithi022.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-09-15T22:19:39.969 INFO:teuthology.orchestra.run.smithi112.stdout:(17/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 4.2 MB/s | 17 MB 00:04 2024-09-15T22:19:39.972 INFO:teuthology.orchestra.run.smithi022.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-15T22:19:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 2.0 MB/s | 506 kB 00:00 2024-09-15T22:19:40.052 INFO:teuthology.orchestra.run.smithi112.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 907 kB/s | 45 kB 00:00 2024-09-15T22:19:40.119 INFO:teuthology.orchestra.run.smithi112.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.0 MB/s | 136 kB 00:00 2024-09-15T22:19:40.186 INFO:teuthology.orchestra.run.smithi112.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-15T22:19:40.278 INFO:teuthology.orchestra.run.smithi112.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 3.4 MB/s | 320 kB 00:00 2024-09-15T22:19:40.362 INFO:teuthology.orchestra.run.smithi112.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 3.5 MB/s | 300 kB 00:00 2024-09-15T22:19:40.412 INFO:teuthology.orchestra.run.smithi112.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 2.0 MB/s | 99 kB 00:00 2024-09-15T22:19:40.439 INFO:teuthology.orchestra.run.smithi022.stdout:(43/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 18 MB/s | 49 MB 00:02 2024-09-15T22:19:40.462 INFO:teuthology.orchestra.run.smithi112.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:19:40.465 INFO:teuthology.orchestra.run.smithi022.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 216 kB/s | 106 kB 00:00 2024-09-15T22:19:40.507 INFO:teuthology.orchestra.run.smithi022.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-09-15T22:19:40.540 INFO:teuthology.orchestra.run.smithi022.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-15T22:19:40.565 INFO:teuthology.orchestra.run.smithi022.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-15T22:19:40.607 INFO:teuthology.orchestra.run.smithi022.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 808 kB/s | 135 kB 00:00 2024-09-15T22:19:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 579 kB/s | 1.0 MB 00:01 2024-09-15T22:19:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 421 kB/s | 61 kB 00:00 2024-09-15T22:19:40.841 INFO:teuthology.orchestra.run.smithi022.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 458 kB/s | 107 kB 00:00 2024-09-15T22:19:40.925 INFO:teuthology.orchestra.run.smithi022.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 261 kB/s | 22 kB 00:00 2024-09-15T22:19:40.958 INFO:teuthology.orchestra.run.smithi022.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 689 kB 00:00 2024-09-15T22:19:40.987 INFO:teuthology.orchestra.run.smithi112.stdout:(26/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 5.2 MB/s | 5.3 MB 00:01 2024-09-15T22:19:40.992 INFO:teuthology.orchestra.run.smithi022.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-15T22:19:41.017 INFO:teuthology.orchestra.run.smithi022.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-15T22:19:41.092 INFO:teuthology.orchestra.run.smithi022.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-15T22:19:41.096 INFO:teuthology.orchestra.run.smithi112.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.5 MB/s | 170 kB 00:00 2024-09-15T22:19:41.109 INFO:teuthology.orchestra.run.smithi022.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-15T22:19:41.138 INFO:teuthology.orchestra.run.smithi112.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 769 kB/s | 32 kB 00:00 2024-09-15T22:19:41.151 INFO:teuthology.orchestra.run.smithi022.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-15T22:19:41.176 INFO:teuthology.orchestra.run.smithi022.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-15T22:19:41.197 INFO:teuthology.orchestra.run.smithi112.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 4.2 MB/s | 3.1 MB 00:00 2024-09-15T22:19:41.219 INFO:teuthology.orchestra.run.smithi022.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-15T22:19:41.222 INFO:teuthology.orchestra.run.smithi112.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.7 MB/s | 146 kB 00:00 2024-09-15T22:19:41.239 INFO:teuthology.orchestra.run.smithi110.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 554 kB/s | 245 kB 00:00 2024-09-15T22:19:41.336 INFO:teuthology.orchestra.run.smithi022.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-15T22:19:41.361 INFO:teuthology.orchestra.run.smithi022.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-15T22:19:41.411 INFO:teuthology.orchestra.run.smithi022.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-15T22:19:41.437 INFO:teuthology.orchestra.run.smithi022.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-15T22:19:41.495 INFO:teuthology.orchestra.run.smithi022.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-15T22:19:41.520 INFO:teuthology.orchestra.run.smithi022.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-15T22:19:41.563 INFO:teuthology.orchestra.run.smithi022.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-15T22:19:41.672 INFO:teuthology.orchestra.run.smithi110.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 573 kB/s | 248 kB 00:00 2024-09-15T22:19:41.798 INFO:teuthology.orchestra.run.smithi110.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-15T22:19:41.931 INFO:teuthology.orchestra.run.smithi110.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 144 kB/s | 19 kB 00:00 2024-09-15T22:19:42.055 INFO:teuthology.orchestra.run.smithi112.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 4.1 MB/s | 3.6 MB 00:00 2024-09-15T22:19:42.122 INFO:teuthology.orchestra.run.smithi112.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.7 MB/s | 249 kB 00:00 2024-09-15T22:19:42.164 INFO:teuthology.orchestra.run.smithi112.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 1.2 MB/s | 49 kB 00:00 2024-09-15T22:19:42.179 INFO:teuthology.orchestra.run.smithi022.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-15T22:19:42.206 INFO:teuthology.orchestra.run.smithi112.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 395 kB/s | 16 kB 00:00 2024-09-15T22:19:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 516 kB/s | 172 kB 00:00 2024-09-15T22:19:42.281 INFO:teuthology.orchestra.run.smithi112.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 3.7 MB/s | 285 kB 00:00 2024-09-15T22:19:42.382 INFO:teuthology.orchestra.run.smithi110.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-09-15T22:19:42.506 INFO:teuthology.orchestra.run.smithi112.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 3.3 MB/s | 765 kB 00:00 2024-09-15T22:19:42.548 INFO:teuthology.orchestra.run.smithi112.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 439 kB/s | 18 kB 00:00 2024-09-15T22:19:42.715 INFO:teuthology.orchestra.run.smithi112.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 5.0 MB/s | 7.4 MB 00:01 2024-09-15T22:19:42.740 INFO:teuthology.orchestra.run.smithi112.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-15T22:19:42.815 INFO:teuthology.orchestra.run.smithi112.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-15T22:19:42.866 INFO:teuthology.orchestra.run.smithi112.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-15T22:19:42.899 INFO:teuthology.orchestra.run.smithi112.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-15T22:19:42.941 INFO:teuthology.orchestra.run.smithi112.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-15T22:19:42.975 INFO:teuthology.orchestra.run.smithi112.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-15T22:19:42.992 INFO:teuthology.orchestra.run.smithi112.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-15T22:19:43.025 INFO:teuthology.orchestra.run.smithi112.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-15T22:19:43.051 INFO:teuthology.orchestra.run.smithi112.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-15T22:19:43.138 INFO:teuthology.orchestra.run.smithi022.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-09-15T22:19:43.230 INFO:teuthology.orchestra.run.smithi022.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 9.8 MB/s | 910 kB 00:00 2024-09-15T22:19:43.314 INFO:teuthology.orchestra.run.smithi022.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-15T22:19:43.380 INFO:teuthology.orchestra.run.smithi022.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2024-09-15T22:19:43.556 INFO:teuthology.orchestra.run.smithi022.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-15T22:19:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:(72/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.3 MB/s | 4.9 MB 00:02 2024-09-15T22:19:43.689 INFO:teuthology.orchestra.run.smithi022.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 657 kB/s | 87 kB 00:00 2024-09-15T22:19:43.757 INFO:teuthology.orchestra.run.smithi022.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 917 kB/s | 61 kB 00:00 2024-09-15T22:19:43.848 INFO:teuthology.orchestra.run.smithi022.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-15T22:19:43.901 INFO:teuthology.orchestra.run.smithi112.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 787 kB/s | 689 kB 00:00 2024-09-15T22:19:43.932 INFO:teuthology.orchestra.run.smithi022.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-15T22:19:43.999 INFO:teuthology.orchestra.run.smithi022.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-15T22:19:44.035 INFO:teuthology.orchestra.run.smithi112.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-15T22:19:44.066 INFO:teuthology.orchestra.run.smithi022.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-09-15T22:19:44.125 INFO:teuthology.orchestra.run.smithi022.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-15T22:19:44.126 INFO:teuthology.orchestra.run.smithi112.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 877 kB/s | 943 kB 00:01 2024-09-15T22:19:44.152 INFO:teuthology.orchestra.run.smithi112.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-15T22:19:44.192 INFO:teuthology.orchestra.run.smithi022.stdout:(80/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-15T22:19:44.217 INFO:teuthology.orchestra.run.smithi022.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 379 kB/s | 35 kB 00:00 2024-09-15T22:19:44.252 INFO:teuthology.orchestra.run.smithi112.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-15T22:19:44.285 INFO:teuthology.orchestra.run.smithi112.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-15T22:19:44.351 INFO:teuthology.orchestra.run.smithi022.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-15T22:19:44.394 INFO:teuthology.orchestra.run.smithi112.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-15T22:19:44.409 INFO:teuthology.orchestra.run.smithi022.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-15T22:19:44.443 INFO:teuthology.orchestra.run.smithi022.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-09-15T22:19:44.477 INFO:teuthology.orchestra.run.smithi022.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-15T22:19:44.502 INFO:teuthology.orchestra.run.smithi022.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-09-15T22:19:44.503 INFO:teuthology.orchestra.run.smithi112.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-15T22:19:44.536 INFO:teuthology.orchestra.run.smithi022.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-15T22:19:44.603 INFO:teuthology.orchestra.run.smithi022.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-15T22:19:44.620 INFO:teuthology.orchestra.run.smithi112.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-15T22:19:44.661 INFO:teuthology.orchestra.run.smithi022.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-15T22:19:44.678 INFO:teuthology.orchestra.run.smithi112.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-09-15T22:19:44.686 INFO:teuthology.orchestra.run.smithi022.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 611 kB/s | 51 kB 00:00 2024-09-15T22:19:44.707 INFO:teuthology.orchestra.run.smithi110.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 923 kB/s | 5.8 MB 00:06 2024-09-15T22:19:44.712 INFO:teuthology.orchestra.run.smithi022.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:19:44.720 INFO:teuthology.orchestra.run.smithi112.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-15T22:19:44.804 INFO:teuthology.orchestra.run.smithi022.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 455 kB/s | 42 kB 00:00 2024-09-15T22:19:44.804 INFO:teuthology.orchestra.run.smithi112.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-15T22:19:44.864 INFO:teuthology.orchestra.run.smithi022.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 742 kB/s | 44 kB 00:00 2024-09-15T22:19:44.904 INFO:teuthology.orchestra.run.smithi112.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 245 kB/s | 24 kB 00:00 2024-09-15T22:19:44.929 INFO:teuthology.orchestra.run.smithi112.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-15T22:19:45.082 INFO:teuthology.orchestra.run.smithi110.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 669 kB/s | 250 kB 00:00 2024-09-15T22:19:45.106 INFO:teuthology.orchestra.run.smithi022.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-15T22:19:45.131 INFO:teuthology.orchestra.run.smithi022.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 827 kB/s | 221 kB 00:00 2024-09-15T22:19:45.165 INFO:teuthology.orchestra.run.smithi022.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-15T22:19:45.190 INFO:teuthology.orchestra.run.smithi022.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-15T22:19:45.240 INFO:teuthology.orchestra.run.smithi022.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-15T22:19:45.291 INFO:teuthology.orchestra.run.smithi022.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 576 kB/s | 58 kB 00:00 2024-09-15T22:19:45.316 INFO:teuthology.orchestra.run.smithi022.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-15T22:19:45.380 INFO:teuthology.orchestra.run.smithi112.stdout:(62/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 6.7 MB/s | 49 MB 00:07 2024-09-15T22:19:45.400 INFO:teuthology.orchestra.run.smithi022.stdout:(101/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-09-15T22:19:45.405 INFO:teuthology.orchestra.run.smithi112.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 95 kB/s | 47 kB 00:00 2024-09-15T22:19:45.425 INFO:teuthology.orchestra.run.smithi022.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-15T22:19:45.439 INFO:teuthology.orchestra.run.smithi112.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 575 kB/s | 292 kB 00:00 2024-09-15T22:19:45.458 INFO:teuthology.orchestra.run.smithi022.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 380 kB/s | 64 kB 00:00 2024-09-15T22:19:45.474 INFO:teuthology.orchestra.run.smithi110.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 567 kB/s | 222 kB 00:00 2024-09-15T22:19:45.522 INFO:teuthology.orchestra.run.smithi112.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-15T22:19:45.552 INFO:teuthology.orchestra.run.smithi022.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-15T22:19:45.593 INFO:teuthology.orchestra.run.smithi022.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-15T22:19:45.618 INFO:teuthology.orchestra.run.smithi022.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-15T22:19:45.675 INFO:teuthology.orchestra.run.smithi110.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-15T22:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-15T22:19:45.777 INFO:teuthology.orchestra.run.smithi022.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-09-15T22:19:45.800 INFO:teuthology.orchestra.run.smithi110.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 338 kB/s | 42 kB 00:00 2024-09-15T22:19:45.810 INFO:teuthology.orchestra.run.smithi022.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-15T22:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-15T22:19:45.931 INFO:teuthology.orchestra.run.smithi112.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 342 kB/s | 188 kB 00:00 2024-09-15T22:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-15T22:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-15T22:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 573 kB/s | 14 kB 00:00 2024-09-15T22:19:46.073 INFO:teuthology.orchestra.run.smithi112.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 7.8 MB/s | 4.9 MB 00:00 2024-09-15T22:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-15T22:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-15T22:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T22:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-15T22:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-15T22:19:46.258 INFO:teuthology.orchestra.run.smithi110.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 588 kB/s | 269 kB 00:00 2024-09-15T22:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-15T22:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-15T22:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 777 kB/s | 18 kB 00:00 2024-09-15T22:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-15T22:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-15T22:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 466 kB/s | 19 kB 00:00 2024-09-15T22:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-09-15T22:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:19:46.498 INFO:teuthology.orchestra.run.smithi112.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 2.8 MB/s | 1.6 MB 00:00 2024-09-15T22:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:19:46.542 INFO:teuthology.orchestra.run.smithi110.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-15T22:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-15T22:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-15T22:19:46.606 INFO:teuthology.orchestra.run.smithi112.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-15T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-15T22:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-15T22:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-15T22:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2024-09-15T22:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-15T22:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-15T22:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-09-15T22:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-15T22:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-15T22:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-15T22:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-15T22:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-15T22:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-15T22:19:47.009 INFO:teuthology.orchestra.run.smithi110.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 598 kB/s | 279 kB 00:00 2024-09-15T22:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T22:19:47.118 INFO:teuthology.orchestra.run.smithi110.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-15T22:19:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-09-15T22:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-15T22:19:47.314 INFO:teuthology.orchestra.run.smithi022.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.7 MB/s | 2.3 MB 00:00 2024-09-15T22:19:47.356 INFO:teuthology.orchestra.run.smithi022.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 977 kB/s | 41 kB 00:00 2024-09-15T22:19:47.406 INFO:teuthology.orchestra.run.smithi022.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-15T22:19:47.423 INFO:teuthology.orchestra.run.smithi112.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 674 kB/s | 910 kB 00:01 2024-09-15T22:19:47.448 INFO:teuthology.orchestra.run.smithi022.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-15T22:19:47.516 INFO:teuthology.orchestra.run.smithi022.stdout:(154/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 6.3 MB/s | 3.2 MB 00:00 2024-09-15T22:19:47.557 INFO:teuthology.orchestra.run.smithi022.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-15T22:19:47.616 INFO:teuthology.orchestra.run.smithi022.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-15T22:19:47.621 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:19:47.622 INFO:teuthology.orchestra.run.smithi022.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-15T22:19:47.890 INFO:teuthology.orchestra.run.smithi112.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-09-15T22:19:48.090 INFO:teuthology.orchestra.run.smithi112.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-15T22:19:49.008 INFO:teuthology.orchestra.run.smithi112.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 652 kB/s | 1.0 MB 00:01 2024-09-15T22:19:49.116 INFO:teuthology.orchestra.run.smithi112.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-15T22:19:49.227 INFO:teuthology.orchestra.run.smithi110.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 628 kB/s | 6.0 MB 00:09 2024-09-15T22:19:49.343 INFO:teuthology.orchestra.run.smithi110.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-15T22:19:49.460 INFO:teuthology.orchestra.run.smithi110.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 379 kB/s | 44 kB 00:00 2024-09-15T22:19:49.491 INFO:teuthology.orchestra.run.smithi112.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-15T22:19:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-15T22:19:49.836 INFO:teuthology.orchestra.run.smithi110.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 589 kB/s | 221 kB 00:00 2024-09-15T22:19:49.888 INFO:teuthology.orchestra.run.smithi112.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 626 kB/s | 248 kB 00:00 2024-09-15T22:19:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-15T22:19:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-15T22:19:50.000 INFO:teuthology.orchestra.run.smithi112.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 230 kB/s | 26 kB 00:00 2024-09-15T22:19:50.027 INFO:teuthology.orchestra.run.smithi110.stdout:(95/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 683 kB/s | 5.1 MB 00:07 2024-09-15T22:19:50.053 INFO:teuthology.orchestra.run.smithi110.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 165 kB/s | 36 kB 00:00 2024-09-15T22:19:50.109 INFO:teuthology.orchestra.run.smithi112.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-15T22:19:50.136 INFO:teuthology.orchestra.run.smithi110.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-15T22:19:50.245 INFO:teuthology.orchestra.run.smithi110.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-15T22:19:50.442 INFO:teuthology.orchestra.run.smithi112.stdout:(79/156): postgresql-server-13.16-1.el9.x86_64. 1.5 MB/s | 5.8 MB 00:03 2024-09-15T22:19:50.445 INFO:teuthology.orchestra.run.smithi110.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 479 kB/s | 96 kB 00:00 2024-09-15T22:19:50.467 INFO:teuthology.orchestra.run.smithi112.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 480 kB/s | 172 kB 00:00 2024-09-15T22:19:50.559 INFO:teuthology.orchestra.run.smithi112.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-09-15T22:19:50.562 INFO:teuthology.orchestra.run.smithi110.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 597 kB/s | 304 kB 00:00 2024-09-15T22:19:50.646 INFO:teuthology.orchestra.run.smithi110.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-15T22:19:50.671 INFO:teuthology.orchestra.run.smithi110.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-15T22:19:50.755 INFO:teuthology.orchestra.run.smithi110.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-15T22:19:50.822 INFO:teuthology.orchestra.run.smithi110.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-15T22:19:50.863 INFO:teuthology.orchestra.run.smithi110.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-15T22:19:50.889 INFO:teuthology.orchestra.run.smithi110.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi112.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-15T22:19:50.981 INFO:teuthology.orchestra.run.smithi110.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-09-15T22:19:51.031 INFO:teuthology.orchestra.run.smithi110.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-09-15T22:19:51.065 INFO:teuthology.orchestra.run.smithi110.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-15T22:19:51.098 INFO:teuthology.orchestra.run.smithi110.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:19:51.174 INFO:teuthology.orchestra.run.smithi110.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-15T22:19:51.199 INFO:teuthology.orchestra.run.smithi110.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-15T22:19:51.258 INFO:teuthology.orchestra.run.smithi110.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-15T22:19:51.283 INFO:teuthology.orchestra.run.smithi110.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:19:51.308 INFO:teuthology.orchestra.run.smithi110.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-15T22:19:51.318 INFO:teuthology.orchestra.run.smithi112.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 580 kB/s | 222 kB 00:00 2024-09-15T22:19:51.325 INFO:teuthology.orchestra.run.smithi110.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 769 kB/s | 32 kB 00:00 2024-09-15T22:19:51.351 INFO:teuthology.orchestra.run.smithi110.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 336 kB/s | 14 kB 00:00 2024-09-15T22:19:51.376 INFO:teuthology.orchestra.run.smithi110.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:19:51.410 INFO:teuthology.orchestra.run.smithi110.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T22:19:51.435 INFO:teuthology.orchestra.run.smithi110.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T22:19:51.460 INFO:teuthology.orchestra.run.smithi110.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:19:51.494 INFO:teuthology.orchestra.run.smithi110.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-15T22:19:51.510 INFO:teuthology.orchestra.run.smithi112.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 403 kB/s | 77 kB 00:00 2024-09-15T22:19:51.510 INFO:teuthology.orchestra.run.smithi110.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-15T22:19:51.536 INFO:teuthology.orchestra.run.smithi110.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-15T22:19:51.586 INFO:teuthology.orchestra.run.smithi110.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-09-15T22:19:51.611 INFO:teuthology.orchestra.run.smithi110.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-09-15T22:19:51.627 INFO:teuthology.orchestra.run.smithi112.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-15T22:19:51.637 INFO:teuthology.orchestra.run.smithi110.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-15T22:19:51.662 INFO:teuthology.orchestra.run.smithi110.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-15T22:19:51.687 INFO:teuthology.orchestra.run.smithi110.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:19:51.712 INFO:teuthology.orchestra.run.smithi110.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:19:51.738 INFO:teuthology.orchestra.run.smithi110.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:19:51.771 INFO:teuthology.orchestra.run.smithi110.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-15T22:19:51.797 INFO:teuthology.orchestra.run.smithi110.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-15T22:19:51.822 INFO:teuthology.orchestra.run.smithi110.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-15T22:19:51.847 INFO:teuthology.orchestra.run.smithi110.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-15T22:19:51.873 INFO:teuthology.orchestra.run.smithi110.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-15T22:19:51.898 INFO:teuthology.orchestra.run.smithi110.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-15T22:19:51.923 INFO:teuthology.orchestra.run.smithi110.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-15T22:19:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T22:19:51.982 INFO:teuthology.orchestra.run.smithi110.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-09-15T22:19:52.008 INFO:teuthology.orchestra.run.smithi110.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-15T22:19:52.033 INFO:teuthology.orchestra.run.smithi110.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-15T22:19:52.058 INFO:teuthology.orchestra.run.smithi110.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T22:19:52.084 INFO:teuthology.orchestra.run.smithi110.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-15T22:19:52.094 INFO:teuthology.orchestra.run.smithi112.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-15T22:19:52.109 INFO:teuthology.orchestra.run.smithi110.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-15T22:19:52.126 INFO:teuthology.orchestra.run.smithi110.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-15T22:19:52.226 INFO:teuthology.orchestra.run.smithi110.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-15T22:19:52.377 INFO:teuthology.orchestra.run.smithi112.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-15T22:19:52.402 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-15T22:19:52.402 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-15T22:19:52.468 INFO:teuthology.orchestra.run.smithi110.stdout:(148/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-15T22:19:52.643 INFO:teuthology.orchestra.run.smithi110.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 6.6 MB/s | 3.4 MB 00:00 2024-09-15T22:19:52.836 INFO:teuthology.orchestra.run.smithi112.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 608 kB/s | 279 kB 00:00 2024-09-15T22:19:52.978 INFO:teuthology.orchestra.run.smithi112.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 360 kB/s | 51 kB 00:00 2024-09-15T22:19:53.052 INFO:teuthology.orchestra.run.smithi110.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 4.4 MB/s | 1.8 MB 00:00 2024-09-15T22:19:53.095 INFO:teuthology.orchestra.run.smithi112.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 461 kB/s | 54 kB 00:00 2024-09-15T22:19:53.110 INFO:teuthology.orchestra.run.smithi110.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 703 kB/s | 41 kB 00:00 2024-09-15T22:19:53.178 INFO:teuthology.orchestra.run.smithi110.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 3.3 MB/s | 2.3 MB 00:00 2024-09-15T22:19:53.253 INFO:teuthology.orchestra.run.smithi110.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.7 MB/s | 249 kB 00:00 2024-09-15T22:19:53.895 INFO:teuthology.orchestra.run.smithi110.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-15T22:19:54.437 INFO:teuthology.orchestra.run.smithi110.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-15T22:19:54.995 INFO:teuthology.orchestra.run.smithi112.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-09-15T22:19:55.111 INFO:teuthology.orchestra.run.smithi112.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi112.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 379 kB/s | 44 kB 00:00 2024-09-15T22:19:55.604 INFO:teuthology.orchestra.run.smithi112.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 589 kB/s | 221 kB 00:00 2024-09-15T22:19:55.746 INFO:teuthology.orchestra.run.smithi112.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 253 kB/s | 36 kB 00:00 2024-09-15T22:19:55.863 INFO:teuthology.orchestra.run.smithi112.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-15T22:19:56.330 INFO:teuthology.orchestra.run.smithi112.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 652 kB/s | 304 kB 00:00 2024-09-15T22:19:56.438 INFO:teuthology.orchestra.run.smithi112.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-15T22:19:56.638 INFO:teuthology.orchestra.run.smithi112.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 479 kB/s | 96 kB 00:00 2024-09-15T22:19:56.872 INFO:teuthology.orchestra.run.smithi112.stdout:(100/156): python3-babel-2.9.1-2.el9.noarch.rpm 695 kB/s | 6.0 MB 00:08 2024-09-15T22:19:56.897 INFO:teuthology.orchestra.run.smithi112.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2024-09-15T22:19:56.973 INFO:teuthology.orchestra.run.smithi112.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-15T22:19:57.006 INFO:teuthology.orchestra.run.smithi112.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 334 kB/s | 45 kB 00:00 2024-09-15T22:19:57.074 INFO:teuthology.orchestra.run.smithi112.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-15T22:19:57.115 INFO:teuthology.orchestra.run.smithi112.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-15T22:19:57.149 INFO:teuthology.orchestra.run.smithi112.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-15T22:19:57.166 INFO:teuthology.orchestra.run.smithi112.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-15T22:19:57.191 INFO:teuthology.orchestra.run.smithi112.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.4 MB/s | 26 kB 00:00 2024-09-15T22:19:57.216 INFO:teuthology.orchestra.run.smithi112.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-15T22:19:57.250 INFO:teuthology.orchestra.run.smithi112.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:19:57.284 INFO:teuthology.orchestra.run.smithi112.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T22:19:57.359 INFO:teuthology.orchestra.run.smithi112.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-15T22:19:57.409 INFO:teuthology.orchestra.run.smithi112.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-15T22:19:57.434 INFO:teuthology.orchestra.run.smithi112.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:19:57.459 INFO:teuthology.orchestra.run.smithi112.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:19:57.485 INFO:teuthology.orchestra.run.smithi112.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-15T22:19:57.518 INFO:teuthology.orchestra.run.smithi112.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-15T22:19:57.561 INFO:teuthology.orchestra.run.smithi112.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-15T22:19:57.602 INFO:teuthology.orchestra.run.smithi112.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-15T22:19:57.636 INFO:teuthology.orchestra.run.smithi112.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-15T22:19:57.720 INFO:teuthology.orchestra.run.smithi112.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-15T22:19:57.753 INFO:teuthology.orchestra.run.smithi112.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-15T22:19:57.778 INFO:teuthology.orchestra.run.smithi112.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-15T22:19:57.804 INFO:teuthology.orchestra.run.smithi112.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-15T22:19:57.829 INFO:teuthology.orchestra.run.smithi112.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-15T22:19:57.854 INFO:teuthology.orchestra.run.smithi112.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-15T22:19:57.921 INFO:teuthology.orchestra.run.smithi112.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 296 kB/s | 20 kB 00:00 2024-09-15T22:19:57.963 INFO:teuthology.orchestra.run.smithi112.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.2 MB/s | 2.0 MB 00:00 2024-09-15T22:19:57.988 INFO:teuthology.orchestra.run.smithi112.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:19:58.022 INFO:teuthology.orchestra.run.smithi112.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:19:58.047 INFO:teuthology.orchestra.run.smithi112.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:19:58.081 INFO:teuthology.orchestra.run.smithi112.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-15T22:19:58.106 INFO:teuthology.orchestra.run.smithi112.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-15T22:19:58.140 INFO:teuthology.orchestra.run.smithi112.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-15T22:19:58.157 INFO:teuthology.orchestra.run.smithi112.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-15T22:19:58.182 INFO:teuthology.orchestra.run.smithi112.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-15T22:19:58.207 INFO:teuthology.orchestra.run.smithi112.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-15T22:19:58.233 INFO:teuthology.orchestra.run.smithi112.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-15T22:19:58.258 INFO:teuthology.orchestra.run.smithi112.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T22:19:58.283 INFO:teuthology.orchestra.run.smithi112.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-15T22:19:58.308 INFO:teuthology.orchestra.run.smithi112.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-15T22:19:58.334 INFO:teuthology.orchestra.run.smithi112.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-15T22:19:58.359 INFO:teuthology.orchestra.run.smithi112.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T22:19:58.441 INFO:teuthology.orchestra.run.smithi112.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 244 kB/s | 20 kB 00:00 2024-09-15T22:19:58.509 INFO:teuthology.orchestra.run.smithi112.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-15T22:19:58.535 INFO:teuthology.orchestra.run.smithi112.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-15T22:19:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T22:19:59.069 INFO:teuthology.orchestra.run.smithi112.stdout:(148/156): librados2-19.1.1-326.g8921c8ef.el9.x 6.4 MB/s | 3.4 MB 00:00 2024-09-15T22:19:59.144 INFO:teuthology.orchestra.run.smithi112.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 5.9 MB/s | 3.2 MB 00:00 2024-09-15T22:19:59.319 INFO:teuthology.orchestra.run.smithi112.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-09-15T22:19:59.361 INFO:teuthology.orchestra.run.smithi112.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-15T22:19:59.378 INFO:teuthology.orchestra.run.smithi112.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 697 kB/s | 41 kB 00:00 2024-09-15T22:19:59.403 INFO:teuthology.orchestra.run.smithi112.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-15T22:19:59.445 INFO:teuthology.orchestra.run.smithi112.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-15T22:19:59.503 INFO:teuthology.orchestra.run.smithi112.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-15T22:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-15T22:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:01.045 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:01.079 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:20:01.302 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:20:01.373 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:20:01.402 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:01.570 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:20:01.652 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:20:01.680 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:20:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:20:01.932 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:20:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:20:02.350 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:20:02.470 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:02.733 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:03.045 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:03.185 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:20:03.302 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:20:03.345 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:20:03.390 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:20:03.484 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:20:03.685 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:20:03.722 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:20:03.807 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:20:03.849 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:20:03.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:20:03.975 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:20:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:20:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:20:04.133 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:20:04.216 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:20:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:20:04.318 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:20:04.357 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:20:04.446 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:20:04.498 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:20:04.592 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:20:04.765 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:20:04.835 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:20:05.521 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:20:05.655 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:20:05.696 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:20:05.760 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:20:05.798 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:20:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:20:06.055 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:20:06.118 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:20:06.187 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:20:06.290 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:20:06.327 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:20:06.372 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:20:06.448 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:20:06.488 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:20:06.535 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:20:06.585 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:20:06.764 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:20:06.833 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:20:06.877 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:20:07.008 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:20:07.058 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:20:07.101 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:20:07.131 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:20:07.180 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:20:07.300 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:20:07.500 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:20:07.540 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:20:07.577 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:20:07.617 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:20:07.694 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:20:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:20:07.771 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:20:07.805 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:20:07.838 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:20:07.891 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:20:07.931 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:20:08.034 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:20:08.090 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:20:08.158 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:20:08.289 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:20:08.348 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:20:09.291 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:20:09.350 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:20:09.384 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:20:09.502 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:20:09.637 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:20:09.747 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:20:09.794 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:20:10.051 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:20:10.091 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:20:10.189 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:20:10.728 INFO:teuthology.orchestra.run.smithi110.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 708 kB/s | 16 MB 00:23 2024-09-15T22:20:10.734 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:20:10.734 INFO:teuthology.orchestra.run.smithi110.stdout:Total 5.7 MB/s | 226 MB 00:39 2024-09-15T22:20:11.058 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:20:11.211 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:20:11.910 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-15T22:20:12.059 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-15T22:20:12.060 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-15T22:20:12.868 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:20:13.069 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:20:13.341 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:20:13.374 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:20:13.728 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:20:13.776 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:20:13.856 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-15T22:20:13.856 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-15T22:20:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:20:13.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:20:14.025 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:20:14.580 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:20:14.606 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:20:14.731 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:20:14.758 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:20:16.845 INFO:teuthology.orchestra.run.smithi112.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 701 kB/s | 16 MB 00:23 2024-09-15T22:20:16.849 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:20:16.850 INFO:teuthology.orchestra.run.smithi112.stdout:Total 5.2 MB/s | 226 MB 00:43 2024-09-15T22:20:17.467 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:17.505 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:18.021 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-15T22:20:18.169 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:18.170 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-15T22:20:18.170 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-15T22:20:18.217 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:20:18.381 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:20:18.382 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:20:18.382 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:20:18.382 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:18.418 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:20:20.021 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-15T22:20:20.021 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-15T22:20:20.124 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-15T22:20:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:20:20.303 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:20:20.365 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:20:20.398 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:20:20.424 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:20:20.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:20:20.796 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:20:20.909 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:21.013 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:21.043 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:21.126 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:21.156 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:20:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:20:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:20:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:20:21.562 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:20:21.583 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:20:21.604 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:20:21.792 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:20:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:20:22.040 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:20:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:20:22.633 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:20:22.664 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:20:22.698 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:20:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:20:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:20:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:20:22.883 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:20:22.916 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:20:22.944 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:20:23.012 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:20:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:20:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:20:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:20:23.224 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:20:23.259 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:20:23.303 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:20:23.332 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:20:23.400 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:20:23.446 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:20:23.520 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:20:23.660 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:20:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:20:24.247 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:20:24.331 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:20:24.361 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:20:24.404 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:20:24.442 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:20:24.475 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:20:24.635 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:20:24.695 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:20:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:20:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:20:24.855 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:20:24.890 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:20:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:20:24.973 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:20:25.016 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:20:25.058 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:20:25.196 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:20:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:20:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:20:25.386 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:20:25.427 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:20:25.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:20:25.499 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:20:25.523 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:20:25.597 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:20:25.726 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:20:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:20:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:20:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:20:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:20:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:20:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:20:25.945 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:20:25.978 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:20:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:20:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:20:26.139 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:20:26.202 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:20:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:20:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-15T22:20:26.335 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:20:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:20:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:20:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:20:26.497 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:20:26.532 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:20:26.557 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:20:26.600 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:20:26.920 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:20:27.041 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:27.092 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:20:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:20:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:20:27.176 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:27.266 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:27.280 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:20:27.296 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:20:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:20:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:20:27.451 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:20:27.460 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:20:27.502 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:20:27.509 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:20:27.529 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:27.617 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:27.639 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:20:27.693 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:20:27.693 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:20:27.715 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:20:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:20:27.733 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:20:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:20:27.908 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:20:28.056 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:20:28.216 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:20:28.311 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:20:28.546 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:20:28.612 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:20:28.717 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:20:28.804 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:20:28.844 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:20:28.887 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:20:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:20:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:20:29.048 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:20:29.091 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:20:29.124 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:20:29.152 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:20:29.219 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:20:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:20:29.305 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:20:29.348 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:20:29.423 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:20:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:20:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:20:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:20:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:20:29.654 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:20:29.728 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:20:29.754 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:20:29.829 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:20:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:20:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:20:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:20:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:20:30.224 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:20:30.261 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:20:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:20:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:20:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:20:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:20:30.526 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:20:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:20:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:20:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:20:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:20:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:20:30.889 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:20:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:20:30.940 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:20:30.943 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:20:31.010 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:20:31.024 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:20:31.033 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:20:31.064 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:20:31.100 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:20:31.146 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:20:31.191 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:20:31.234 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:20:31.276 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:20:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:20:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:20:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:20:31.604 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:20:31.637 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:20:31.676 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:20:31.710 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:20:31.743 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:20:31.745 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:20:31.745 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-09-15T22:20:31.746 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:31.816 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:20:31.943 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:20:31.956 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:20:31.993 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:20:31.993 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:31.993 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:20:31.993 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:32.008 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:20:32.036 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:20:32.070 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:20:32.109 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:20:32.141 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:20:32.171 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:20:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:20:32.247 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:20:32.297 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:20:32.340 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:20:32.426 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:20:32.479 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:20:32.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:20:32.613 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:20:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:20:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:33.389 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:20:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:20:33.466 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:20:33.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:20:33.621 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:20:33.652 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:20:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:20:33.710 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:20:33.711 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:33.711 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:20:33.711 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:20:33.711 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:20:33.711 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:33.761 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:20:33.802 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:20:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:20:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:20:33.992 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:20:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:20:34.033 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:20:34.033 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:20:34.034 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:20:34.034 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:34.043 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:20:34.043 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:34.043 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:20:34.043 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:20:34.043 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:20:34.043 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:34.068 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:20:34.093 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:20:34.543 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:20:34.594 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:20:34.594 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:34.594 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:20:34.594 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:20:34.594 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:20:34.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:34.727 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:20:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:20:34.789 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:20:34.847 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:20:34.863 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:20:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:20:35.174 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:20:35.271 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:20:35.381 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:20:35.560 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:20:35.620 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:20:35.670 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:20:35.696 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:20:36.057 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:20:36.138 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:20:36.167 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:20:36.199 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:20:36.364 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:20:36.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:20:36.429 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:20:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:20:36.508 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:20:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:20:36.581 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:20:36.627 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:20:36.659 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:20:36.694 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:20:37.173 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:20:37.207 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:20:37.278 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:20:37.317 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:20:37.891 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:20:37.936 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:20:39.090 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:20:39.120 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:20:39.264 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:20:39.456 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:20:39.505 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:20:39.553 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:39.557 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:20:39.557 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:39.557 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:20:39.557 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:20:39.557 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:20:39.557 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:39.588 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:39.614 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:20:39.641 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:20:39.752 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:20:39.818 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:20:40.127 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:20:40.175 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:20:40.273 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:20:40.273 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:20:40.273 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:20:40.273 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:40.309 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:20:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:20:40.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:20:40.988 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:20:40.988 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:40.988 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:20:40.988 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:20:40.989 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:20:40.989 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:41.034 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:20:41.085 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:20:41.085 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:41.085 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:20:41.085 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:41.151 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:20:41.203 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:20:41.203 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:41.203 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:20:41.203 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:20:41.203 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:20:41.204 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:41.552 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:20:41.603 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:20:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:20:41.604 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:20:41.604 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:20:41.604 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-09-15T22:20:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:20:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:20:46.599 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:46.599 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:20:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:20:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:20:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:20:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:20:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:20:47.277 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:20:47.338 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:20:47.367 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:20:47.399 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:20:47.459 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:20:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:20:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:20:48.095 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:48.095 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:20:48.095 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:20:48.096 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:20:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:48.228 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:20:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:20:48.316 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:20:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:20:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:20:48.368 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:48.368 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:20:48.368 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:20:48.368 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:20:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:48.812 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:20:48.835 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:20:48.835 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:48.835 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:20:48.835 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:20:48.835 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:20:48.835 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:48.942 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:20:48.990 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:20:49.046 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:20:49.230 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:20:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:20:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:20:49.446 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:20:49.576 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:20:49.613 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:20:49.645 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:20:49.673 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:20:49.697 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:20:49.805 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:20:49.863 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:20:49.988 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:20:50.032 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:20:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:20:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:20:50.091 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:20:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:20:50.127 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:20:50.128 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:20:50.174 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:20:50.204 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:20:50.227 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:20:50.227 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:20:50.319 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:20:50.343 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:20:50.359 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:20:50.359 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:20:50.612 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:20:50.613 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:20:50.731 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:20:50.808 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:20:51.066 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:20:51.066 INFO:teuthology.orchestra.run.smithi022.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-15T22:20:51.066 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:20:51.280 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:20:51.900 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:20:51.900 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-15T22:20:51.900 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-15T22:20:51.900 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-15T22:20:51.901 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-15T22:20:51.901 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-15T22:20:51.901 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-15T22:20:51.901 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-15T22:20:51.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:52.086 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:20:52.102 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:20:52.102 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:52.102 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:20:52.102 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:52.237 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:20:52.256 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:20:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:20:52.528 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:20:52.558 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:20:52.581 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:20:52.581 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:52.582 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:20:52.582 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:20:52.582 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:20:52.582 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:52.625 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:20:52.636 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:20:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:20:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:20:53.589 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:20:53.615 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:20:53.615 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:53.615 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:20:53.615 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:20:53.615 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:20:53.615 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:53.703 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:20:53.728 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:20:53.751 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:20:53.751 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:53.751 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:20:53.752 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:20:53.752 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:20:53.752 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:53.795 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:20:53.817 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:20:53.818 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:53.818 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:20:53.818 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:53.848 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:53.871 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:20:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:20:53.894 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:53.894 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:20:53.894 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:20:53.894 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:20:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:54.197 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:20:54.220 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:20:54.220 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:54.220 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:20:54.220 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:20:54.220 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:20:54.220 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:20:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:20:54.329 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:20:54.330 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:54.330 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:20:54.330 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:20:54.330 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:20:54.330 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:54.437 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:20:54.494 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:20:54.549 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:20:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:20:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:20:54.868 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:20:54.957 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:20:55.106 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:20:55.149 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:20:55.197 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:20:55.226 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:20:55.554 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:20:55.582 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:20:55.614 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:20:55.675 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:20:55.713 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:20:56.621 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:20:56.622 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:20:56.623 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:20:56.635 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:20:56.635 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:20:56.635 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:20:56.635 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:20:56.635 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:20:56.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:20:56.637 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:20:56.638 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:20:56.639 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:20:56.640 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:20:56.641 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:20:56.642 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:20:56.643 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:20:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:20:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:20:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:20:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:20:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:20:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:20:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:20:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:20:56.752 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:20:56.790 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:20:57.750 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:20:57.774 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:20:57.875 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:20:58.036 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:20:58.067 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:20:58.090 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:20:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:20:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:20:58.091 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:20:58.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:58.151 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:20:58.162 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:20:58.260 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:20:58.317 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:20:58.759 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:20:58.800 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.841 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.842 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.843 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:20:58.844 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:20:58.845 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:20:58.846 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:20:58.847 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:20:58.848 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:20:58.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:20:58.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:20:58.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:20:58.852 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:20:58.853 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:20:58.853 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:20:58.853 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:20:58.853 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:20:58.853 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-15T22:20:58.873 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:20:58.900 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:20:59.084 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:20:59.139 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:20:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:20:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:20:59.235 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:20:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:20:59.271 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:20:59.294 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:20:59.294 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:59.294 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:20:59.294 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:20:59.294 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:20:59.294 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:59.338 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:20:59.360 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:20:59.360 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:59.360 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:20:59.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:59.405 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:20:59.427 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:20:59.428 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:59.428 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:20:59.428 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:20:59.428 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:20:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:59.546 DEBUG:teuthology.parallel:result is None 2024-09-15T22:20:59.739 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:20:59.762 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:20:59.762 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:20:59.762 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:20:59.762 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:20:59.762 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:20:59.763 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:20:59.840 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:20:59.885 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:20:59.906 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:21:00.744 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:21:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:21:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:21:00.954 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:21:00.994 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:21:01.019 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:21:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:21:01.054 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:21:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:21:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:21:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:21:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:21:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:21:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:21:01.399 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:21:01.399 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:21:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:21:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:21:04.284 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:21:04.333 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:21:04.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:21:04.415 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:21:04.442 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:21:04.629 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:21:04.672 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:21:04.702 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:21:04.732 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:21:04.770 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:21:05.322 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:21:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:21:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:21:06.227 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:21:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:21:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:21:06.436 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:21:06.474 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:21:06.517 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:21:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:21:06.543 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:21:06.627 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:21:06.627 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:21:06.736 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:21:06.761 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:21:06.765 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:21:06.765 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:21:06.938 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:21:06.938 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:21:07.030 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:21:07.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:21:07.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:21:07.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:21:07.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:21:07.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:21:07.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:21:07.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:21:07.074 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:21:07.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:21:07.076 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:21:07.077 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:21:07.078 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:21:07.079 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:21:07.093 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:21:09.706 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:21:09.706 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:21:09.706 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-09-15T22:21:09.706 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:09.706 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:09.706 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.707 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:21:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:21:09.710 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:21:09.711 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:21:09.712 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:21:09.713 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:21:09.714 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:21:09.715 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:21:09.716 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.717 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:21:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:21:09.719 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-15T22:21:10.164 DEBUG:teuthology.parallel:result is None 2024-09-15T22:21:12.796 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:21:12.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:21:12.798 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:21:12.799 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:21:12.799 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:21:12.799 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:21:12.811 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:21:12.811 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:21:12.811 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:21:12.811 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:21:12.811 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:21:12.812 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:21:12.813 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:21:12.814 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:21:12.815 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:21:12.816 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:21:12.817 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:21:12.818 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:21:12.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:21:12.820 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:21:12.821 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:21:12.822 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:21:15.377 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.378 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.379 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:21:15.380 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.381 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:21:15.382 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:21:15.383 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:21:15.384 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:21:15.385 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:21:15.386 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:21:15.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:21:15.389 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:21:15.390 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:21:15.390 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:21:15.390 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:21:15.390 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:21:15.390 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:21:15.390 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-15T22:21:15.812 DEBUG:teuthology.parallel:result is None 2024-09-15T22:21:15.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:21:15.969 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:21:16.019 INFO:teuthology.orchestra.run.smithi022.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:21:16.020 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:21:16.020 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:21:16.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:21:16.164 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:21:16.190 INFO:teuthology.orchestra.run.smithi110.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:21:16.190 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:21:16.190 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:21:16.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:21:16.339 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:21:16.363 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:21:16.363 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:21:16.363 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:21:16.365 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:21:16.365 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:21:16.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:21:16.430 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:21:16.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:21:16.463 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:21:16.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:21:16.491 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:21:16.491 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:21:16.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:21:16.550 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:21:16.648 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:21:16.649 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:21:16.678 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:21:16.747 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:21:16.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:21:16.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:21:16.841 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:21:16.842 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:21:16.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:21:16.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:21:16.994 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:21:16.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:21:17.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:21:17.085 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:21:17.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:21:17.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:21:17.180 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:21:17.180 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:21:17.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:21:17.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:21:17.331 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:21:17.331 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:21:17.356 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:21:17.421 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:21:17.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:21:17.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:21:17.516 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T22:21:17.611 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2}} 2024-09-15T22:21:17.611 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:21:17.611 INFO:tasks.cephadm:Cluster fsid is d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:21:17.612 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T22:21:17.612 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.22', 'mon.b': '172.21.15.110', 'mon.c': '172.21.15.112'} 2024-09-15T22:21:17.612 INFO:tasks.cephadm:First mon is mon.a on smithi022 2024-09-15T22:21:17.612 INFO:tasks.cephadm:First mgr is x 2024-09-15T22:21:17.612 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T22:21:17.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-09-15T22:21:17.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname $(hostname -s) 2024-09-15T22:21:17.694 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-09-15T22:21:17.724 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T22:21:17.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:21:17.862 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T22:21:18.000 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:21:18.001 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:21:18.001 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:21:18.001 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:18.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:21 /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:18.394 DEBUG:teuthology.orchestra.run.smithi110:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:18.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:21 /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:18.754 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:19.138 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:21 /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:19.139 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:19.180 DEBUG:teuthology.orchestra.run.smithi110:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:19.200 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:21:19.238 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T22:21:19.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:21:19.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:21:19.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:21:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:21:20.892 INFO:teuthology.orchestra.run.smithi110.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:21:21.160 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:21:50.390 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T22:21:50.390 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:21:50.391 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:21:50.391 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-09-15T22:21:50.391 INFO:teuthology.orchestra.run.smithi112.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:21:50.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T22:21:50.391 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T22:21:51.089 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-15T22:21:51.089 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:21:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:21:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "repo_digests": [ 2024-09-15T22:21:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:21:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-15T22:21:51.090 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-15T22:21:54.096 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:21:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:21:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:21:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-09-15T22:21:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:21:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:21:54.097 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:21:54.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-09-15T22:21:54.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph 2024-09-15T22:21:54.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-09-15T22:21:54.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-09-15T22:21:54.309 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /etc/ceph 2024-09-15T22:21:54.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-09-15T22:21:54.368 INFO:tasks.cephadm:Writing seed config... 2024-09-15T22:21:54.369 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T22:21:54.370 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T22:21:54.371 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T22:21:54.372 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T22:21:54.373 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-15T22:21:54.374 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:21:54.374 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T22:21:54.409 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d3c50556-73b0-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T22:21:54.409 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T22:21:54.454 DEBUG:teuthology.orchestra.run.smithi022:mgr.x> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T22:21:54.499 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T22:21:54.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:21:54.761 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:21:54.761 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'd3c50556-73b0-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.22', '--skip-admin-label'] 2024-09-15T22:21:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T22:21:54.762 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2024-09-15T22:21:54.807 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:21:54.807 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2024-09-15T22:21:54.807 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2024-09-15T22:21:54.821 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:21:54.821 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:21:54.833 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:21:54.833 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-15T22:21:54.847 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-15T22:21:54.860 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-15T22:21:54.860 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:21:54.860 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2024-09-15T22:21:54.903 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:21:54.904 INFO:teuthology.orchestra.run.smithi022.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T22:21:54.904 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2024-09-15T22:21:54.904 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2024-09-15T22:21:54.916 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:21:54.916 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:21:54.929 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:21:54.929 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-15T22:21:54.942 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-15T22:21:54.955 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-15T22:21:54.955 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:21:54.955 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2024-09-15T22:21:54.956 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:21:54.956 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 139720127652864 on /run/cephadm/d3c50556-73b0-11ef-bceb-c7b262605968.lock 2024-09-15T22:21:54.956 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 139720127652864 acquired on /run/cephadm/d3c50556-73b0-11ef-bceb-c7b262605968.lock 2024-09-15T22:21:54.956 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 3300 ... 2024-09-15T22:21:54.956 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2024-09-15T22:21:54.957 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:3300, 172.21.15.22:6789], mon addrv is [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-15T22:21:54.963 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.22 metric 100 2024-09-15T22:21:54.964 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 metric 100 2024-09-15T22:21:54.969 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T22:21:54.969 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-15T22:21:54.970 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-15T22:21:54.975 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T22:21:54.975 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T22:21:54.975 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:21:54.975 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-15T22:21:54.976 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-15T22:21:54.976 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:21:54.976 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-15T22:21:54.976 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-15T22:21:54.976 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T22:21:54.977 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T22:21:54.978 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:21:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T22:21:56.597 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:21:56.597 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:21:56.597 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T22:21:57.718 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2024-09-15T22:21:57.718 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2024-09-15T22:22:08.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQAGXudmYa3XBRAAUhZqgu2UQIDezpCrfg/t7g== 2024-09-15T22:22:09.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQAQXudmZYaUJhAACN5OHslkzCqvm+ZxuWtTQw== 2024-09-15T22:22:10.267 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQARXudmBgZoJhAALALCsEiST+KABJ66y9/F7A== 2024-09-15T22:22:10.268 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v2:172.21.15.22:3300,v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-09-15T22:22:11.423 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:11.424 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:22:11.424 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:22:11.424 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2024-09-15T22:22:12.500 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2024-09-15T22:22:12.785 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T22:22:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T22:22:13.961 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d3c50556-73b0-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d3c50556-73b0-11ef-bceb-c7b262605968.target. 2024-09-15T22:22:13.961 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d3c50556-73b0-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d3c50556-73b0-11ef-bceb-c7b262605968.target. 2024-09-15T22:22:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:22:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T22:22:14.580 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3c50556-73b0-11ef-bceb-c7b262605968.target.wants/ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d3c50556-73b0-11ef-bceb-c7b262605968@.service. 2024-09-15T22:22:15.230 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:15 smithi022 podman[30253]: 2024-09-15 22:22:15.16618788 +0000 UTC m=+0.352103587 container start 512d54e0da826d7d518a6e5b4deb36e850c655d87826ead0d92019c2e8e81d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-15T22:22:15.279 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:22:15.279 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-15T22:22:15.292 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:22:15.292 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-15T22:22:15.293 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-15T22:22:15.293 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:22:15.293 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2024-09-15T22:22:15.293 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2024-09-15T22:22:15.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:15 smithi022 ceph-mon[30272]: mkfs d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:15.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:15 smithi022 ceph-mon[30272]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:22:15.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:15 smithi022 bash[30253]: 512d54e0da826d7d518a6e5b4deb36e850c655d87826ead0d92019c2e8e81d8c 2024-09-15T22:22:15.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:15 smithi022 systemd[1]: Started Ceph mon.a for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:22:16.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: monmap epoch 1 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: last_changed 2024-09-15T22:22:10.805617+0000 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: min_mon_release 19 (squid) 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: election_strategy: 1 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: fsmap 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: mgrmap e1: no daemons active 2024-09-15T22:22:16.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:16 smithi022 ceph-mon[30272]: from='client.? 172.21.15.22:0/3161676324' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:16.527 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.692844s) 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.838+0000 7f03da200640 1 Processor -- start 2024-09-15T22:22:16.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.839+0000 7f03da200640 1 -- start start 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.839+0000 7f03da200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d4109c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.839+0000 7f03da200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03d410a1f0 con 0x7f03d4109820 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.840+0000 7f03d8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d4109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.840+0000 7f03d8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d4109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52546/0 (socket says 172.21.15.22:52546) 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.840+0000 7f03d8e00640 1 -- 172.21.15.22:0/2477713016 learned_addr learned my addr 172.21.15.22:0/2477713016 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.840+0000 7f03d8e00640 1 -- 172.21.15.22:0/2477713016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d410aa70 con 0x7f03d4109820 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.842+0000 7f03d8e00640 1 --2- 172.21.15.22:0/2477713016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d4109c20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009820 tx=0x7f03c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70b8f7c53c7ff08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03d3400640 1 -- 172.21.15.22:0/2477713016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c8037070 con 0x7f03d4109820 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03d3400640 1 -- 172.21.15.22:0/2477713016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c8032440 con 0x7f03d4109820 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03d3400640 1 -- 172.21.15.22:0/2477713016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c8032740 con 0x7f03d4109820 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03da200640 1 -- 172.21.15.22:0/2477713016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 msgr2=0x7f03d4109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03da200640 1 --2- 172.21.15.22:0/2477713016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d4109c20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009820 tx=0x7f03c802a270 comp rx=0 tx=0).stop 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03da200640 1 -- 172.21.15.22:0/2477713016 shutdown_connections 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03da200640 1 --2- 172.21.15.22:0/2477713016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d4109c20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03da200640 1 -- 172.21.15.22:0/2477713016 >> 172.21.15.22:0/2477713016 conn(0x7f03d407cf10 msgr2=0x7f03d407d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.843+0000 7f03da200640 1 -- 172.21.15.22:0/2477713016 shutdown_connections 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.844+0000 7f03da200640 1 -- 172.21.15.22:0/2477713016 wait complete. 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.845+0000 7f03da200640 1 Processor -- start 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.845+0000 7f03da200640 1 -- start start 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.845+0000 7f03da200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.845+0000 7f03da200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03d410b010 con 0x7f03d4109820 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.846+0000 7f03d8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.846+0000 7f03d8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52562/0 (socket says 172.21.15.22:52562) 2024-09-15T22:22:16.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.846+0000 7f03d8e00640 1 -- 172.21.15.22:0/3161676324 learned_addr learned my addr 172.21.15.22:0/3161676324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.846+0000 7f03d8e00640 1 -- 172.21.15.22:0/3161676324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d419d550 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.846+0000 7f03d8e00640 1 --2- 172.21.15.22:0/3161676324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d419d010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f03c80090b0 tx=0x7f03c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c8041070 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c803c7a0 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c8037040 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d419d7e0 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d41a04d0 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03c8044070 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.847+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03c803d3f0 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.848+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d410b680 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.851+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f03c8046450 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.916+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f03d41a0a20 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.917+0000 7f03d1600640 1 -- 172.21.15.22:0/3161676324 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f03c8046630 con 0x7f03d4109820 2024-09-15T22:22:16.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 msgr2=0x7f03d419d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 --2- 172.21.15.22:0/3161676324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d419d010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f03c80090b0 tx=0x7f03c80046c0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 shutdown_connections 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 --2- 172.21.15.22:0/3161676324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4109820 0x7f03d419d010 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 >> 172.21.15.22:0/3161676324 conn(0x7f03d407cf10 msgr2=0x7f03d4191300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 shutdown_connections 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:15.918+0000 7f03da200640 1 -- 172.21.15.22:0/3161676324 wait complete. 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2024-09-15T22:22:16.532 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T22:22:17.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:17 smithi022 ceph-mon[30272]: from='client.? 172.21.15.22:0/1494016183' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:22:17.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:17 smithi022 ceph-mon[30272]: from='client.? 172.21.15.22:0/1494016183' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:22:17.659 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.026+0000 7fb7a5a00640 1 Processor -- start 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.026+0000 7fb7a5a00640 1 -- start start 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.027+0000 7fb7a5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.027+0000 7fb7a5a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a007c860 con 0x7fb7a007de30 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.027+0000 7fb79ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.027+0000 7fb79ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52566/0 (socket says 172.21.15.22:52566) 2024-09-15T22:22:17.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.027+0000 7fb79ea00640 1 -- 172.21.15.22:0/3910940884 learned_addr learned my addr 172.21.15.22:0/3910940884 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.027+0000 7fb79ea00640 1 -- 172.21.15.22:0/3910940884 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a007c9e0 con 0x7fb7a007de30 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.028+0000 7fb79ea00640 1 --2- 172.21.15.22:0/3910940884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a007c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb790009820 tx=0x7fb79002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357859c78abbc450 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb79e000640 1 -- 172.21.15.22:0/3910940884 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb790037070 con 0x7fb7a007de30 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb79e000640 1 -- 172.21.15.22:0/3910940884 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790032440 con 0x7fb7a007de30 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb79e000640 1 -- 172.21.15.22:0/3910940884 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb790032740 con 0x7fb7a007de30 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 -- 172.21.15.22:0/3910940884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 msgr2=0x7fb7a007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 --2- 172.21.15.22:0/3910940884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a007c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb790009820 tx=0x7fb79002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 -- 172.21.15.22:0/3910940884 shutdown_connections 2024-09-15T22:22:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 --2- 172.21.15.22:0/3910940884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a007c290 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 -- 172.21.15.22:0/3910940884 >> 172.21.15.22:0/3910940884 conn(0x7fb7a0102ff0 msgr2=0x7fb7a0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 -- 172.21.15.22:0/3910940884 shutdown_connections 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.029+0000 7fb7a5a00640 1 -- 172.21.15.22:0/3910940884 wait complete. 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.030+0000 7fb7a5a00640 1 Processor -- start 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb7a5a00640 1 -- start start 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb7a5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb7a5a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a007cf10 con 0x7fb7a007de30 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb79ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb79ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a019d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52576/0 (socket says 172.21.15.22:52576) 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb79ea00640 1 -- 172.21.15.22:0/1494016183 learned_addr learned my addr 172.21.15.22:0/1494016183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.031+0000 7fb79ea00640 1 -- 172.21.15.22:0/1494016183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a019d730 con 0x7fb7a007de30 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb79ea00640 1 --2- 172.21.15.22:0/1494016183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a019d1f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb7900090b0 tx=0x7fb7900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:17.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb790041070 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79003c7a0 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb790037040 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a019d9c0 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a01a06b0 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.032+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb790044070 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.033+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb79003d3f0 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.033+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a007c310 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.036+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb790046450 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.098+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fb7a002d940 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.102+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fb790046630 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb797e00640 1 -- 172.21.15.22:0/1494016183 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb790056070 con 0x7fb7a007de30 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 msgr2=0x7fb7a019d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 --2- 172.21.15.22:0/1494016183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a019d1f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb7900090b0 tx=0x7fb7900046c0 comp rx=0 tx=0).stop 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 shutdown_connections 2024-09-15T22:22:17.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 --2- 172.21.15.22:0/1494016183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a007de30 0x7fb7a019d1f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:17.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 >> 172.21.15.22:0/1494016183 conn(0x7fb7a0102ff0 msgr2=0x7fb7a0104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:17.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 shutdown_connections 2024-09-15T22:22:17.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:17.103+0000 7fb7a5a00640 1 -- 172.21.15.22:0/1494016183 wait complete. 2024-09-15T22:22:17.664 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2024-09-15T22:22:18.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:18 smithi022 ceph-mon[30272]: from='client.? 172.21.15.22:0/3909094426' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:18.872 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.157+0000 7fa8d7000640 1 Processor -- start 2024-09-15T22:22:18.872 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.157+0000 7fa8d7000640 1 -- start start 2024-09-15T22:22:18.872 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.157+0000 7fa8d7000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d0107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:18.872 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.157+0000 7fa8d7000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01081d0 con 0x7fa8d0107800 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.158+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d0107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.158+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d0107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52584/0 (socket says 172.21.15.22:52584) 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.158+0000 7fa8cfe00640 1 -- 172.21.15.22:0/754767078 learned_addr learned my addr 172.21.15.22:0/754767078 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.158+0000 7fa8cfe00640 1 -- 172.21.15.22:0/754767078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d0108a00 con 0x7fa8d0107800 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.159+0000 7fa8cfe00640 1 --2- 172.21.15.22:0/754767078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d0107c00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009820 tx=0x7fa8c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3089eb869b9b3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.159+0000 7fa8cea00640 1 -- 172.21.15.22:0/754767078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0037070 con 0x7fa8d0107800 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.159+0000 7fa8cea00640 1 -- 172.21.15.22:0/754767078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8c0032900 con 0x7fa8d0107800 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.159+0000 7fa8cea00640 1 -- 172.21.15.22:0/754767078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0030850 con 0x7fa8d0107800 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 -- 172.21.15.22:0/754767078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 msgr2=0x7fa8d0107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 --2- 172.21.15.22:0/754767078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d0107c00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009820 tx=0x7fa8c002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 -- 172.21.15.22:0/754767078 shutdown_connections 2024-09-15T22:22:18.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 --2- 172.21.15.22:0/754767078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d0107c00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 -- 172.21.15.22:0/754767078 >> 172.21.15.22:0/754767078 conn(0x7fa8d0102ff0 msgr2=0x7fa8d0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 -- 172.21.15.22:0/754767078 shutdown_connections 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.160+0000 7fa8d7000640 1 -- 172.21.15.22:0/754767078 wait complete. 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.161+0000 7fa8d7000640 1 Processor -- start 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.161+0000 7fa8d7000640 1 -- start start 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.161+0000 7fa8d7000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.161+0000 7fa8d7000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d010bdb0 con 0x7fa8d0107800 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.162+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.162+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52600/0 (socket says 172.21.15.22:52600) 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.162+0000 7fa8cfe00640 1 -- 172.21.15.22:0/3909094426 learned_addr learned my addr 172.21.15.22:0/3909094426 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.162+0000 7fa8cfe00640 1 -- 172.21.15.22:0/3909094426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d019dff0 con 0x7fa8d0107800 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.162+0000 7fa8cfe00640 1 --2- 172.21.15.22:0/3909094426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d019dab0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009940 tx=0x7fa8c00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:18.874 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0042070 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8c0032be0 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0037040 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d019e280 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d01a0f70 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8c0045070 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.163+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa8c0047a30 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.164+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d010bf30 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.167+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa8c0032d90 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.230+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa8d01a1140 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.230+0000 7fa8ccc00640 1 -- 172.21.15.22:0/3909094426 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fa8c003d430 con 0x7fa8d0107800 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.231+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 msgr2=0x7fa8d019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.231+0000 7fa8d7000640 1 --2- 172.21.15.22:0/3909094426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d019dab0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009940 tx=0x7fa8c00326e0 comp rx=0 tx=0).stop 2024-09-15T22:22:18.875 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.231+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 shutdown_connections 2024-09-15T22:22:18.876 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.231+0000 7fa8d7000640 1 --2- 172.21.15.22:0/3909094426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8d0107800 0x7fa8d019dab0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:18.876 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.231+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 >> 172.21.15.22:0/3909094426 conn(0x7fa8d0102ff0 msgr2=0x7fa8d0103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:18.876 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.232+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 shutdown_connections 2024-09-15T22:22:18.876 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:18.232+0000 7fa8d7000640 1 -- 172.21.15.22:0/3909094426 wait complete. 2024-09-15T22:22:18.876 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2024-09-15T22:22:19.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:18 smithi022 systemd[1]: Stopping Ceph mon.a for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:22:19.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:19 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a[30268]: 2024-09-15T22:22:19.224+0000 7f334dc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:22:19.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:19 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a[30268]: 2024-09-15T22:22:19.224+0000 7f334dc00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T22:22:19.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:19 smithi022 podman[30513]: 2024-09-15 22:22:19.441427319 +0000 UTC m=+0.341911153 container died 512d54e0da826d7d518a6e5b4deb36e850c655d87826ead0d92019c2e8e81d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T22:22:20.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:19 smithi022 podman[30513]: 2024-09-15 22:22:19.83794534 +0000 UTC m=+0.738429173 container cleanup 512d54e0da826d7d518a6e5b4deb36e850c655d87826ead0d92019c2e8e81d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T22:22:20.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:19 smithi022 bash[30513]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:22:20.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 podman[30526]: 2024-09-15 22:22:20.005443729 +0000 UTC m=+0.552371098 container remove 512d54e0da826d7d518a6e5b4deb36e850c655d87826ead0d92019c2e8e81d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T22:22:20.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 systemd[1]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T22:22:20.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 systemd[1]: Stopped Ceph mon.a for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:22:20.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 systemd[1]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.234s CPU time. 2024-09-15T22:22:20.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 systemd[1]: Starting Ceph mon.a for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:22:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 podman[30616]: 2024-09-15 22:22:20.500841723 +0000 UTC m=+0.027470486 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:22:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 podman[30616]: 2024-09-15 22:22:20.606399626 +0000 UTC m=+0.133028378 container create 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T22:22:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 podman[30616]: 2024-09-15 22:22:20.800514747 +0000 UTC m=+0.327143509 container init 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T22:22:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 podman[30616]: 2024-09-15 22:22:20.807500122 +0000 UTC m=+0.334128874 container start 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-15T22:22:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:22:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: pidfile_write: ignore empty --pid-file 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: load: jerasure load: lrc 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Git sha 0 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: DB SUMMARY 2024-09-15T22:22:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: DB Session ID: NQJBSAP50FA7GARV6T8N 2024-09-15T22:22:20.906 INFO:teuthology.orchestra.run.smithi022.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106784 ; 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:22:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.env: 0x557c8313b940 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.info_log: 0x557cb13676a0 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.statistics: (nil) 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.use_fsync: 0 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:22:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.db_log_dir: 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.wal_dir: 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:22:21.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:22:21.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:22:21.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:22:21.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:22:21.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:22:21.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.write_buffer_manager: 0x557cb1376dc0 2024-09-15T22:22:21.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:22:21.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:22:21.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.unordered_write: 0 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.row_cache: None 2024-09-15T22:22:21.121 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.wal_filter: None 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.wal_compression: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:22:21.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:22:21.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_open_files: -1 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Compression algorithms supported: 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kZSTD supported: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:22:21.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.merge_operator: 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_filter: None 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:22:21.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557cb1367300) 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_type: 0 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_index_type: 0 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_shortening: 1 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: checksum: 4 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: no_block_cache: 0 2024-09-15T22:22:21.126 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache: 0x557cb135b1f0 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_options: 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: capacity : 536870912 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_shard_bits : 4 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: strict_capacity_limit : 0 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_compressed: (nil) 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: persistent_cache: (nil) 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size: 4096 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size_deviation: 10 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_restart_interval: 16 2024-09-15T22:22:21.127 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_block_restart_interval: 1 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: metadata_block_size: 4096 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: partition_filters: 0 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: use_delta_encoding: 1 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: filter_policy: bloomfilter 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: whole_key_filtering: 1 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: verify_compression: 0 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: format_version: 5 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_index_compression: 1 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_align: 0 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: max_auto_readahead_size: 262144 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: prepopulate_block_cache: 0 2024-09-15T22:22:21.128 INFO:journalctl@ceph.mon.a.smithi022.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression: NoCompression 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.num_levels: 7 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:22:21.129 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:22:21.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:22:21.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:22:21.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:22:21.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.ttl: 2592000 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:22:21.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0b2c5546-f746-4ba8-aa15-5b043c4e8c52 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438940851658, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T22:22:21.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438940854156, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101718, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99603, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14671, "raw_average_key_size": 50, "raw_value_size": 91658, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726438940, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0b2c5546-f746-4ba8-aa15-5b043c4e8c52", "db_session_id": "NQJBSAP50FA7GARV6T8N", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438940854450, "job": 1, "event": "recovery_finished"} 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557cb138ae00 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: DB pointer 0x557cb1486000 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** DB Stats ** 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:22:21.136 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: L0 2/0 101.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: Sum 2/0 101.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:22:21.137 INFO:journalctl@ceph.mon.a.smithi022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative compaction: 0.00 GB write, 11.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval compaction: 0.00 GB write, 11.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:22:21.138 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache BinnedLRUCache@0x557cb135b1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: starting mon.a rank 0 at public addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] at bind addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???) e1 preinit fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).mds e1 new map 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).mds e1 print_map 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: e1 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: btime 2024-09-15T22:22:15:226409+0000 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: legacy client fscid: -1 2024-09-15T22:22:21.139 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout: No filesystems configured 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 bash[30616]: 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 systemd[1]: Started Ceph mon.a for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: monmap epoch 1 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: last_changed 2024-09-15T22:22:10.805617+0000 2024-09-15T22:22:21.140 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:22:21.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: min_mon_release 19 (squid) 2024-09-15T22:22:21.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: election_strategy: 1 2024-09-15T22:22:21.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:22:21.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: fsmap 2024-09-15T22:22:21.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:22:21.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:20 smithi022 ceph-mon[30634]: mgrmap e1: no daemons active 2024-09-15T22:22:22.068 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.399+0000 7f1c44a00640 1 Processor -- start 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.399+0000 7f1c44a00640 1 -- start start 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.399+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c40107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.399+0000 7f1c44a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c401081d0 con 0x7f1c40107800 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.400+0000 7f1c3de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c40107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.400+0000 7f1c3de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c40107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37900/0 (socket says 172.21.15.22:37900) 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.400+0000 7f1c3de00640 1 -- 172.21.15.22:0/431095058 learned_addr learned my addr 172.21.15.22:0/431095058 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.401+0000 7f1c3de00640 1 -- 172.21.15.22:0/431095058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c40108a00 con 0x7f1c40107800 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.403+0000 7f1c3de00640 1 --2- 172.21.15.22:0/431095058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c40107c00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009820 tx=0x7f1c3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d21d34dfb20a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c3ca00640 1 -- 172.21.15.22:0/431095058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c30037070 con 0x7f1c40107800 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c3ca00640 1 -- 172.21.15.22:0/431095058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c30032900 con 0x7f1c40107800 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c3ca00640 1 -- 172.21.15.22:0/431095058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c30030850 con 0x7f1c40107800 2024-09-15T22:22:22.069 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c44a00640 1 -- 172.21.15.22:0/431095058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 msgr2=0x7f1c40107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c44a00640 1 --2- 172.21.15.22:0/431095058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c40107c00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009820 tx=0x7f1c3002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c44a00640 1 -- 172.21.15.22:0/431095058 shutdown_connections 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c44a00640 1 --2- 172.21.15.22:0/431095058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c40107c00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c44a00640 1 -- 172.21.15.22:0/431095058 >> 172.21.15.22:0/431095058 conn(0x7f1c40102ff0 msgr2=0x7f1c40105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.404+0000 7f1c44a00640 1 -- 172.21.15.22:0/431095058 shutdown_connections 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.405+0000 7f1c44a00640 1 -- 172.21.15.22:0/431095058 wait complete. 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.405+0000 7f1c44a00640 1 Processor -- start 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.406+0000 7f1c44a00640 1 -- start start 2024-09-15T22:22:22.070 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.406+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c4019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.406+0000 7f1c44a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4010bdb0 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.406+0000 7f1c3de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c4019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.406+0000 7f1c3de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c4019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37906/0 (socket says 172.21.15.22:37906) 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.406+0000 7f1c3de00640 1 -- 172.21.15.22:0/3094891625 learned_addr learned my addr 172.21.15.22:0/3094891625 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c3de00640 1 -- 172.21.15.22:0/3094891625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4019dff0 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c3de00640 1 --2- 172.21.15.22:0/3094891625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c4019dab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009940 tx=0x7f1c300326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c30042070 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c30032be0 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c30037040 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4019e280 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.407+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c401a0f70 con 0x7f1c40107800 2024-09-15T22:22:22.071 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.408+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c30045070 con 0x7f1c40107800 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.408+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1c30047a30 con 0x7f1c40107800 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.408+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4010bf30 con 0x7f1c40107800 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.411+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1c30032d90 con 0x7f1c40107800 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.474+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f1c40107c80 con 0x7f1c40107800 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.476+0000 7f1c36a00640 1 -- 172.21.15.22:0/3094891625 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f1c3003d430 con 0x7f1c40107800 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 msgr2=0x7f1c4019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 --2- 172.21.15.22:0/3094891625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c4019dab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009940 tx=0x7f1c300326e0 comp rx=0 tx=0).stop 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 shutdown_connections 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 --2- 172.21.15.22:0/3094891625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c40107800 0x7f1c4019dab0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 >> 172.21.15.22:0/3094891625 conn(0x7f1c40102ff0 msgr2=0x7f1c40103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 shutdown_connections 2024-09-15T22:22:22.072 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:21.477+0000 7f1c44a00640 1 -- 172.21.15.22:0/3094891625 wait complete. 2024-09-15T22:22:22.073 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T22:22:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:22:22.099 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2024-09-15T22:22:22.099 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T22:22:22.099 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T22:22:22.464 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:22:22.465 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T22:22:22.699 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3c50556-73b0-11ef-bceb-c7b262605968.target.wants/ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d3c50556-73b0-11ef-bceb-c7b262605968@.service. 2024-09-15T22:22:22.729 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:22 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3094891625' entity='client.admin' 2024-09-15T22:22:22.730 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:22 smithi022 systemd[1]: Starting Ceph mgr.x for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:22:23.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 podman[30847]: 2024-09-15 22:22:22.952728507 +0000 UTC m=+0.027155363 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:22:23.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 podman[30847]: 2024-09-15 22:22:23.058446812 +0000 UTC m=+0.132873656 container create ec0bebdab7b32ba0ca0faa03c49897d19b2ba13d10f100081935a27b1b06128c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:22:23.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 podman[30847]: 2024-09-15 22:22:23.269283799 +0000 UTC m=+0.343710647 container init ec0bebdab7b32ba0ca0faa03c49897d19b2ba13d10f100081935a27b1b06128c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:22:23.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 podman[30847]: 2024-09-15 22:22:23.275555055 +0000 UTC m=+0.349981900 container start ec0bebdab7b32ba0ca0faa03c49897d19b2ba13d10f100081935a27b1b06128c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-15T22:22:23.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 bash[30847]: ec0bebdab7b32ba0ca0faa03c49897d19b2ba13d10f100081935a27b1b06128c 2024-09-15T22:22:23.386 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:22:23.386 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-15T22:22:23.402 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:22:23.402 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-15T22:22:23.402 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-15T22:22:23.403 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:22:23.420 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:22:23.420 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-15T22:22:23.434 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:22:23.434 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-15T22:22:23.434 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-15T22:22:23.434 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T22:22:23.435 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2024-09-15T22:22:23.435 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2024-09-15T22:22:23.742 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 systemd[1]: Started Ceph mgr.x for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:22:23.743 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:23.459+0000 7f56d57d4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:22:23.743 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:23.541+0000 7f56d57d4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:22:23.743 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:23.740+0000 7f56d57d4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:22:23.998 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:23.826+0000 7f56d57d4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:22:24.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:24 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/4218946692' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:22:24.282 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:24.015+0000 7f56d57d4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:22:24.282 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:24.194+0000 7f56d57d4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:22:24.899 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:24.601+0000 7f56d57d4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:22:24.899 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:24.675+0000 7f56d57d4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:22:24.900 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:24.897+0000 7f56d57d4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:22:24.938 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:22:24.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:22:24.946 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:22:15:226409+0000", 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:22:24.947 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:22:15.227161+0000", 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:22:24.948 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.109+0000 7f669b600640 1 Processor -- start 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.109+0000 7f669b600640 1 -- start start 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.110+0000 7f669b600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f6694109de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.110+0000 7f669b600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f669410a3b0 con 0x7f66941099e0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.110+0000 7f6698c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f6694109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.110+0000 7f6698c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f6694109de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37928/0 (socket says 172.21.15.22:37928) 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.110+0000 7f6698c00640 1 -- 172.21.15.22:0/1874102136 learned_addr learned my addr 172.21.15.22:0/1874102136 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.111+0000 7f6698c00640 1 -- 172.21.15.22:0/1874102136 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669410abb0 con 0x7f66941099e0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.112+0000 7f6698c00640 1 --2- 172.21.15.22:0/1874102136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f6694109de0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6688009820 tx=0x7f668802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec43d39000e19c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.112+0000 7f6693400640 1 -- 172.21.15.22:0/1874102136 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688037070 con 0x7f66941099e0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.112+0000 7f6693400640 1 -- 172.21.15.22:0/1874102136 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6688032900 con 0x7f66941099e0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.112+0000 7f6693400640 1 -- 172.21.15.22:0/1874102136 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688030850 con 0x7f66941099e0 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 -- 172.21.15.22:0/1874102136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 msgr2=0x7f6694109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 --2- 172.21.15.22:0/1874102136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f6694109de0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6688009820 tx=0x7f668802a270 comp rx=0 tx=0).stop 2024-09-15T22:22:24.949 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 -- 172.21.15.22:0/1874102136 shutdown_connections 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 --2- 172.21.15.22:0/1874102136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f6694109de0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 -- 172.21.15.22:0/1874102136 >> 172.21.15.22:0/1874102136 conn(0x7f669407cf90 msgr2=0x7f669407d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 -- 172.21.15.22:0/1874102136 shutdown_connections 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.113+0000 7f669b600640 1 -- 172.21.15.22:0/1874102136 wait complete. 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.114+0000 7f669b600640 1 Processor -- start 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.114+0000 7f669b600640 1 -- start start 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.115+0000 7f669b600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f669419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.115+0000 7f669b600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f669410df60 con 0x7f66941099e0 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.115+0000 7f6698c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f669419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.115+0000 7f6698c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f669419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37936/0 (socket says 172.21.15.22:37936) 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.115+0000 7f6698c00640 1 -- 172.21.15.22:0/4218946692 learned_addr learned my addr 172.21.15.22:0/4218946692 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.115+0000 7f6698c00640 1 -- 172.21.15.22:0/4218946692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669419dfc0 con 0x7f66941099e0 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.116+0000 7f6698c00640 1 --2- 172.21.15.22:0/4218946692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f669419da80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66880305a0 tx=0x7f6688032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:24.950 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.116+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688042070 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.116+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6688032be0 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.116+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669419e250 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.116+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688037040 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.116+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66941a0f40 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.118+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669410e0e0 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.118+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6688045070 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.118+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6688047780 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.122+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6688032d90 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.188+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f66941a1110 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.188+0000 7f6691600640 1 -- 172.21.15.22:0/4218946692 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f668803cde0 con 0x7f66941099e0 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 msgr2=0x7f669419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 --2- 172.21.15.22:0/4218946692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f669419da80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66880305a0 tx=0x7f6688032670 comp rx=0 tx=0).stop 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 shutdown_connections 2024-09-15T22:22:24.951 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 --2- 172.21.15.22:0/4218946692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66941099e0 0x7f669419da80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:24.952 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 >> 172.21.15.22:0/4218946692 conn(0x7f669407cf90 msgr2=0x7f6694107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:24.952 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 shutdown_connections 2024-09-15T22:22:24.952 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:24.190+0000 7f669b600640 1 -- 172.21.15.22:0/4218946692 wait complete. 2024-09-15T22:22:24.952 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2024-09-15T22:22:26.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:26.051+0000 7f56d57d4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:22:26.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:26.134+0000 7f56d57d4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:22:27.397 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.114+0000 7f56d57d4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:22:27.397 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.261+0000 7f56d57d4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:22:27.701 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/263377012' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:22:27.701 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.433+0000 7f56d57d4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:22:27.702 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.511+0000 7f56d57d4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:22:27.702 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.699+0000 7f56d57d4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:22:28.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.787+0000 7f56d57d4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:22:28.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:27.865+0000 7f56d57d4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:22:28.326 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:28.057+0000 7f56d57d4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:22:28.326 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:28.140+0000 7f56d57d4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:22:28.326 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:28.222+0000 7f56d57d4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:22:28.326 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:28.323+0000 7f56d57d4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:22:28.452 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:22:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:28.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:22:28.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:22:28.461 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:22:15:226409+0000", 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:22:28.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:22:15.227161+0000", 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:22:28.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.506+0000 7fc4bb800640 1 Processor -- start 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.506+0000 7fc4bb800640 1 -- start start 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.507+0000 7fc4bb800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b4109e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.507+0000 7fc4bb800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b410a3e0 con 0x7fc4b4109a10 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.507+0000 7fc4b8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b4109e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.507+0000 7fc4b8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b4109e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37940/0 (socket says 172.21.15.22:37940) 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.507+0000 7fc4b8e00640 1 -- 172.21.15.22:0/1999744134 learned_addr learned my addr 172.21.15.22:0/1999744134 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.508+0000 7fc4b8e00640 1 -- 172.21.15.22:0/1999744134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b410abc0 con 0x7fc4b4109a10 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.509+0000 7fc4b8e00640 1 --2- 172.21.15.22:0/1999744134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b4109e10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009820 tx=0x7fc4a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667b5c033fbfd33b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.509+0000 7fc4b3400640 1 -- 172.21.15.22:0/1999744134 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8037070 con 0x7fc4b4109a10 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.509+0000 7fc4b3400640 1 -- 172.21.15.22:0/1999744134 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4a8032900 con 0x7fc4b4109a10 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.509+0000 7fc4b3400640 1 -- 172.21.15.22:0/1999744134 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8030850 con 0x7fc4b4109a10 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 -- 172.21.15.22:0/1999744134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 msgr2=0x7fc4b4109e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 --2- 172.21.15.22:0/1999744134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b4109e10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009820 tx=0x7fc4a802a270 comp rx=0 tx=0).stop 2024-09-15T22:22:28.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 -- 172.21.15.22:0/1999744134 shutdown_connections 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 --2- 172.21.15.22:0/1999744134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b4109e10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 -- 172.21.15.22:0/1999744134 >> 172.21.15.22:0/1999744134 conn(0x7fc4b407d030 msgr2=0x7fc4b407d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 -- 172.21.15.22:0/1999744134 shutdown_connections 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.510+0000 7fc4bb800640 1 -- 172.21.15.22:0/1999744134 wait complete. 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.511+0000 7fc4bb800640 1 Processor -- start 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.511+0000 7fc4bb800640 1 -- start start 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.511+0000 7fc4bb800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.511+0000 7fc4bb800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b410df70 con 0x7fc4b4109a10 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.511+0000 7fc4b8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37942/0 (socket says 172.21.15.22:37942) 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b8e00640 1 -- 172.21.15.22:0/263377012 learned_addr learned my addr 172.21.15.22:0/263377012 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:28.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b8e00640 1 -- 172.21.15.22:0/263377012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b419df90 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b8e00640 1 --2- 172.21.15.22:0/263377012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b419da50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80097f0 tx=0x7fc4a8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8042070 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4a8032ca0 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.512+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8037040 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.513+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b419e220 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.513+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b41a0f10 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.513+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc4a8045070 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.513+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc4a80463b0 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.514+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b410e0f0 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.516+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc4a803da60 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.583+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc4b41a10e0 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.583+0000 7fc4b1600640 1 -- 172.21.15.22:0/263377012 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc4a8047440 con 0x7fc4b4109a10 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.584+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 msgr2=0x7fc4b419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:28.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.584+0000 7fc4bb800640 1 --2- 172.21.15.22:0/263377012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b419da50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80097f0 tx=0x7fc4a8030ec0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.467 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.585+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 shutdown_connections 2024-09-15T22:22:28.467 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.585+0000 7fc4bb800640 1 --2- 172.21.15.22:0/263377012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4b4109a10 0x7fc4b419da50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:28.467 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.585+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 >> 172.21.15.22:0/263377012 conn(0x7fc4b407d030 msgr2=0x7fc4b4107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:28.467 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.585+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 shutdown_connections 2024-09-15T22:22:28.467 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:27.585+0000 7fc4bb800640 1 -- 172.21.15.22:0/263377012 wait complete. 2024-09-15T22:22:28.467 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (2/15)... 2024-09-15T22:22:28.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:28.398+0000 7f56d57d4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:22:28.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:28.473+0000 7f56d57d4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:22:29.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:29.429+0000 7f56d57d4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:22:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: Activating manager daemon x 2024-09-15T22:22:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: mgrmap e2: x(active, starting, since 0.00445936s) 2024-09-15T22:22:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:22:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:22:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:22:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: Manager daemon x is now available 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' 2024-09-15T22:22:29.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:29 smithi022 ceph-mon[30634]: from='mgr.14100 172.21.15.22:0/4081899153' entity='mgr.x' 2024-09-15T22:22:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:31 smithi022 ceph-mon[30634]: mgrmap e3: x(active, since 1.00975s) 2024-09-15T22:22:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:31 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2704716895' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:22:31.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:31.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:22:31.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:22:31.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:22:31.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:22:31.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:31.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:22:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:22:31.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:22:31.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:22:31.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:22:31.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:22:31.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:22:15:226409+0000", 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:22:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:22:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:22:15.227161+0000", 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.925+0000 7f8d85200640 1 Processor -- start 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.925+0000 7f8d85200640 1 -- start start 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.925+0000 7f8d85200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d80109e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.925+0000 7f8d85200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8010a3e0 con 0x7f8d80109a10 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.926+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d80109e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.926+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d80109e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36374/0 (socket says 172.21.15.22:36374) 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.926+0000 7f8d7de00640 1 -- 172.21.15.22:0/1711351095 learned_addr learned my addr 172.21.15.22:0/1711351095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:31.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.926+0000 7f8d7de00640 1 -- 172.21.15.22:0/1711351095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8010abc0 con 0x7f8d80109a10 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.927+0000 7f8d7de00640 1 --2- 172.21.15.22:0/1711351095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d80109e10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009820 tx=0x7f8d7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cb07df4fb96941 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.927+0000 7f8d7ca00640 1 -- 172.21.15.22:0/1711351095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d70037070 con 0x7f8d80109a10 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.927+0000 7f8d7ca00640 1 -- 172.21.15.22:0/1711351095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d70032900 con 0x7f8d80109a10 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.927+0000 7f8d7ca00640 1 -- 172.21.15.22:0/1711351095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d70030850 con 0x7f8d80109a10 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 -- 172.21.15.22:0/1711351095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 msgr2=0x7f8d80109e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 --2- 172.21.15.22:0/1711351095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d80109e10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009820 tx=0x7f8d7002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 -- 172.21.15.22:0/1711351095 shutdown_connections 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 --2- 172.21.15.22:0/1711351095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d80109e10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 -- 172.21.15.22:0/1711351095 >> 172.21.15.22:0/1711351095 conn(0x7f8d8007d030 msgr2=0x7f8d8007d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 -- 172.21.15.22:0/1711351095 shutdown_connections 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.928+0000 7f8d85200640 1 -- 172.21.15.22:0/1711351095 wait complete. 2024-09-15T22:22:31.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.929+0000 7f8d85200640 1 Processor -- start 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.929+0000 7f8d85200640 1 -- start start 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d85200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d8019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d85200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8010df70 con 0x7f8d80109a10 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d8019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d8019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36390/0 (socket says 172.21.15.22:36390) 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d7de00640 1 -- 172.21.15.22:0/2704716895 learned_addr learned my addr 172.21.15.22:0/2704716895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d7de00640 1 -- 172.21.15.22:0/2704716895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8019df90 con 0x7f8d80109a10 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.930+0000 7f8d7de00640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d8019da50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d700097f0 tx=0x7f8d70030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.931+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d70042070 con 0x7f8d80109a10 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.931+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d70032ca0 con 0x7f8d80109a10 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.931+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8019e220 con 0x7f8d80109a10 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.931+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d70037040 con 0x7f8d80109a10 2024-09-15T22:22:31.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.931+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d801a0f10 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.932+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f8d70045070 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.932+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8010e0f0 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.933+0000 7f8d76a00640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8d64039050 0x7f8d6403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.933+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8d7006bf40 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.933+0000 7f8d7d400640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8d64039050 0x7f8d6403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.933+0000 7f8d7d400640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8d64039050 0x7f8d6403b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0098c0 tx=0x7f8d6c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:30.938+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d7004b170 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.189+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8d801a1580 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.189+0000 7f8d76a00640 1 -- 172.21.15.22:0/2704716895 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f8d7003d430 con 0x7f8d80109a10 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.193+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8d64039050 msgr2=0x7f8d6403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.193+0000 7f8d85200640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8d64039050 0x7f8d6403b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0098c0 tx=0x7f8d6c006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:31.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.193+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 msgr2=0x7f8d8019da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.193+0000 7f8d85200640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d8019da50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d700097f0 tx=0x7f8d70030ec0 comp rx=0 tx=0).stop 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.194+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 shutdown_connections 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.194+0000 7f8d85200640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8d64039050 0x7f8d6403b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.194+0000 7f8d85200640 1 --2- 172.21.15.22:0/2704716895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d80109a10 0x7f8d8019da50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.194+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 >> 172.21.15.22:0/2704716895 conn(0x7f8d8007d030 msgr2=0x7f8d80107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.194+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 shutdown_connections 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:31.194+0000 7f8d85200640 1 -- 172.21.15.22:0/2704716895 wait complete. 2024-09-15T22:22:31.864 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2024-09-15T22:22:32.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:32 smithi022 ceph-mon[30634]: mgrmap e4: x(active, since 2s) 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:22:33.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:22:33.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.323+0000 7f8ff9600640 1 Processor -- start 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.324+0000 7f8ff9600640 1 -- start start 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.324+0000 7f8ff9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff4109c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.324+0000 7f8ff9600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff410a1f0 con 0x7f8ff4109820 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.324+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff4109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.324+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff4109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36396/0 (socket says 172.21.15.22:36396) 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.324+0000 7f8ff3e00640 1 -- 172.21.15.22:0/2377942713 learned_addr learned my addr 172.21.15.22:0/2377942713 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.325+0000 7f8ff3e00640 1 -- 172.21.15.22:0/2377942713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff410aa70 con 0x7f8ff4109820 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.326+0000 7f8ff3e00640 1 --2- 172.21.15.22:0/2377942713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff4109c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009e80 tx=0x7f8fe402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474e140510d1a82f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.326+0000 7f8ff3400640 1 -- 172.21.15.22:0/2377942713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4036070 con 0x7f8ff4109820 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.326+0000 7f8ff3400640 1 -- 172.21.15.22:0/2377942713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fe40318c0 con 0x7f8ff4109820 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.326+0000 7f8ff3400640 1 -- 172.21.15.22:0/2377942713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4007ab0 con 0x7f8ff4109820 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 -- 172.21.15.22:0/2377942713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 msgr2=0x7f8ff4109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:33.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 --2- 172.21.15.22:0/2377942713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff4109c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009e80 tx=0x7f8fe402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 -- 172.21.15.22:0/2377942713 shutdown_connections 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 --2- 172.21.15.22:0/2377942713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff4109c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 -- 172.21.15.22:0/2377942713 >> 172.21.15.22:0/2377942713 conn(0x7f8ff407cf10 msgr2=0x7f8ff407d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 -- 172.21.15.22:0/2377942713 shutdown_connections 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.327+0000 7f8ff9600640 1 -- 172.21.15.22:0/2377942713 wait complete. 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.328+0000 7f8ff9600640 1 Processor -- start 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.328+0000 7f8ff9600640 1 -- start start 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.328+0000 7f8ff9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff419d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.328+0000 7f8ff9600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff410de20 con 0x7f8ff4109820 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.329+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff419d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.329+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff419d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36406/0 (socket says 172.21.15.22:36406) 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.329+0000 7f8ff3e00640 1 -- 172.21.15.22:0/1183006783 learned_addr learned my addr 172.21.15.22:0/1183006783 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:33.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.329+0000 7f8ff3e00640 1 -- 172.21.15.22:0/1183006783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff419dd80 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.329+0000 7f8ff3e00640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff419d840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8fe402ad90 tx=0x7f8fe4031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.329+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4036050 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.330+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fe4042070 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.330+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe403d7e0 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.330+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff419e010 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.330+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41a0d00 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.331+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f8fe403b610 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.331+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff4109c20 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.331+0000 7f8ff1600640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8fd8039160 0x7f8fd803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.331+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8fe4007e00 con 0x7f8ff4109820 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.331+0000 7f8feb400640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8fd8039160 0x7f8fd803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.332+0000 7f8feb400640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8fd8039160 0x7f8fd803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0098c0 tx=0x7f8fdc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:33.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.336+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fe40073a0 con 0x7f8ff4109820 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.521+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8ff41a2500 con 0x7f8ff4109820 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.522+0000 7f8ff1600640 1 -- 172.21.15.22:0/1183006783 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f8fe4042220 con 0x7f8ff4109820 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8fd8039160 msgr2=0x7f8fd803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8fd8039160 0x7f8fd803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0098c0 tx=0x7f8fdc006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 msgr2=0x7f8ff419d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff419d840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8fe402ad90 tx=0x7f8fe4031ca0 comp rx=0 tx=0).stop 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 shutdown_connections 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7f8fd8039160 0x7f8fd803b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.524+0000 7f8ff9600640 1 --2- 172.21.15.22:0/1183006783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff4109820 0x7f8ff419d840 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.525+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 >> 172.21.15.22:0/1183006783 conn(0x7f8ff407cf10 msgr2=0x7f8ff4107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.525+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 shutdown_connections 2024-09-15T22:22:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:32.525+0000 7f8ff9600640 1 -- 172.21.15.22:0/1183006783 wait complete. 2024-09-15T22:22:33.097 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2024-09-15T22:22:33.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:33 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1183006783' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:22:34.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:34 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2845969233' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T22:22:34.767 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: ignoring --setuser ceph since I am not root 2024-09-15T22:22:34.767 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: ignoring --setgroup ceph since I am not root 2024-09-15T22:22:34.767 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:34.689+0000 7f7c8fc4a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:22:34.767 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:34.764+0000 7f7c8fc4a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:22:35.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:34.978+0000 7f7c8fc4a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.531+0000 7fa373200640 1 Processor -- start 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.531+0000 7fa373200640 1 -- start start 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.531+0000 7fa373200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.531+0000 7fa373200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c07c880 con 0x7fa36c07de50 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.532+0000 7fa36be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.532+0000 7fa36be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36414/0 (socket says 172.21.15.22:36414) 2024-09-15T22:22:35.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.532+0000 7fa36be00640 1 -- 172.21.15.22:0/3351617211 learned_addr learned my addr 172.21.15.22:0/3351617211 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.532+0000 7fa36be00640 1 -- 172.21.15.22:0/3351617211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c07ca00 con 0x7fa36c07de50 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.533+0000 7fa36be00640 1 --2- 172.21.15.22:0/3351617211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c07c2b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009820 tx=0x7fa35c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e9f702c30a67a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.533+0000 7fa36aa00640 1 -- 172.21.15.22:0/3351617211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35c037070 con 0x7fa36c07de50 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.533+0000 7fa36aa00640 1 -- 172.21.15.22:0/3351617211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa35c032900 con 0x7fa36c07de50 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.533+0000 7fa36aa00640 1 -- 172.21.15.22:0/3351617211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35c030850 con 0x7fa36c07de50 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 -- 172.21.15.22:0/3351617211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 msgr2=0x7fa36c07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 --2- 172.21.15.22:0/3351617211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c07c2b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009820 tx=0x7fa35c02a270 comp rx=0 tx=0).stop 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 -- 172.21.15.22:0/3351617211 shutdown_connections 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 --2- 172.21.15.22:0/3351617211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c07c2b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 -- 172.21.15.22:0/3351617211 >> 172.21.15.22:0/3351617211 conn(0x7fa36c102ff0 msgr2=0x7fa36c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:35.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 -- 172.21.15.22:0/3351617211 shutdown_connections 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.534+0000 7fa373200640 1 -- 172.21.15.22:0/3351617211 wait complete. 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.535+0000 7fa373200640 1 Processor -- start 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.535+0000 7fa373200640 1 -- start start 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.535+0000 7fa373200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.535+0000 7fa373200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c10de70 con 0x7fa36c07de50 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa36be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa36be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c19da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36424/0 (socket says 172.21.15.22:36424) 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa36be00640 1 -- 172.21.15.22:0/2845969233 learned_addr learned my addr 172.21.15.22:0/2845969233 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa36be00640 1 -- 172.21.15.22:0/2845969233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c19df90 con 0x7fa36c07de50 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa36be00640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c19da50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0097f0 tx=0x7fa35c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35c042070 con 0x7fa36c07de50 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa35c032ca0 con 0x7fa36c07de50 2024-09-15T22:22:35.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.536+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35c037040 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.537+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36c19e220 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.537+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36c1a0f10 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.538+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36c07c330 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.538+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fa35c045070 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.538+0000 7fa368c00640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa3500391b0 0x7fa35003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.538+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa35c06c1b0 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.538+0000 7fa36b400640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa3500391b0 0x7fa35003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.539+0000 7fa36b400640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa3500391b0 0x7fa35003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa3580098c0 tx=0x7fa358006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.543+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa35c045360 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:33.775+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa36c1a1590 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.444+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa35c06bbd0 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.446+0000 7fa368c00640 1 -- 172.21.15.22:0/2845969233 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa35c03d430 con 0x7fa36c07de50 2024-09-15T22:22:35.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa3500391b0 msgr2=0x7fa35003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa3500391b0 0x7fa35003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa3580098c0 tx=0x7fa358006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 msgr2=0x7fa36c19da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c19da50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0097f0 tx=0x7fa35c030ec0 comp rx=0 tx=0).stop 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 shutdown_connections 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa3500391b0 0x7fa35003b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 --2- 172.21.15.22:0/2845969233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa36c07de50 0x7fa36c19da50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 >> 172.21.15.22:0/2845969233 conn(0x7fa36c102ff0 msgr2=0x7fa36c103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 shutdown_connections 2024-09-15T22:22:35.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:34.448+0000 7fa373200640 1 -- 172.21.15.22:0/2845969233 wait complete. 2024-09-15T22:22:35.322 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:35.062+0000 7f7c8fc4a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:22:35.322 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:35.253+0000 7f7c8fc4a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:22:35.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2845969233' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T22:22:35.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-mon[30634]: mgrmap e5: x(active, since 5s) 2024-09-15T22:22:35.597 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:35.428+0000 7f7c8fc4a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:22:35.904 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:35.825+0000 7f7c8fc4a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:22:35.904 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:35.901+0000 7f7c8fc4a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:22:36.282 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:36.135+0000 7f7c8fc4a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:22:36.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:36 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/469966975' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:22:36.610 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:22:36.610 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.704+0000 7fa46be00640 1 Processor -- start 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.704+0000 7fa46be00640 1 -- start start 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.704+0000 7fa46be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.704+0000 7fa46be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10a240 con 0x7fa46c109870 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.705+0000 7fa46aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.705+0000 7fa46aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36440/0 (socket says 172.21.15.22:36440) 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.705+0000 7fa46aa00640 1 -- 172.21.15.22:0/3685195969 learned_addr learned my addr 172.21.15.22:0/3685195969 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:36.611 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.705+0000 7fa46aa00640 1 -- 172.21.15.22:0/3685195969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c10aa10 con 0x7fa46c109870 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.706+0000 7fa46aa00640 1 --2- 172.21.15.22:0/3685195969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c109c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009820 tx=0x7fa45c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefbdc64969c0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.706+0000 7fa469600640 1 -- 172.21.15.22:0/3685195969 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45c037070 con 0x7fa46c109870 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.706+0000 7fa469600640 1 -- 172.21.15.22:0/3685195969 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa45c032900 con 0x7fa46c109870 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa469600640 1 -- 172.21.15.22:0/3685195969 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45c030850 con 0x7fa46c109870 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa46be00640 1 -- 172.21.15.22:0/3685195969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 msgr2=0x7fa46c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa46be00640 1 --2- 172.21.15.22:0/3685195969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c109c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009820 tx=0x7fa45c02a270 comp rx=0 tx=0).stop 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa46be00640 1 -- 172.21.15.22:0/3685195969 shutdown_connections 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa46be00640 1 --2- 172.21.15.22:0/3685195969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c109c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa46be00640 1 -- 172.21.15.22:0/3685195969 >> 172.21.15.22:0/3685195969 conn(0x7fa46c07ce30 msgr2=0x7fa46c07d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.707+0000 7fa46be00640 1 -- 172.21.15.22:0/3685195969 shutdown_connections 2024-09-15T22:22:36.612 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.708+0000 7fa46be00640 1 -- 172.21.15.22:0/3685195969 wait complete. 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.708+0000 7fa46be00640 1 Processor -- start 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46be00640 1 -- start start 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c19d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46be00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10ddc0 con 0x7fa46c109870 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c19d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c19d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36450/0 (socket says 172.21.15.22:36450) 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46aa00640 1 -- 172.21.15.22:0/469966975 learned_addr learned my addr 172.21.15.22:0/469966975 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.709+0000 7fa46aa00640 1 -- 172.21.15.22:0/469966975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c19dd80 con 0x7fa46c109870 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.710+0000 7fa46aa00640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c19d840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0097f0 tx=0x7fa45c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.710+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45c037040 con 0x7fa46c109870 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.710+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa45c040070 con 0x7fa46c109870 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.710+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45c03a390 con 0x7fa46c109870 2024-09-15T22:22:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.710+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c19e010 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.710+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1a0d00 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.711+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa45c03a5e0 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.712+0000 7fa463400640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 0x7fa45003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.712+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c109cf0 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.712+0000 7fa46a000640 1 -- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 msgr2=0x7fa45003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.712+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa45c06c3c0 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.712+0000 7fa46a000640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 0x7fa45003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.717+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa45c042310 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.913+0000 7fa46a000640 1 -- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 msgr2=0x7fa45003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.913+0000 7fa46a000640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 0x7fa45003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.954+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa46c1a13d0 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.954+0000 7fa463400640 1 -- 172.21.15.22:0/469966975 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fa45c0371e0 con 0x7fa46c109870 2024-09-15T22:22:36.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 msgr2=0x7fa45003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 0x7fa45003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 msgr2=0x7fa46c19d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c19d840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0097f0 tx=0x7fa45c030d80 comp rx=0 tx=0).stop 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 shutdown_connections 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7fa450039200 0x7fa45003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 --2- 172.21.15.22:0/469966975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa46c109870 0x7fa46c19d840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 >> 172.21.15.22:0/469966975 conn(0x7fa46c07ce30 msgr2=0x7fa46c107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 shutdown_connections 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:35.957+0000 7fa46be00640 1 -- 172.21.15.22:0/469966975 wait complete. 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-15T22:22:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2024-09-15T22:22:37.393 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:37.307+0000 7f7c8fc4a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:22:37.393 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:37.391+0000 7f7c8fc4a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:22:38.667 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:38.351+0000 7f7c8fc4a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:22:38.668 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:38.493+0000 7f7c8fc4a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:22:38.668 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:38.665+0000 7f7c8fc4a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:22:38.922 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:38.741+0000 7f7c8fc4a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:22:38.922 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:38.920+0000 7f7c8fc4a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:22:39.277 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.005+0000 7f7c8fc4a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:22:39.277 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.081+0000 7f7c8fc4a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:22:39.277 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.274+0000 7f7c8fc4a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:22:39.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.357+0000 7f7c8fc4a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:22:39.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.443+0000 7f7c8fc4a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:22:40.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.547+0000 7f7c8fc4a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:22:40.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.623+0000 7f7c8fc4a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:22:40.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:39.700+0000 7f7c8fc4a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:22:41.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:40.676+0000 7f7c8fc4a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:22:41.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: Active manager daemon x restarted 2024-09-15T22:22:41.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: Activating manager daemon x 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: mgrmap e6: x(active, starting, since 0.00374603s) 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:22:41.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: Manager daemon x is now available 2024-09-15T22:22:41.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:41.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:41.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:41.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:40 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:41 smithi022 ceph-mon[30634]: Found migration_current of "None". Setting to last migration. 2024-09-15T22:22:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:41 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:22:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:41 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:22:42.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:41 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:42.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:41 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:42.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:41 smithi022 ceph-mon[30634]: mgrmap e7: x(active, since 1.00683s) 2024-09-15T22:22:42.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:22:42.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T22:22:42.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:22:42.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.109+0000 7ff7b4e00640 1 Processor -- start 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.110+0000 7ff7b4e00640 1 -- start start 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.110+0000 7ff7b4e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b0107a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.110+0000 7ff7b4e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b0108040 con 0x7ff7b0107670 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.110+0000 7ff7af400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b0107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.110+0000 7ff7af400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b0107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36462/0 (socket says 172.21.15.22:36462) 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.110+0000 7ff7af400640 1 -- 172.21.15.22:0/3982946477 learned_addr learned my addr 172.21.15.22:0/3982946477 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.111+0000 7ff7af400640 1 -- 172.21.15.22:0/3982946477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b0108820 con 0x7ff7b0107670 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.112+0000 7ff7af400640 1 --2- 172.21.15.22:0/3982946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b0107a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009820 tx=0x7ff7a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6dd9f9444bcedc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.112+0000 7ff7aea00640 1 -- 172.21.15.22:0/3982946477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a0037070 con 0x7ff7b0107670 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.112+0000 7ff7aea00640 1 -- 172.21.15.22:0/3982946477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7a0032900 con 0x7ff7b0107670 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.112+0000 7ff7aea00640 1 -- 172.21.15.22:0/3982946477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a0030850 con 0x7ff7b0107670 2024-09-15T22:22:42.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 -- 172.21.15.22:0/3982946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 msgr2=0x7ff7b0107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/3982946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b0107a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009820 tx=0x7ff7a002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 -- 172.21.15.22:0/3982946477 shutdown_connections 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/3982946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b0107a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 -- 172.21.15.22:0/3982946477 >> 172.21.15.22:0/3982946477 conn(0x7ff7b0102e20 msgr2=0x7ff7b0105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 -- 172.21.15.22:0/3982946477 shutdown_connections 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.113+0000 7ff7b4e00640 1 -- 172.21.15.22:0/3982946477 wait complete. 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.114+0000 7ff7b4e00640 1 Processor -- start 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.114+0000 7ff7b4e00640 1 -- start start 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.115+0000 7ff7b4e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.115+0000 7ff7b4e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b010bbd0 con 0x7ff7b0107670 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.115+0000 7ff7af400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.115+0000 7ff7af400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36478/0 (socket says 172.21.15.22:36478) 2024-09-15T22:22:42.628 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.115+0000 7ff7af400640 1 -- 172.21.15.22:0/1658590814 learned_addr learned my addr 172.21.15.22:0/1658590814 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.115+0000 7ff7af400640 1 -- 172.21.15.22:0/1658590814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b019dde0 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.116+0000 7ff7af400640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b019d8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00097f0 tx=0x7ff7a0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.116+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a0037040 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.116+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b019e070 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.116+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7a0040070 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.116+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a003a390 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.116+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b01a0d60 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.117+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7ff7a003a5e0 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.118+0000 7ff7acc00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.118+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 --> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff79403bdd0 con 0x7ff794039200 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.118+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff7a006d490 con 0x7ff7b0107670 2024-09-15T22:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.118+0000 7ff7a7e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 msgr2=0x7ff79403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.118+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.319+0000 7ff7a7e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 msgr2=0x7ff79403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.319+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.720+0000 7ff7a7e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 msgr2=0x7ff79403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:37.720+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:38.521+0000 7ff7a7e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 msgr2=0x7ff79403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:38.521+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:40.122+0000 7ff7a7e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 msgr2=0x7ff79403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/2616449464 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:40.122+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:40.680+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7ff7a002fd40 con 0x7ff7b0107670 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:40.680+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 msgr2=0x7ff79403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:22:42.630 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:40.680+0000 7ff7acc00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.681+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7ff7a006e0f0 con 0x7ff7b0107670 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.682+0000 7ff7acc00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7ff79403cb30 0x7ff79403ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.682+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff7a0037e50 con 0x7ff79403cb30 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.683+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7ff79403cb30 0x7ff79403ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.684+0000 7ff7a7e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7ff79403cb30 0x7ff79403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff798003980 tx=0x7ff7980092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.685+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff7a0037e50 con 0x7ff79403cb30 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.692+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff78c002570 con 0x7ff79403cb30 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.692+0000 7ff7acc00640 1 -- 172.21.15.22:0/1658590814 <== mgr.14118 v2:172.21.15.22:6800/3305817552 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff78c002570 con 0x7ff79403cb30 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7ff79403cb30 msgr2=0x7ff79403ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7ff79403cb30 0x7ff79403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff798003980 tx=0x7ff7980092b0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 msgr2=0x7ff7b019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b019d8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00097f0 tx=0x7ff7a0030d80 comp rx=0 tx=0).stop 2024-09-15T22:22:42.631 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 shutdown_connections 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7ff79403cb30 0x7ff79403ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:6800/2616449464,v1:172.21.15.22:6801/2616449464] conn(0x7ff794039200 0x7ff79403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 --2- 172.21.15.22:0/1658590814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b0107670 0x7ff7b019d8a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 >> 172.21.15.22:0/1658590814 conn(0x7ff7b0102e20 msgr2=0x7ff7b0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 shutdown_connections 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:41.693+0000 7ff7b4e00640 1 -- 172.21.15.22:0/1658590814 wait complete. 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2024-09-15T22:22:42.632 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2024-09-15T22:22:42.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-mon[30634]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:22:42.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-mon[30634]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:22:42.896 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:42.798+0000 7f7be8600640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:22:42] ENGINE Error in HTTPServer.serve 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: Traceback (most recent call last): 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self._connections.run(self.expiration_interval) 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self._run(expiration_interval) 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: s = self.context.wrap_socket( 2024-09-15T22:22:42.897 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: return self.sslsocket_class._create( 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self.do_handshake() 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self._sslobj.do_handshake() 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:22:42.898 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: [15/Sep/2024:22:22:42] ENGINE Bus STARTING 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: [15/Sep/2024:22:22:42] ENGINE Serving on http://172.21.15.22:8765 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: mgrmap e8: x(active, since 2s) 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: [15/Sep/2024:22:22:42] ENGINE Serving on https://172.21.15.22:7150 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: [15/Sep/2024:22:22:42] ENGINE Bus STARTED 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: [15/Sep/2024:22:22:42] ENGINE Error in HTTPServer.serve 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:22:44.021 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:22:44.022 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-15T22:22:44.023 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:22:44.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:44.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:44.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:43 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:44.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.160+0000 7fc667200640 1 Processor -- start 2024-09-15T22:22:44.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.160+0000 7fc667200640 1 -- start start 2024-09-15T22:22:44.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.160+0000 7fc667200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc668107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.160+0000 7fc667200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc668108000 con 0x7fc668107630 2024-09-15T22:22:44.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.160+0000 7fc665e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc668107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.161+0000 7fc665e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc668107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36480/0 (socket says 172.21.15.22:36480) 2024-09-15T22:22:44.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.161+0000 7fc665e00640 1 -- 172.21.15.22:0/4132132839 learned_addr learned my addr 172.21.15.22:0/4132132839 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.161+0000 7fc665e00640 1 -- 172.21.15.22:0/4132132839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc668108830 con 0x7fc668107630 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.162+0000 7fc665e00640 1 --2- 172.21.15.22:0/4132132839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc668107a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc658009820 tx=0x7fc65802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae0dc9ff5e862b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.162+0000 7fc665400640 1 -- 172.21.15.22:0/4132132839 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658037070 con 0x7fc668107630 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.162+0000 7fc665400640 1 -- 172.21.15.22:0/4132132839 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc658032900 con 0x7fc668107630 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.162+0000 7fc665400640 1 -- 172.21.15.22:0/4132132839 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658030850 con 0x7fc668107630 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 -- 172.21.15.22:0/4132132839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 msgr2=0x7fc668107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 --2- 172.21.15.22:0/4132132839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc668107a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc658009820 tx=0x7fc65802a270 comp rx=0 tx=0).stop 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 -- 172.21.15.22:0/4132132839 shutdown_connections 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 --2- 172.21.15.22:0/4132132839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc668107a30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 -- 172.21.15.22:0/4132132839 >> 172.21.15.22:0/4132132839 conn(0x7fc668102dc0 msgr2=0x7fc668105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 -- 172.21.15.22:0/4132132839 shutdown_connections 2024-09-15T22:22:44.034 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.163+0000 7fc667200640 1 -- 172.21.15.22:0/4132132839 wait complete. 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.164+0000 7fc667200640 1 Processor -- start 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.164+0000 7fc667200640 1 -- start start 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.164+0000 7fc667200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc66819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.164+0000 7fc667200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc66810bbe0 con 0x7fc668107630 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.165+0000 7fc665e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc66819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.165+0000 7fc665e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc66819d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36488/0 (socket says 172.21.15.22:36488) 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.165+0000 7fc665e00640 1 -- 172.21.15.22:0/306770346 learned_addr learned my addr 172.21.15.22:0/306770346 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.165+0000 7fc665e00640 1 -- 172.21.15.22:0/306770346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66819dd50 con 0x7fc668107630 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.165+0000 7fc665e00640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc66819d810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc658009940 tx=0x7fc658032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.165+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658042070 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.166+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6580308c0 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.166+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66819dfe0 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.166+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc658037040 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.166+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6681a0cd0 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.167+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc658045070 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.167+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc668107ab0 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.167+0000 7fc65ea00640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fc64c039200 0x7fc64c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.167+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc65806c300 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.167+0000 7fc65fe00640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fc64c039200 0x7fc64c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.168+0000 7fc65fe00640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fc64c039200 0x7fc64c03b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc6500098c0 tx=0x7fc650006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.173+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc65804b170 con 0x7fc668107630 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.371+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fc668104020 con 0x7fc64c039200 2024-09-15T22:22:44.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.376+0000 7fc65ea00640 1 -- 172.21.15.22:0/306770346 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc668104020 con 0x7fc64c039200 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fc64c039200 msgr2=0x7fc64c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fc64c039200 0x7fc64c03b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc6500098c0 tx=0x7fc650006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 msgr2=0x7fc66819d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc66819d810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc658009940 tx=0x7fc658032ce0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 shutdown_connections 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fc64c039200 0x7fc64c03b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 --2- 172.21.15.22:0/306770346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc668107630 0x7fc66819d810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 >> 172.21.15.22:0/306770346 conn(0x7fc668102dc0 msgr2=0x7fc668103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 shutdown_connections 2024-09-15T22:22:44.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:43.379+0000 7fc667200640 1 -- 172.21.15.22:0/306770346 wait complete. 2024-09-15T22:22:45.321 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T22:22:45.321 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.497+0000 7f817cc00640 1 Processor -- start 2024-09-15T22:22:45.321 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.497+0000 7f817cc00640 1 -- start start 2024-09-15T22:22:45.321 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.498+0000 7f817cc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f8178107be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.498+0000 7f817cc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81781081b0 con 0x7f81781077e0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.498+0000 7f8175e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f8178107be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.498+0000 7f8175e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f8178107be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36496/0 (socket says 172.21.15.22:36496) 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.498+0000 7f8175e00640 1 -- 172.21.15.22:0/957785050 learned_addr learned my addr 172.21.15.22:0/957785050 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.498+0000 7f8175e00640 1 -- 172.21.15.22:0/957785050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81781089e0 con 0x7f81781077e0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.499+0000 7f8175e00640 1 --2- 172.21.15.22:0/957785050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f8178107be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8168009820 tx=0x7f816802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298fbfa812a10c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f8175400640 1 -- 172.21.15.22:0/957785050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8168037070 con 0x7f81781077e0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f8175400640 1 -- 172.21.15.22:0/957785050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8168032900 con 0x7f81781077e0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f8175400640 1 -- 172.21.15.22:0/957785050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8168030850 con 0x7f81781077e0 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f817cc00640 1 -- 172.21.15.22:0/957785050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 msgr2=0x7f8178107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f817cc00640 1 --2- 172.21.15.22:0/957785050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f8178107be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8168009820 tx=0x7f816802a270 comp rx=0 tx=0).stop 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f817cc00640 1 -- 172.21.15.22:0/957785050 shutdown_connections 2024-09-15T22:22:45.322 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f817cc00640 1 --2- 172.21.15.22:0/957785050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f8178107be0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.500+0000 7f817cc00640 1 -- 172.21.15.22:0/957785050 >> 172.21.15.22:0/957785050 conn(0x7f8178102ff0 msgr2=0x7f8178105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.501+0000 7f817cc00640 1 -- 172.21.15.22:0/957785050 shutdown_connections 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.501+0000 7f817cc00640 1 -- 172.21.15.22:0/957785050 wait complete. 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.501+0000 7f817cc00640 1 Processor -- start 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.502+0000 7f817cc00640 1 -- start start 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.502+0000 7f817cc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f817819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.502+0000 7f817cc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f817810bd90 con 0x7f81781077e0 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.502+0000 7f8175e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f817819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.502+0000 7f8175e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f817819b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36504/0 (socket says 172.21.15.22:36504) 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.502+0000 7f8175e00640 1 -- 172.21.15.22:0/1643263242 learned_addr learned my addr 172.21.15.22:0/1643263242 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f8175e00640 1 -- 172.21.15.22:0/1643263242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817819bd40 con 0x7f81781077e0 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f8175e00640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f817819b800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81680097f0 tx=0x7f8168030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:45.323 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8168037040 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8168040070 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817819bfd0 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f816803a390 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.503+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817819ecc0 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.504+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f816803b430 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.504+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8178107c60 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.505+0000 7f816f400640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f815c0391b0 0x7f815c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.505+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f816806c810 con 0x7f81781077e0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.505+0000 7f816d400640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f815c0391b0 0x7f815c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.506+0000 7f816d400640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f815c0391b0 0x7f815c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f81600098c0 tx=0x7f8160006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:45.324 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.510+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f816806c160 con 0x7f81781077e0 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.697+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f8178104280 con 0x7f815c0391b0 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.697+0000 7f816f400640 1 -- 172.21.15.22:0/1643263242 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f8178104280 con 0x7f815c0391b0 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.700+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f815c0391b0 msgr2=0x7f815c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.700+0000 7f817cc00640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f815c0391b0 0x7f815c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f81600098c0 tx=0x7f8160006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.700+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 msgr2=0x7f817819b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.700+0000 7f817cc00640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f817819b800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81680097f0 tx=0x7f8168030d80 comp rx=0 tx=0).stop 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.701+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 shutdown_connections 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.701+0000 7f817cc00640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f815c0391b0 0x7f815c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.701+0000 7f817cc00640 1 --2- 172.21.15.22:0/1643263242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81781077e0 0x7f817819b800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.701+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 >> 172.21.15.22:0/1643263242 conn(0x7f8178102ff0 msgr2=0x7f8178103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.701+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 shutdown_connections 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:44.701+0000 7f817cc00640 1 -- 172.21.15.22:0/1643263242 wait complete. 2024-09-15T22:22:45.325 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2024-09-15T22:22:45.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:45 smithi022 ceph-mon[30634]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:46.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: Generating public/private rsa key pair. 2024-09-15T22:22:46.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: Your identification has been saved in /tmp/tmpne3nwn7r/key 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: Your public key has been saved in /tmp/tmpne3nwn7r/key.pub 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: The key fingerprint is: 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: SHA256:TnVwT/x8lYqGthi8/wouICc2A5v9ElPh2wM4VIYFank ceph-d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: The key's randomart image is: 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: +---[RSA 3072]----+ 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: | .=+ . ... .| 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: | .+.. o o...| 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: |.+ E .. o o oo.| 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: |o + + o + + . +| 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: |.+ o + S o .| 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: |o*+o. o= . | 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: |. *+. oo | 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: | . ... .. | 2024-09-15T22:22:46.783 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: | . .. .o. | 2024-09-15T22:22:46.784 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:22:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: +----[SHA256]-----+ 2024-09-15T22:22:47.129 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.839+0000 7f5c83200640 1 Processor -- start 2024-09-15T22:22:47.129 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.839+0000 7f5c83200640 1 -- start start 2024-09-15T22:22:47.129 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.839+0000 7f5c83200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c84107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.839+0000 7f5c83200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84108000 con 0x7f5c84107630 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.839+0000 7f5c81e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c84107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.840+0000 7f5c81e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c84107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36508/0 (socket says 172.21.15.22:36508) 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.840+0000 7f5c81e00640 1 -- 172.21.15.22:0/964407348 learned_addr learned my addr 172.21.15.22:0/964407348 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.840+0000 7f5c81e00640 1 -- 172.21.15.22:0/964407348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c84108830 con 0x7f5c84107630 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.841+0000 7f5c81e00640 1 --2- 172.21.15.22:0/964407348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c84107a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009e80 tx=0x7f5c7402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ca9f2f4407bec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.841+0000 7f5c80a00640 1 -- 172.21.15.22:0/964407348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74036070 con 0x7f5c84107630 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.841+0000 7f5c80a00640 1 -- 172.21.15.22:0/964407348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c740318c0 con 0x7f5c84107630 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.841+0000 7f5c80a00640 1 -- 172.21.15.22:0/964407348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74007ab0 con 0x7f5c84107630 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 -- 172.21.15.22:0/964407348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 msgr2=0x7f5c84107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 --2- 172.21.15.22:0/964407348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c84107a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009e80 tx=0x7f5c7402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.130 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 -- 172.21.15.22:0/964407348 shutdown_connections 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 --2- 172.21.15.22:0/964407348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c84107a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 -- 172.21.15.22:0/964407348 >> 172.21.15.22:0/964407348 conn(0x7f5c84102dc0 msgr2=0x7f5c84105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 -- 172.21.15.22:0/964407348 shutdown_connections 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.842+0000 7f5c83200640 1 -- 172.21.15.22:0/964407348 wait complete. 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.843+0000 7f5c83200640 1 Processor -- start 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.843+0000 7f5c83200640 1 -- start start 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.843+0000 7f5c83200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c8407db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.843+0000 7f5c83200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8410bbe0 con 0x7f5c84107630 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.844+0000 7f5c81e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c8407db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.844+0000 7f5c81e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c8407db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36524/0 (socket says 172.21.15.22:36524) 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.844+0000 7f5c81e00640 1 -- 172.21.15.22:0/2309007017 learned_addr learned my addr 172.21.15.22:0/2309007017 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.844+0000 7f5c81e00640 1 -- 172.21.15.22:0/2309007017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8407e060 con 0x7f5c84107630 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.844+0000 7f5c81e00640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c8407db20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c7402acc0 tx=0x7f5c74031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.845+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74036050 con 0x7f5c84107630 2024-09-15T22:22:47.131 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.845+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c74037040 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.845+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7403d8c0 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.845+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8407c250 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.845+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8407c790 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.846+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5c74044020 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.846+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c84107ab0 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.846+0000 7f5c7aa00640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f5c68039200 0x7f5c6803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.846+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5c74042020 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.847+0000 7f5c81400640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f5c68039200 0x7f5c6803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.847+0000 7f5c81400640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f5c68039200 0x7f5c6803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098c0 tx=0x7f5c70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:45.851+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c7404b020 con 0x7f5c84107630 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.038+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f5c8407d0e0 con 0x7f5c68039200 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.537+0000 7f5c7aa00640 1 -- 172.21.15.22:0/2309007017 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c8407d0e0 con 0x7f5c68039200 2024-09-15T22:22:47.132 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f5c68039200 msgr2=0x7f5c6803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f5c68039200 0x7f5c6803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098c0 tx=0x7f5c70006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 msgr2=0x7f5c8407db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c8407db20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c7402acc0 tx=0x7f5c74031ca0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 shutdown_connections 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f5c68039200 0x7f5c6803b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 --2- 172.21.15.22:0/2309007017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c84107630 0x7f5c8407db20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 >> 172.21.15.22:0/2309007017 conn(0x7f5c84102dc0 msgr2=0x7f5c84103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 shutdown_connections 2024-09-15T22:22:47.133 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:46.539+0000 7f5c83200640 1 -- 172.21.15.22:0/2309007017 wait complete. 2024-09-15T22:22:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:47 smithi022 ceph-mon[30634]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:47 smithi022 ceph-mon[30634]: Generating ssh key... 2024-09-15T22:22:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:47 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:47 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:48.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.662+0000 7f28eb800640 1 Processor -- start 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.662+0000 7f28eb800640 1 -- start start 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.662+0000 7f28eb800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e4109e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.662+0000 7f28eb800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f28e410a3e0 con 0x7f28e4109a10 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.663+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e4109e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.663+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e4109e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36536/0 (socket says 172.21.15.22:36536) 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.663+0000 7f28e8e00640 1 -- 172.21.15.22:0/3417582144 learned_addr learned my addr 172.21.15.22:0/3417582144 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.663+0000 7f28e8e00640 1 -- 172.21.15.22:0/3417582144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e410abc0 con 0x7f28e4109a10 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.664+0000 7f28e8e00640 1 --2- 172.21.15.22:0/3417582144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e4109e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009820 tx=0x7f28d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75df0d5cb6523509 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.664+0000 7f28e3400640 1 -- 172.21.15.22:0/3417582144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28d8037070 con 0x7f28e4109a10 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.664+0000 7f28e3400640 1 -- 172.21.15.22:0/3417582144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28d8032900 con 0x7f28e4109a10 2024-09-15T22:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.664+0000 7f28e3400640 1 -- 172.21.15.22:0/3417582144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28d8030850 con 0x7f28e4109a10 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 -- 172.21.15.22:0/3417582144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 msgr2=0x7f28e4109e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 --2- 172.21.15.22:0/3417582144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e4109e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009820 tx=0x7f28d802a270 comp rx=0 tx=0).stop 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 -- 172.21.15.22:0/3417582144 shutdown_connections 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 --2- 172.21.15.22:0/3417582144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e4109e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 -- 172.21.15.22:0/3417582144 >> 172.21.15.22:0/3417582144 conn(0x7f28e407d030 msgr2=0x7f28e407d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 -- 172.21.15.22:0/3417582144 shutdown_connections 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.665+0000 7f28eb800640 1 -- 172.21.15.22:0/3417582144 wait complete. 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.666+0000 7f28eb800640 1 Processor -- start 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.666+0000 7f28eb800640 1 -- start start 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.666+0000 7f28eb800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.666+0000 7f28eb800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f28e410df70 con 0x7f28e4109a10 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.667+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:48.531 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.667+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36538/0 (socket says 172.21.15.22:36538) 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.667+0000 7f28e8e00640 1 -- 172.21.15.22:0/3197730330 learned_addr learned my addr 172.21.15.22:0/3197730330 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.667+0000 7f28e8e00640 1 -- 172.21.15.22:0/3197730330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e419df90 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.667+0000 7f28e8e00640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e419da50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f28d80097f0 tx=0x7f28d8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.668+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28d8042070 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.668+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28d8032ca0 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.668+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28d8037040 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.668+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e419e220 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.668+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41a0f10 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.669+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f28d8045070 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.669+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e410e0f0 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.669+0000 7f28e1600640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f28cc039200 0x7f28cc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.669+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f28d806c230 con 0x7f28e4109a10 2024-09-15T22:22:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.670+0000 7f28e3e00640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f28cc039200 0x7f28cc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.670+0000 7f28e3e00640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f28cc039200 0x7f28cc03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28d00098c0 tx=0x7f28d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.675+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28d804b170 con 0x7f28e4109a10 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.861+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f28e4107c60 con 0x7f28cc039200 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.862+0000 7f28e1600640 1 -- 172.21.15.22:0/3197730330 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f28e4107c60 con 0x7f28cc039200 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.864+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f28cc039200 msgr2=0x7f28cc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.864+0000 7f28eb800640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f28cc039200 0x7f28cc03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28d00098c0 tx=0x7f28d0006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.864+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 msgr2=0x7f28e419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.864+0000 7f28eb800640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e419da50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f28d80097f0 tx=0x7f28d8030ec0 comp rx=0 tx=0).stop 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.865+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 shutdown_connections 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.865+0000 7f28eb800640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f28cc039200 0x7f28cc03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.865+0000 7f28eb800640 1 --2- 172.21.15.22:0/3197730330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e4109a10 0x7f28e419da50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.865+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 >> 172.21.15.22:0/3197730330 conn(0x7f28e407d030 msgr2=0x7f28e4107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:48.533 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.865+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 shutdown_connections 2024-09-15T22:22:48.534 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:47.865+0000 7f28eb800640 1 -- 172.21.15.22:0/3197730330 wait complete. 2024-09-15T22:22:48.534 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:22:48.534 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T22:22:48.534 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2024-09-15T22:22:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:48 smithi022 ceph-mon[30634]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:49.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:49 smithi022 ceph-mon[30634]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:51.898 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:51 smithi022 ceph-mon[30634]: Deploying cephadm binary to smithi022 2024-09-15T22:22:54.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2024-09-15T22:22:54.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.038+0000 7f3fe4000640 1 Processor -- start 2024-09-15T22:22:54.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.038+0000 7f3fe4000640 1 -- start start 2024-09-15T22:22:54.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.038+0000 7f3fe4000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:54.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.038+0000 7f3fe4000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc1081d0 con 0x7f3fdc107800 2024-09-15T22:22:54.453 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.039+0000 7f3fe1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.039+0000 7f3fe1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36552/0 (socket says 172.21.15.22:36552) 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.039+0000 7f3fe1600640 1 -- 172.21.15.22:0/1329311506 learned_addr learned my addr 172.21.15.22:0/1329311506 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.039+0000 7f3fe1600640 1 -- 172.21.15.22:0/1329311506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc108a00 con 0x7f3fdc107800 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.040+0000 7f3fe1600640 1 --2- 172.21.15.22:0/1329311506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc107c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009820 tx=0x7f3fd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f9925a440b1581 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.040+0000 7f3fdbe00640 1 -- 172.21.15.22:0/1329311506 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0037070 con 0x7f3fdc107800 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.040+0000 7f3fdbe00640 1 -- 172.21.15.22:0/1329311506 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fd0032900 con 0x7f3fdc107800 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.040+0000 7f3fdbe00640 1 -- 172.21.15.22:0/1329311506 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0030850 con 0x7f3fdc107800 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 -- 172.21.15.22:0/1329311506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 msgr2=0x7f3fdc107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 --2- 172.21.15.22:0/1329311506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc107c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009820 tx=0x7f3fd002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 -- 172.21.15.22:0/1329311506 shutdown_connections 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 --2- 172.21.15.22:0/1329311506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc107c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 -- 172.21.15.22:0/1329311506 >> 172.21.15.22:0/1329311506 conn(0x7f3fdc102ff0 msgr2=0x7f3fdc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:54.454 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 -- 172.21.15.22:0/1329311506 shutdown_connections 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.041+0000 7f3fe4000640 1 -- 172.21.15.22:0/1329311506 wait complete. 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.042+0000 7f3fe4000640 1 Processor -- start 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.042+0000 7f3fe4000640 1 -- start start 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.043+0000 7f3fe4000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.043+0000 7f3fe4000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc10bdb0 con 0x7f3fdc107800 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.043+0000 7f3fe1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.043+0000 7f3fe1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36566/0 (socket says 172.21.15.22:36566) 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.043+0000 7f3fe1600640 1 -- 172.21.15.22:0/4269727804 learned_addr learned my addr 172.21.15.22:0/4269727804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.043+0000 7f3fe1600640 1 -- 172.21.15.22:0/4269727804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc19bdd0 con 0x7f3fdc107800 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.044+0000 7f3fe1600640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc19b890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00097f0 tx=0x7f3fd0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.044+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0042070 con 0x7f3fdc107800 2024-09-15T22:22:54.455 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.044+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fd0032ca0 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.044+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc19c060 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.044+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0037040 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.044+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc19ed50 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.045+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3fd0045070 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.045+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc10bf30 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.045+0000 7f3fda000640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f3fc4039200 0x7f3fc403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.046+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3fd006c340 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.046+0000 7f3fe0c00640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f3fc4039200 0x7f3fc403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.046+0000 7f3fe0c00640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f3fc4039200 0x7f3fc403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80098c0 tx=0x7f3fc8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.050+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fd003ac60 con 0x7f3fdc107800 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:49.237+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}) -- 0x7f3fdc104380 con 0x7f3fc4039200 2024-09-15T22:22:54.456 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.806+0000 7f3fda000640 1 -- 172.21.15.22:0/4269727804 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3fdc104380 con 0x7f3fc4039200 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f3fc4039200 msgr2=0x7f3fc403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f3fc4039200 0x7f3fc403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80098c0 tx=0x7f3fc8006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 msgr2=0x7f3fdc19b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc19b890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00097f0 tx=0x7f3fd0030ec0 comp rx=0 tx=0).stop 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 shutdown_connections 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f3fc4039200 0x7f3fc403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 --2- 172.21.15.22:0/4269727804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fdc107800 0x7f3fdc19b890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 >> 172.21.15.22:0/4269727804 conn(0x7f3fdc102ff0 msgr2=0x7f3fdc103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 shutdown_connections 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:53.809+0000 7f3fe4000640 1 -- 172.21.15.22:0/4269727804 wait complete. 2024-09-15T22:22:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2024-09-15T22:22:55.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:54 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:55.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:54 smithi022 ceph-mon[30634]: Added host smithi022 2024-09-15T22:22:55.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:54 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:56 smithi022 ceph-mon[30634]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:56 smithi022 ceph-mon[30634]: Saving service mon spec with placement count:5 2024-09-15T22:22:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:56 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.056+0000 7f41d4c00640 1 Processor -- start 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.056+0000 7f41d4c00640 1 -- start start 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.057+0000 7f41d4c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.057+0000 7f41d4c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f41d007c860 con 0x7f41d007de30 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.057+0000 7f41cde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.057+0000 7f41cde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54202/0 (socket says 172.21.15.22:54202) 2024-09-15T22:22:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.057+0000 7f41cde00640 1 -- 172.21.15.22:0/2894789539 learned_addr learned my addr 172.21.15.22:0/2894789539 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.057+0000 7f41cde00640 1 -- 172.21.15.22:0/2894789539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d007c9e0 con 0x7f41d007de30 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.058+0000 7f41cde00640 1 --2- 172.21.15.22:0/2894789539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d007c290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009820 tx=0x7f41c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a381190b53249315 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41cd400640 1 -- 172.21.15.22:0/2894789539 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c0037070 con 0x7f41d007de30 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41cd400640 1 -- 172.21.15.22:0/2894789539 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41c0032900 con 0x7f41d007de30 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41cd400640 1 -- 172.21.15.22:0/2894789539 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c0030850 con 0x7f41d007de30 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41d4c00640 1 -- 172.21.15.22:0/2894789539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 msgr2=0x7f41d007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41d4c00640 1 --2- 172.21.15.22:0/2894789539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d007c290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009820 tx=0x7f41c002a270 comp rx=0 tx=0).stop 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41d4c00640 1 -- 172.21.15.22:0/2894789539 shutdown_connections 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41d4c00640 1 --2- 172.21.15.22:0/2894789539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d007c290 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.059+0000 7f41d4c00640 1 -- 172.21.15.22:0/2894789539 >> 172.21.15.22:0/2894789539 conn(0x7f41d0102ff0 msgr2=0x7f41d0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.060+0000 7f41d4c00640 1 -- 172.21.15.22:0/2894789539 shutdown_connections 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.060+0000 7f41d4c00640 1 -- 172.21.15.22:0/2894789539 wait complete. 2024-09-15T22:22:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.060+0000 7f41d4c00640 1 Processor -- start 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41d4c00640 1 -- start start 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41d4c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41d4c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f41d010de30 con 0x7f41d007de30 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41cde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41cde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d019da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54208/0 (socket says 172.21.15.22:54208) 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41cde00640 1 -- 172.21.15.22:0/2176838579 learned_addr learned my addr 172.21.15.22:0/2176838579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.061+0000 7f41cde00640 1 -- 172.21.15.22:0/2176838579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d019df80 con 0x7f41d007de30 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.062+0000 7f41cde00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d019da40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41c00097f0 tx=0x7f41c0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.062+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c0042070 con 0x7f41d007de30 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.062+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d019e210 con 0x7f41d007de30 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.062+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41c0032ca0 con 0x7f41d007de30 2024-09-15T22:22:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.062+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c0037040 con 0x7f41d007de30 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.062+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01a0f00 con 0x7f41d007de30 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.063+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f41c0045070 con 0x7f41d007de30 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.063+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d007c310 con 0x7f41d007de30 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.063+0000 7f41c6a00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f41b4039200 0x7f41b403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.064+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f41c006c2e0 con 0x7f41d007de30 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.064+0000 7f41c7e00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f41b4039200 0x7f41b403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.065+0000 7f41c7e00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f41b4039200 0x7f41b403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41b80098c0 tx=0x7f41b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.069+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41c006bc30 con 0x7f41d007de30 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.272+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f41d01042f0 con 0x7f41b4039200 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.278+0000 7f41c6a00640 1 -- 172.21.15.22:0/2176838579 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f41d01042f0 con 0x7f41b4039200 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f41b4039200 msgr2=0x7f41b403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f41b4039200 0x7f41b403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41b80098c0 tx=0x7f41b8006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 msgr2=0x7f41d019da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d019da40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41c00097f0 tx=0x7f41c0030ec0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 shutdown_connections 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f41b4039200 0x7f41b403b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 --2- 172.21.15.22:0/2176838579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41d007de30 0x7f41d019da40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.280+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 >> 172.21.15.22:0/2176838579 conn(0x7f41d0102ff0 msgr2=0x7f41d0103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.281+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 shutdown_connections 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:55.281+0000 7f41d4c00640 1 -- 172.21.15.22:0/2176838579 wait complete. 2024-09-15T22:22:57.113 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2024-09-15T22:22:57.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:57 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:57.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:57 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:59.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:58 smithi022 ceph-mon[30634]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:22:59.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:58 smithi022 ceph-mon[30634]: Saving service mgr spec with placement count:2 2024-09-15T22:22:59.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:58 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:59.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:22:58 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:22:59.180 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T22:22:59.180 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.696+0000 7faef3200640 1 Processor -- start 2024-09-15T22:22:59.180 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.696+0000 7faef3200640 1 -- start start 2024-09-15T22:22:59.180 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.697+0000 7faef3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef4109c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.697+0000 7faef3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faef410a1f0 con 0x7faef4109820 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.697+0000 7faef1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef4109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.697+0000 7faef1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef4109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54224/0 (socket says 172.21.15.22:54224) 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.697+0000 7faef1e00640 1 -- 172.21.15.22:0/641090342 learned_addr learned my addr 172.21.15.22:0/641090342 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.698+0000 7faef1e00640 1 -- 172.21.15.22:0/641090342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef410aa70 con 0x7faef4109820 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.699+0000 7faef1e00640 1 --2- 172.21.15.22:0/641090342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef4109c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faee4009820 tx=0x7faee402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51038627b8ac579d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.699+0000 7faef1400640 1 -- 172.21.15.22:0/641090342 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee4037070 con 0x7faef4109820 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.699+0000 7faef1400640 1 -- 172.21.15.22:0/641090342 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee4032920 con 0x7faef4109820 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.699+0000 7faef1400640 1 -- 172.21.15.22:0/641090342 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee4030810 con 0x7faef4109820 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.699+0000 7faef3200640 1 -- 172.21.15.22:0/641090342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 msgr2=0x7faef4109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.699+0000 7faef3200640 1 --2- 172.21.15.22:0/641090342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef4109c20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faee4009820 tx=0x7faee402a270 comp rx=0 tx=0).stop 2024-09-15T22:22:59.181 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.700+0000 7faef3200640 1 -- 172.21.15.22:0/641090342 shutdown_connections 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.700+0000 7faef3200640 1 --2- 172.21.15.22:0/641090342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef4109c20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.700+0000 7faef3200640 1 -- 172.21.15.22:0/641090342 >> 172.21.15.22:0/641090342 conn(0x7faef407cf10 msgr2=0x7faef407d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.700+0000 7faef3200640 1 -- 172.21.15.22:0/641090342 shutdown_connections 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.700+0000 7faef3200640 1 -- 172.21.15.22:0/641090342 wait complete. 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef3200640 1 Processor -- start 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef3200640 1 -- start start 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef3200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef419d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef3200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faef410de20 con 0x7faef4109820 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef419d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef1e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef419d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54228/0 (socket says 172.21.15.22:54228) 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.701+0000 7faef1e00640 1 -- 172.21.15.22:0/2667946365 learned_addr learned my addr 172.21.15.22:0/2667946365 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.702+0000 7faef1e00640 1 -- 172.21.15.22:0/2667946365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef419dda0 con 0x7faef4109820 2024-09-15T22:22:59.182 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.702+0000 7faef1e00640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef419d860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faee40097f0 tx=0x7faee40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.702+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee4037040 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.702+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee4030cc0 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.702+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef419e030 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.702+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee403a6b0 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.703+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef41a0d20 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.704+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed00052c0 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.704+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7faee403a850 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.705+0000 7faeeaa00640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7faed8039200 0x7faed803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.705+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faee406c930 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.705+0000 7faeebe00640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7faed8039200 0x7faed803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.705+0000 7faeebe00640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7faed8039200 0x7faed803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faedc0098c0 tx=0x7faedc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.710+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faee406c280 con 0x7faef4109820 2024-09-15T22:22:59.183 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.918+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7faed0000bf0 con 0x7faed8039200 2024-09-15T22:22:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.923+0000 7faeeaa00640 1 -- 172.21.15.22:0/2667946365 <== mgr.14118 v2:172.21.15.22:6800/3305817552 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7faed0000bf0 con 0x7faed8039200 2024-09-15T22:22:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7faed8039200 msgr2=0x7faed803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7faed8039200 0x7faed803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faedc0098c0 tx=0x7faedc006db0 comp rx=0 tx=0).stop 2024-09-15T22:22:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 msgr2=0x7faef419d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef419d860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faee40097f0 tx=0x7faee40327b0 comp rx=0 tx=0).stop 2024-09-15T22:22:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 shutdown_connections 2024-09-15T22:22:59.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7faed8039200 0x7faed803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:59.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 --2- 172.21.15.22:0/2667946365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faef4109820 0x7faef419d860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:59.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 >> 172.21.15.22:0/2667946365 conn(0x7faef407cf10 msgr2=0x7faef41074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:59.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 shutdown_connections 2024-09-15T22:22:59.185 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:57.927+0000 7faef3200640 1 -- 172.21.15.22:0/2667946365 wait complete. 2024-09-15T22:23:00.542 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.641+0000 7f7bfbe00640 1 Processor -- start 2024-09-15T22:23:00.542 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.642+0000 7f7bfbe00640 1 -- start start 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.642+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.642+0000 7f7bfbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf407c8c0 con 0x7f7bf407de90 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.642+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.643+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54240/0 (socket says 172.21.15.22:54240) 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.643+0000 7f7bf9400640 1 -- 172.21.15.22:0/3731150381 learned_addr learned my addr 172.21.15.22:0/3731150381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.643+0000 7f7bf9400640 1 -- 172.21.15.22:0/3731150381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf407ca40 con 0x7f7bf407de90 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.644+0000 7f7bf9400640 1 --2- 172.21.15.22:0/3731150381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf407c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009820 tx=0x7f7be802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb643acaf54ef71 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.644+0000 7f7bf3e00640 1 -- 172.21.15.22:0/3731150381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be8037070 con 0x7f7bf407de90 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.644+0000 7f7bf3e00640 1 -- 172.21.15.22:0/3731150381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be8032920 con 0x7f7bf407de90 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.644+0000 7f7bf3e00640 1 -- 172.21.15.22:0/3731150381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be8030810 con 0x7f7bf407de90 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 -- 172.21.15.22:0/3731150381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 msgr2=0x7f7bf407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/3731150381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf407c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009820 tx=0x7f7be802a270 comp rx=0 tx=0).stop 2024-09-15T22:23:00.543 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 -- 172.21.15.22:0/3731150381 shutdown_connections 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/3731150381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf407c2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 -- 172.21.15.22:0/3731150381 >> 172.21.15.22:0/3731150381 conn(0x7f7bf4102ff0 msgr2=0x7f7bf4105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 -- 172.21.15.22:0/3731150381 shutdown_connections 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.645+0000 7f7bfbe00640 1 -- 172.21.15.22:0/3731150381 wait complete. 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.646+0000 7f7bfbe00640 1 Processor -- start 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.646+0000 7f7bfbe00640 1 -- start start 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.647+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.647+0000 7f7bfbe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf410de90 con 0x7f7bf407de90 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.647+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.647+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf419dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54242/0 (socket says 172.21.15.22:54242) 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.647+0000 7f7bf9400640 1 -- 172.21.15.22:0/986867855 learned_addr learned my addr 172.21.15.22:0/986867855 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.647+0000 7f7bf9400640 1 -- 172.21.15.22:0/986867855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf419e020 con 0x7f7bf407de90 2024-09-15T22:23:00.544 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.648+0000 7f7bf9400640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf419dae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097f0 tx=0x7f7be80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.648+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be8037040 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.648+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be8030c40 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.648+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be803a5b0 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.648+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf419e2b0 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.648+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf41a0fa0 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.649+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7be803a7a0 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.649+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf407c370 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.650+0000 7f7bf2000640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f7bdc039200 0x7f7bdc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.650+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7be806c740 con 0x7f7bf407de90 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.650+0000 7f7bf8a00640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f7bdc039200 0x7f7bdc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.651+0000 7f7bf8a00640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f7bdc039200 0x7f7bdc03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7be00098c0 tx=0x7f7be0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:00.545 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.655+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7be80371e0 con 0x7f7bf407de90 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.842+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f7bf41a1590 con 0x7f7bf407de90 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.844+0000 7f7bf2000640 1 -- 172.21.15.22:0/986867855 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f7be806c090 con 0x7f7bf407de90 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f7bdc039200 msgr2=0x7f7bdc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f7bdc039200 0x7f7bdc03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7be00098c0 tx=0x7f7be0006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 msgr2=0x7f7bf419dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf419dae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097f0 tx=0x7f7be80327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 shutdown_connections 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f7bdc039200 0x7f7bdc03b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 --2- 172.21.15.22:0/986867855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bf407de90 0x7f7bf419dae0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.847+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 >> 172.21.15.22:0/986867855 conn(0x7f7bf4102ff0 msgr2=0x7f7bf4103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.848+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 shutdown_connections 2024-09-15T22:23:00.546 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:22:59.848+0000 7f7bfbe00640 1 -- 172.21.15.22:0/986867855 wait complete. 2024-09-15T22:23:01.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:00 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/986867855' entity='client.admin' 2024-09-15T22:23:01.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:00 smithi022 ceph-mon[30634]: from='mgr.14118 172.21.15.22:0/766573143' entity='mgr.x' 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.064+0000 7f9001000640 1 Processor -- start 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.064+0000 7f9001000640 1 -- start start 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.064+0000 7f9001000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.064+0000 7f9001000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc108200 con 0x7f8ffc107830 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.065+0000 7f8ff9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.065+0000 7f8ff9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50280/0 (socket says 172.21.15.22:50280) 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.065+0000 7f8ff9e00640 1 -- 172.21.15.22:0/3914674164 learned_addr learned my addr 172.21.15.22:0/3914674164 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:02.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.065+0000 7f8ff9e00640 1 -- 172.21.15.22:0/3914674164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc1089e0 con 0x7f8ffc107830 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.066+0000 7f8ff9e00640 1 --2- 172.21.15.22:0/3914674164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc107c30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009820 tx=0x7f8fec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6e55138d6ee722 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.067+0000 7f8ff8a00640 1 -- 172.21.15.22:0/3914674164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec037070 con 0x7f8ffc107830 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.067+0000 7f8ff8a00640 1 -- 172.21.15.22:0/3914674164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fec032920 con 0x7f8ffc107830 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.067+0000 7f8ff8a00640 1 -- 172.21.15.22:0/3914674164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec030810 con 0x7f8ffc107830 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.067+0000 7f9001000640 1 -- 172.21.15.22:0/3914674164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 msgr2=0x7f8ffc107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.067+0000 7f9001000640 1 --2- 172.21.15.22:0/3914674164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc107c30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009820 tx=0x7f8fec02a270 comp rx=0 tx=0).stop 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.068+0000 7f9001000640 1 -- 172.21.15.22:0/3914674164 shutdown_connections 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.068+0000 7f9001000640 1 --2- 172.21.15.22:0/3914674164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc107c30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.068+0000 7f9001000640 1 -- 172.21.15.22:0/3914674164 >> 172.21.15.22:0/3914674164 conn(0x7f8ffc103000 msgr2=0x7f8ffc105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.068+0000 7f9001000640 1 -- 172.21.15.22:0/3914674164 shutdown_connections 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.068+0000 7f9001000640 1 -- 172.21.15.22:0/3914674164 wait complete. 2024-09-15T22:23:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f9001000640 1 Processor -- start 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f9001000640 1 -- start start 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f9001000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f9001000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10bd90 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f8ff9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f8ff9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50286/0 (socket says 172.21.15.22:50286) 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.069+0000 7f8ff9e00640 1 -- 172.21.15.22:0/4281443320 learned_addr learned my addr 172.21.15.22:0/4281443320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f8ff9e00640 1 -- 172.21.15.22:0/4281443320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc19bd70 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f8ff9e00640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc19b830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097f0 tx=0x7f8fec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec037040 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fec030cc0 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec03a640 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc19c000 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.070+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc19ecf0 con 0x7f8ffc107830 2024-09-15T22:23:02.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.072+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc10bf10 con 0x7f8ffc107830 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.072+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8fec03b3f0 con 0x7f8ffc107830 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.072+0000 7f8ff2a00640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f8fe0039200 0x7f8fe003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.072+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8fec06c860 con 0x7f8ffc107830 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.073+0000 7f8ff9400640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f8fe0039200 0x7f8fe003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.073+0000 7f8ff9400640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f8fe0039200 0x7f8fe003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80098c0 tx=0x7f8fe8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.078+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fec042e10 con 0x7f8ffc107830 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.279+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f8ffc107cb0 con 0x7f8ffc107830 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.281+0000 7f8ff2a00640 1 -- 172.21.15.22:0/4281443320 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f8fec0328c0 con 0x7f8ffc107830 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f8fe0039200 msgr2=0x7f8fe003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f8fe0039200 0x7f8fe003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80098c0 tx=0x7f8fe8006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 msgr2=0x7f8ffc19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc19b830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097f0 tx=0x7f8fec0327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 shutdown_connections 2024-09-15T22:23:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f8fe0039200 0x7f8fe003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 --2- 172.21.15.22:0/4281443320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ffc107830 0x7f8ffc19b830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 >> 172.21.15.22:0/4281443320 conn(0x7f8ffc103000 msgr2=0x7f8ffc103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 shutdown_connections 2024-09-15T22:23:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:01.284+0000 7f9001000640 1 -- 172.21.15.22:0/4281443320 wait complete. 2024-09-15T22:23:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2024-09-15T22:23:02.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:02 smithi022 ceph-mon[30634]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:02.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:02 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/4281443320' entity='client.admin' 2024-09-15T22:23:03.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/697182915' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T22:23:03.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: ignoring --setuser ceph since I am not root 2024-09-15T22:23:03.533 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: ignoring --setgroup ceph since I am not root 2024-09-15T22:23:03.807 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:03.539+0000 7f500fc34040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:23:03.807 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:03.612+0000 7f500fc34040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:23:03.807 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:03.805+0000 7f500fc34040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:23:04.070 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:03.888+0000 7f500fc34040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:23:04.070 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:04.068+0000 7f500fc34040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.621+0000 7f5770800640 1 Processor -- start 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.621+0000 7f5770800640 1 -- start start 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.621+0000 7f5770800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576807c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.622+0000 7f5770800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f576807c7b0 con 0x7f576807de10 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.622+0000 7f576de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576807c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.622+0000 7f576de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576807c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50292/0 (socket says 172.21.15.22:50292) 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.622+0000 7f576de00640 1 -- 172.21.15.22:0/4186178097 learned_addr learned my addr 172.21.15.22:0/4186178097 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.622+0000 7f576de00640 1 -- 172.21.15.22:0/4186178097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576807c930 con 0x7f576807de10 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.623+0000 7f576de00640 1 --2- 172.21.15.22:0/4186178097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576807c270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f575c009820 tx=0x7f575c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d258c5f63af9c502 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.624+0000 7f576ca00640 1 -- 172.21.15.22:0/4186178097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f575c037070 con 0x7f576807de10 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.624+0000 7f576ca00640 1 -- 172.21.15.22:0/4186178097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f575c032920 con 0x7f576807de10 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.624+0000 7f576ca00640 1 -- 172.21.15.22:0/4186178097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f575c030810 con 0x7f576807de10 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.624+0000 7f5770800640 1 -- 172.21.15.22:0/4186178097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 msgr2=0x7f576807c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.624+0000 7f5770800640 1 --2- 172.21.15.22:0/4186178097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576807c270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f575c009820 tx=0x7f575c02a270 comp rx=0 tx=0).stop 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.625+0000 7f5770800640 1 -- 172.21.15.22:0/4186178097 shutdown_connections 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.625+0000 7f5770800640 1 --2- 172.21.15.22:0/4186178097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576807c270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.625+0000 7f5770800640 1 -- 172.21.15.22:0/4186178097 >> 172.21.15.22:0/4186178097 conn(0x7f5768102ff0 msgr2=0x7f5768105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.625+0000 7f5770800640 1 -- 172.21.15.22:0/4186178097 shutdown_connections 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.625+0000 7f5770800640 1 -- 172.21.15.22:0/4186178097 wait complete. 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f5770800640 1 Processor -- start 2024-09-15T22:23:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f5770800640 1 -- start start 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f5770800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f5770800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f576810de50 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f576de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f576de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576819da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50298/0 (socket says 172.21.15.22:50298) 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.626+0000 7f576de00640 1 -- 172.21.15.22:0/697182915 learned_addr learned my addr 172.21.15.22:0/697182915 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.627+0000 7f576de00640 1 -- 172.21.15.22:0/697182915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576819dfc0 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.627+0000 7f576de00640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576819da80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f575c0097f0 tx=0x7f575c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.627+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f575c037040 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.627+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f575c030c40 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.627+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576819e250 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.627+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f575c03a5d0 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.628+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57681a0f40 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.629+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f575c03b3f0 con 0x7f576807de10 2024-09-15T22:23:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.629+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576807c2f0 con 0x7f576807de10 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.629+0000 7f5762a00640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f57500391b0 0x7f575003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.629+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f575c06c830 con 0x7f576807de10 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.629+0000 7f576d400640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f57500391b0 0x7f575003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.630+0000 7f576d400640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f57500391b0 0x7f575003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f57580098c0 tx=0x7f5758006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.634+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f575c0313a0 con 0x7f576807de10 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:02.867+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f57681a1530 con 0x7f576807de10 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.284+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f575c038250 con 0x7f576807de10 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.287+0000 7f5762a00640 1 -- 172.21.15.22:0/697182915 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f575c041d10 con 0x7f576807de10 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f57500391b0 msgr2=0x7f575003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f57500391b0 0x7f575003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f57580098c0 tx=0x7f5758006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 msgr2=0x7f576819da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576819da80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f575c0097f0 tx=0x7f575c0327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 shutdown_connections 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f57500391b0 0x7f575003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 --2- 172.21.15.22:0/697182915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f576807de10 0x7f576819da80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 >> 172.21.15.22:0/697182915 conn(0x7f5768102ff0 msgr2=0x7f5768103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 shutdown_connections 2024-09-15T22:23:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:03.288+0000 7f5770800640 1 -- 172.21.15.22:0/697182915 wait complete. 2024-09-15T22:23:04.383 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:04.244+0000 7f500fc34040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:23:04.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/697182915' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T22:23:04.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-mon[30634]: mgrmap e9: x(active, since 22s) 2024-09-15T22:23:04.890 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:04.637+0000 7f500fc34040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:23:04.890 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:04.713+0000 7f500fc34040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:23:05.207 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:04 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:04.937+0000 7f500fc34040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:23:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:05 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2137024979' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:23:05.588 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:23:05.588 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T22:23:05.588 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.624+0000 7fb48e200640 1 Processor -- start 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.624+0000 7fb48e200640 1 -- start start 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.625+0000 7fb48e200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb488109e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.625+0000 7fb48e200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb48810a3d0 con 0x7fb488109a00 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.625+0000 7fb487400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb488109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.625+0000 7fb487400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb488109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50328/0 (socket says 172.21.15.22:50328) 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.625+0000 7fb487400640 1 -- 172.21.15.22:0/1444133324 learned_addr learned my addr 172.21.15.22:0/1444133324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.626+0000 7fb487400640 1 -- 172.21.15.22:0/1444133324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48810abf0 con 0x7fb488109a00 2024-09-15T22:23:05.589 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.626+0000 7fb487400640 1 --2- 172.21.15.22:0/1444133324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb488109e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb478009820 tx=0x7fb47802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a7fb3bf620ab10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.627+0000 7fb486000640 1 -- 172.21.15.22:0/1444133324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478037070 con 0x7fb488109a00 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.627+0000 7fb486000640 1 -- 172.21.15.22:0/1444133324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb478032920 con 0x7fb488109a00 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.627+0000 7fb486000640 1 -- 172.21.15.22:0/1444133324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478030810 con 0x7fb488109a00 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.627+0000 7fb48e200640 1 -- 172.21.15.22:0/1444133324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 msgr2=0x7fb488109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.627+0000 7fb48e200640 1 --2- 172.21.15.22:0/1444133324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb488109e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb478009820 tx=0x7fb47802a270 comp rx=0 tx=0).stop 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.628+0000 7fb48e200640 1 -- 172.21.15.22:0/1444133324 shutdown_connections 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.628+0000 7fb48e200640 1 --2- 172.21.15.22:0/1444133324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb488109e00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.628+0000 7fb48e200640 1 -- 172.21.15.22:0/1444133324 >> 172.21.15.22:0/1444133324 conn(0x7fb48807d010 msgr2=0x7fb48807d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.628+0000 7fb48e200640 1 -- 172.21.15.22:0/1444133324 shutdown_connections 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.628+0000 7fb48e200640 1 -- 172.21.15.22:0/1444133324 wait complete. 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.629+0000 7fb48e200640 1 Processor -- start 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.629+0000 7fb48e200640 1 -- start start 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.629+0000 7fb48e200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb48819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:05.590 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.629+0000 7fb48e200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb48810dfa0 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.630+0000 7fb487400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb48819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.630+0000 7fb487400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb48819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50342/0 (socket says 172.21.15.22:50342) 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.630+0000 7fb487400640 1 -- 172.21.15.22:0/2137024979 learned_addr learned my addr 172.21.15.22:0/2137024979 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.630+0000 7fb487400640 1 -- 172.21.15.22:0/2137024979 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48819df60 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.630+0000 7fb487400640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb48819da20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4780097f0 tx=0x7fb4780327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.631+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478037040 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.631+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb478030cc0 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.631+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb47803a640 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.631+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48819e1f0 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.631+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4881a0ee0 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.632+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48810e120 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.632+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fb47803b3f0 con 0x7fb488109a00 2024-09-15T22:23:05.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.633+0000 7fb47fe00640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 0x7fb46c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.633+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb47806c8b0 con 0x7fb488109a00 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.633+0000 7fb486a00640 1 -- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 msgr2=0x7fb46c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.633+0000 7fb486a00640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 0x7fb46c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.639+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4780328c0 con 0x7fb488109a00 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.834+0000 7fb486a00640 1 -- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 msgr2=0x7fb46c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.834+0000 7fb486a00640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 0x7fb46c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.872+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb4881a10b0 con 0x7fb488109a00 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.872+0000 7fb47fe00640 1 -- 172.21.15.22:0/2137024979 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fb478042dc0 con 0x7fb488109a00 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 msgr2=0x7fb46c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 0x7fb46c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 msgr2=0x7fb48819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:05.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb48819da20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4780097f0 tx=0x7fb4780327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 shutdown_connections 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7fb46c039260 0x7fb46c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 --2- 172.21.15.22:0/2137024979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb488109a00 0x7fb48819da20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 >> 172.21.15.22:0/2137024979 conn(0x7fb48807d010 msgr2=0x7fb488107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 shutdown_connections 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:04.875+0000 7fb48e200640 1 -- 172.21.15.22:0/2137024979 wait complete. 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-15T22:23:05.593 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2024-09-15T22:23:06.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:06 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:06.105+0000 7f500fc34040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:23:06.532 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:06 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:06.191+0000 7f500fc34040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:23:07.282 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.158+0000 7f500fc34040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:23:07.728 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.300+0000 7f500fc34040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:23:07.729 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.472+0000 7f500fc34040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:23:07.729 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.548+0000 7f500fc34040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:23:07.729 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.726+0000 7f500fc34040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:23:08.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.812+0000 7f500fc34040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:23:08.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:07.886+0000 7f500fc34040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:23:08.342 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:08 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:08.077+0000 7f500fc34040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:23:08.342 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:08 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:08.157+0000 7f500fc34040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:23:08.343 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:08 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:08.240+0000 7f500fc34040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:23:08.343 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:08 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:08.341+0000 7f500fc34040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:23:08.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:08 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:08.415+0000 7f500fc34040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:23:08.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:08 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:08.489+0000 7f500fc34040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:23:09.695 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:09.457+0000 7f500fc34040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:23:09.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: Active manager daemon x restarted 2024-09-15T22:23:09.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: Activating manager daemon x 2024-09-15T22:23:09.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T22:23:09.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: mgrmap e10: x(active, starting, since 0.00489879s) 2024-09-15T22:23:09.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:23:09.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:23:09.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:23:09.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:23:09.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:23:09.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: Manager daemon x is now available 2024-09-15T22:23:09.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:10.722 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:23:10.722 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:23:10.722 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:10 smithi022 ceph-mon[30634]: mgrmap e11: x(active, since 1.00819s) 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:11.338+0000 7f4f6d000640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:23:11] ENGINE Error in HTTPServer.serve 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: Traceback (most recent call last): 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self._connections.run(self.expiration_interval) 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self._run(expiration_interval) 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:23:11.519 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: s = self.context.wrap_socket( 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: return self.sslsocket_class._create( 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self.do_handshake() 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: self._sslobj.do_handshake() 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:23:11.520 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-mon[30634]: [15/Sep/2024:22:23:11] ENGINE Bus STARTING 2024-09-15T22:23:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-mon[30634]: [15/Sep/2024:22:23:11] ENGINE Serving on https://172.21.15.22:7150 2024-09-15T22:23:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:11 smithi022 ceph-mon[30634]: [15/Sep/2024:22:23:11] ENGINE Error in HTTPServer.serve 2024-09-15T22:23:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-15T22:23:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:23:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-15T22:23:11.783 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:23:11.784 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-15T22:23:11.784 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T22:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.079+0000 7f85bd800640 1 Processor -- start 2024-09-15T22:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.080+0000 7f85bd800640 1 -- start start 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.080+0000 7f85bd800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b8109e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.080+0000 7f85bd800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f85b810a3d0 con 0x7f85b8109a00 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.080+0000 7f85b6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b8109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.080+0000 7f85b6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b8109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50356/0 (socket says 172.21.15.22:50356) 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.080+0000 7f85b6a00640 1 -- 172.21.15.22:0/3001158893 learned_addr learned my addr 172.21.15.22:0/3001158893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.081+0000 7f85b6a00640 1 -- 172.21.15.22:0/3001158893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b810ac00 con 0x7f85b8109a00 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.082+0000 7f85b6a00640 1 --2- 172.21.15.22:0/3001158893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b8109e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009820 tx=0x7f85a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcc2f46993a7386 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.082+0000 7f85b5600640 1 -- 172.21.15.22:0/3001158893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a8037070 con 0x7f85b8109a00 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.082+0000 7f85b5600640 1 -- 172.21.15.22:0/3001158893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a8032920 con 0x7f85b8109a00 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.082+0000 7f85b5600640 1 -- 172.21.15.22:0/3001158893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a8030810 con 0x7f85b8109a00 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 -- 172.21.15.22:0/3001158893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 msgr2=0x7f85b8109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 --2- 172.21.15.22:0/3001158893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b8109e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009820 tx=0x7f85a802a270 comp rx=0 tx=0).stop 2024-09-15T22:23:11.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 -- 172.21.15.22:0/3001158893 shutdown_connections 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 --2- 172.21.15.22:0/3001158893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b8109e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 -- 172.21.15.22:0/3001158893 >> 172.21.15.22:0/3001158893 conn(0x7f85b807cfe0 msgr2=0x7f85b807d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 -- 172.21.15.22:0/3001158893 shutdown_connections 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.083+0000 7f85bd800640 1 -- 172.21.15.22:0/3001158893 wait complete. 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.084+0000 7f85bd800640 1 Processor -- start 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.084+0000 7f85bd800640 1 -- start start 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.084+0000 7f85bd800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.084+0000 7f85bd800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f85b810dfb0 con 0x7f85b8109a00 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.085+0000 7f85b6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.085+0000 7f85b6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50368/0 (socket says 172.21.15.22:50368) 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.085+0000 7f85b6a00640 1 -- 172.21.15.22:0/4277992955 learned_addr learned my addr 172.21.15.22:0/4277992955 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.085+0000 7f85b6a00640 1 -- 172.21.15.22:0/4277992955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b819df60 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.085+0000 7f85b6a00640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b819da20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85a80097f0 tx=0x7f85a80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.086+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a8037040 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.086+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a8030cc0 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.086+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b819e1f0 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.086+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a803a640 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.086+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b81a0ee0 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.087+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f85a803b3f0 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.087+0000 7f85af400640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.087+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 --> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f859c03bdd0 con 0x7f859c039200 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.088+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f85a806c900 con 0x7f85b8109a00 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.088+0000 7f85b6000640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 msgr2=0x7f859c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.088+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.289+0000 7f85b6000640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 msgr2=0x7f859c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.289+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.690+0000 7f85b6000640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 msgr2=0x7f859c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:06.690+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:07.491+0000 7f85b6000640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 msgr2=0x7f859c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:07.491+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:09.094+0000 7f85b6000640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 msgr2=0x7f859c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3305817552 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:09.094+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:09.462+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f85a803a940 con 0x7f85b8109a00 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:09.462+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 msgr2=0x7f859c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:09.462+0000 7f85af400640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.464+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f85a806e5c0 con 0x7f85b8109a00 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.464+0000 7f85af400640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f859c03ccc0 0x7f859c03f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.464+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f85a8065960 con 0x7f859c03ccc0 2024-09-15T22:23:11.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.465+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f859c03ccc0 0x7f859c03f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.466+0000 7f85b6000640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f859c03ccc0 0x7f859c03f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85a4003980 tx=0x7f85a4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.467+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f85a8065960 con 0x7f859c03ccc0 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.476+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f85b810e130 con 0x7f859c03ccc0 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85af400640 1 -- 172.21.15.22:0/4277992955 <== mgr.14150 v2:172.21.15.22:6800/191438634 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f85b810e130 con 0x7f859c03ccc0 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f859c03ccc0 msgr2=0x7f859c03f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f859c03ccc0 0x7f859c03f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85a4003980 tx=0x7f85a4009290 comp rx=0 tx=0).stop 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 msgr2=0x7f85b819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b819da20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85a80097f0 tx=0x7f85a80327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 shutdown_connections 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/3305817552,v1:172.21.15.22:6801/3305817552] conn(0x7f859c039200 0x7f859c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f859c03ccc0 0x7f859c03f0b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 --2- 172.21.15.22:0/4277992955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85b8109a00 0x7f85b819da20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.477+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 >> 172.21.15.22:0/4277992955 conn(0x7f85b807cfe0 msgr2=0x7f85b8107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.478+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 shutdown_connections 2024-09-15T22:23:11.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:10.478+0000 7f85bd800640 1 -- 172.21.15.22:0/4277992955 wait complete. 2024-09-15T22:23:11.848 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2024-09-15T22:23:11.848 INFO:teuthology.orchestra.run.smithi022.stdout:Generating a dashboard self-signed certificate... 2024-09-15T22:23:12.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:12 smithi022 ceph-mon[30634]: [15/Sep/2024:22:23:11] ENGINE Serving on http://172.21.15.22:8765 2024-09-15T22:23:12.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:12 smithi022 ceph-mon[30634]: [15/Sep/2024:22:23:11] ENGINE Bus STARTED 2024-09-15T22:23:12.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:12 smithi022 ceph-mon[30634]: mgrmap e12: x(active, since 2s) 2024-09-15T22:23:12.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.369+0000 7f3c8d800640 1 Processor -- start 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.370+0000 7f3c8d800640 1 -- start start 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.370+0000 7f3c8d800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c88109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.370+0000 7f3c8d800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8810a240 con 0x7f3c88109870 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.371+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c88109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.371+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c88109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37848/0 (socket says 172.21.15.22:37848) 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.371+0000 7f3c87e00640 1 -- 172.21.15.22:0/2059836381 learned_addr learned my addr 172.21.15.22:0/2059836381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.371+0000 7f3c87e00640 1 -- 172.21.15.22:0/2059836381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8810aa10 con 0x7f3c88109870 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.372+0000 7f3c87e00640 1 --2- 172.21.15.22:0/2059836381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c88109c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009820 tx=0x7f3c7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1521424a20895eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.372+0000 7f3c86a00640 1 -- 172.21.15.22:0/2059836381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78037070 con 0x7f3c88109870 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.372+0000 7f3c86a00640 1 -- 172.21.15.22:0/2059836381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c78032920 con 0x7f3c88109870 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.372+0000 7f3c86a00640 1 -- 172.21.15.22:0/2059836381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78030810 con 0x7f3c88109870 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 -- 172.21.15.22:0/2059836381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 msgr2=0x7f3c88109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 --2- 172.21.15.22:0/2059836381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c88109c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009820 tx=0x7f3c7802a270 comp rx=0 tx=0).stop 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 -- 172.21.15.22:0/2059836381 shutdown_connections 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 --2- 172.21.15.22:0/2059836381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c88109c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 -- 172.21.15.22:0/2059836381 >> 172.21.15.22:0/2059836381 conn(0x7f3c8807ce30 msgr2=0x7f3c8807d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 -- 172.21.15.22:0/2059836381 shutdown_connections 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.373+0000 7f3c8d800640 1 -- 172.21.15.22:0/2059836381 wait complete. 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.374+0000 7f3c8d800640 1 Processor -- start 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.374+0000 7f3c8d800640 1 -- start start 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.375+0000 7f3c8d800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c8819d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.299 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.375+0000 7f3c8d800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8810ddc0 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.375+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c8819d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.375+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c8819d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37854/0 (socket says 172.21.15.22:37854) 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.375+0000 7f3c87e00640 1 -- 172.21.15.22:0/3915604808 learned_addr learned my addr 172.21.15.22:0/3915604808 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.375+0000 7f3c87e00640 1 -- 172.21.15.22:0/3915604808 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8819dda0 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.376+0000 7f3c87e00640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c8819d860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097f0 tx=0x7f3c780327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.376+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78037040 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.376+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c78030cc0 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.376+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7803a640 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.376+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8819e030 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.376+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c881a0d20 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.377+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3c7803b3f0 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.377+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8810df40 con 0x7f3c88109870 2024-09-15T22:23:13.300 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.378+0000 7f3c84c00640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3c6c039260 0x7f3c6c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.378+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3c7806c990 con 0x7f3c88109870 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.378+0000 7f3c87400640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3c6c039260 0x7f3c6c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.379+0000 7f3c87400640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3c6c039260 0x7f3c6c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098c0 tx=0x7f3c74006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.383+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c78042dc0 con 0x7f3c88109870 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.579+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f3c88107c50 con 0x7f3c6c039260 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.628+0000 7f3c84c00640 1 -- 172.21.15.22:0/3915604808 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f3c88107c50 con 0x7f3c6c039260 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3c6c039260 msgr2=0x7f3c6c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3c6c039260 0x7f3c6c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098c0 tx=0x7f3c74006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 msgr2=0x7f3c8819d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c8819d860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097f0 tx=0x7f3c780327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 shutdown_connections 2024-09-15T22:23:13.301 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3c6c039260 0x7f3c6c03b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.302 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 --2- 172.21.15.22:0/3915604808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c88109870 0x7f3c8819d860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.302 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 >> 172.21.15.22:0/3915604808 conn(0x7f3c8807ce30 msgr2=0x7f3c88107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:13.302 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 shutdown_connections 2024-09-15T22:23:13.302 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:12.630+0000 7f3c8d800640 1 -- 172.21.15.22:0/3915604808 wait complete. 2024-09-15T22:23:13.302 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2024-09-15T22:23:13.881 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:13 smithi022 ceph-mon[30634]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:13.881 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:13.881 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:13.881 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:15.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:15 smithi022 ceph-mon[30634]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:15.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:15.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$8.GZnhM439VD/Ph09bjyXe7aSJA/MY51mUBKLI.1bE8dsep21vZAy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726438994, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T22:23:15.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.880+0000 7ff73d400640 1 Processor -- start 2024-09-15T22:23:15.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.880+0000 7ff73d400640 1 -- start start 2024-09-15T22:23:15.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.880+0000 7ff73d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff738109e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.880+0000 7ff73d400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff73810a3d0 con 0x7ff738109a00 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.880+0000 7ff736800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff738109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.881+0000 7ff736800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff738109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37856/0 (socket says 172.21.15.22:37856) 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.881+0000 7ff736800640 1 -- 172.21.15.22:0/3393034276 learned_addr learned my addr 172.21.15.22:0/3393034276 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.881+0000 7ff736800640 1 -- 172.21.15.22:0/3393034276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73810ac00 con 0x7ff738109a00 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.882+0000 7ff736800640 1 --2- 172.21.15.22:0/3393034276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff738109e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff728009820 tx=0x7ff72802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5873c6f8d04a504e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.882+0000 7ff735400640 1 -- 172.21.15.22:0/3393034276 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff728037070 con 0x7ff738109a00 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.882+0000 7ff735400640 1 -- 172.21.15.22:0/3393034276 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff728032920 con 0x7ff738109a00 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.882+0000 7ff735400640 1 -- 172.21.15.22:0/3393034276 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff728030810 con 0x7ff738109a00 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 -- 172.21.15.22:0/3393034276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 msgr2=0x7ff738109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 --2- 172.21.15.22:0/3393034276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff738109e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff728009820 tx=0x7ff72802a270 comp rx=0 tx=0).stop 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 -- 172.21.15.22:0/3393034276 shutdown_connections 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 --2- 172.21.15.22:0/3393034276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff738109e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 -- 172.21.15.22:0/3393034276 >> 172.21.15.22:0/3393034276 conn(0x7ff73807d060 msgr2=0x7ff73807d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 -- 172.21.15.22:0/3393034276 shutdown_connections 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.883+0000 7ff73d400640 1 -- 172.21.15.22:0/3393034276 wait complete. 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.884+0000 7ff73d400640 1 Processor -- start 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff73d400640 1 -- start start 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff73d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff73819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff73d400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff73810dfb0 con 0x7ff738109a00 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff736800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff73819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff736800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff73819dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37868/0 (socket says 172.21.15.22:37868) 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff736800640 1 -- 172.21.15.22:0/3870064816 learned_addr learned my addr 172.21.15.22:0/3870064816 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.885+0000 7ff736800640 1 -- 172.21.15.22:0/3870064816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73819e020 con 0x7ff738109a00 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.886+0000 7ff736800640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff73819dae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7280097f0 tx=0x7ff7280327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.886+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff728037040 con 0x7ff738109a00 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.886+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73819e2b0 con 0x7ff738109a00 2024-09-15T22:23:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.886+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff728030c40 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.886+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72803a5b0 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.886+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7381a0fa0 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.887+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7ff72803a7f0 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.888+0000 7ff72f400640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff71c039200 0x7ff71c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.888+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff72806c8b0 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.888+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73810e130 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.888+0000 7ff735e00640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff71c039200 0x7ff71c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.889+0000 7ff735e00640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff71c039200 0x7ff71c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff7240098c0 tx=0x7ff724006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:13.893+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff728030df0 con 0x7ff738109a00 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.096+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff738109e80 con 0x7ff71c039200 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.346+0000 7ff72f400640 1 -- 172.21.15.22:0/3870064816 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff738109e80 con 0x7ff71c039200 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff71c039200 msgr2=0x7ff71c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff71c039200 0x7ff71c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff7240098c0 tx=0x7ff724006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 msgr2=0x7ff73819dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff73819dae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7280097f0 tx=0x7ff7280327b0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 shutdown_connections 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff71c039200 0x7ff71c03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 --2- 172.21.15.22:0/3870064816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff738109a00 0x7ff73819dae0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 >> 172.21.15.22:0/3870064816 conn(0x7ff73807d060 msgr2=0x7ff7381075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 shutdown_connections 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:14.348+0000 7ff73d400640 1 -- 172.21.15.22:0/3870064816 wait complete. 2024-09-15T22:23:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2024-09-15T22:23:17.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T22:23:17.042 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.239+0000 7f6911000640 1 Processor -- start 2024-09-15T22:23:17.042 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.240+0000 7f6911000640 1 -- start start 2024-09-15T22:23:17.042 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.240+0000 7f6911000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.042 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.240+0000 7f6911000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1081d0 con 0x7f690c107800 2024-09-15T22:23:17.042 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.240+0000 7f6909e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.043 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.240+0000 7f6909e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37870/0 (socket says 172.21.15.22:37870) 2024-09-15T22:23:17.043 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.240+0000 7f6909e00640 1 -- 172.21.15.22:0/1765083125 learned_addr learned my addr 172.21.15.22:0/1765083125 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.241+0000 7f6909e00640 1 -- 172.21.15.22:0/1765083125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c108a00 con 0x7f690c107800 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.242+0000 7f6909e00640 1 --2- 172.21.15.22:0/1765083125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c107c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009820 tx=0x7f68fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db4c7eb7891a979 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.242+0000 7f6909400640 1 -- 172.21.15.22:0/1765083125 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc037070 con 0x7f690c107800 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.242+0000 7f6909400640 1 -- 172.21.15.22:0/1765083125 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68fc032920 con 0x7f690c107800 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.242+0000 7f6909400640 1 -- 172.21.15.22:0/1765083125 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc030810 con 0x7f690c107800 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.242+0000 7f6911000640 1 -- 172.21.15.22:0/1765083125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 msgr2=0x7f690c107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.242+0000 7f6911000640 1 --2- 172.21.15.22:0/1765083125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c107c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009820 tx=0x7f68fc02a270 comp rx=0 tx=0).stop 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.243+0000 7f6911000640 1 -- 172.21.15.22:0/1765083125 shutdown_connections 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.243+0000 7f6911000640 1 --2- 172.21.15.22:0/1765083125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c107c00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.243+0000 7f6911000640 1 -- 172.21.15.22:0/1765083125 >> 172.21.15.22:0/1765083125 conn(0x7f690c102ff0 msgr2=0x7f690c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.243+0000 7f6911000640 1 -- 172.21.15.22:0/1765083125 shutdown_connections 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.243+0000 7f6911000640 1 -- 172.21.15.22:0/1765083125 wait complete. 2024-09-15T22:23:17.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6911000640 1 Processor -- start 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6911000640 1 -- start start 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6911000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6911000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f690c10bdb0 con 0x7f690c107800 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6909e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6909e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37880/0 (socket says 172.21.15.22:37880) 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.244+0000 7f6909e00640 1 -- 172.21.15.22:0/69924812 learned_addr learned my addr 172.21.15.22:0/69924812 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6909e00640 1 -- 172.21.15.22:0/69924812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c19bde0 con 0x7f690c107800 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6909e00640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c19b8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68fc030560 tx=0x7f68fc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc037040 con 0x7f690c107800 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68fc040070 con 0x7f690c107800 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690c19c070 con 0x7f690c107800 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc03a6d0 con 0x7f690c107800 2024-09-15T22:23:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.245+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690c19ed60 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.246+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f68fc03bb20 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.246+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690c10bf30 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.247+0000 7f6903400640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68f0039260 0x7f68f003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.247+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f68fc06c990 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.247+0000 7f6901400640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68f0039260 0x7f68f003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.248+0000 7f6901400640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68f0039260 0x7f68f003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68f40098c0 tx=0x7f68f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.252+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68fc04a200 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.348+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f68fc03a870 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.442+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f690c19ef30 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.443+0000 7f6903400640 1 -- 172.21.15.22:0/69924812 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f68fc040220 con 0x7f690c107800 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.445+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68f0039260 msgr2=0x7f68f003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.445+0000 7f6911000640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68f0039260 0x7f68f003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68f40098c0 tx=0x7f68f4006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.445+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 msgr2=0x7f690c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.445+0000 7f6911000640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c19b8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68fc030560 tx=0x7f68fc032670 comp rx=0 tx=0).stop 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.446+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 shutdown_connections 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.446+0000 7f6911000640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68f0039260 0x7f68f003b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.446+0000 7f6911000640 1 --2- 172.21.15.22:0/69924812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f690c107800 0x7f690c19b8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.446+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 >> 172.21.15.22:0/69924812 conn(0x7f690c102ff0 msgr2=0x7f690c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.446+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 shutdown_connections 2024-09-15T22:23:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:16.446+0000 7f6911000640 1 -- 172.21.15.22:0/69924812 wait complete. 2024-09-15T22:23:17.057 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:23:17.057 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-15T22:23:17.071 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:23:17.071 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-15T22:23:17.071 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-15T22:23:17.071 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T22:23:17.073 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2024-09-15T22:23:17.073 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:17.073 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022.front.sepia.ceph.com:8443/ 2024-09-15T22:23:17.074 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2024-09-15T22:23:17.074 INFO:teuthology.orchestra.run.smithi022.stdout: Password: ztnpmwie4y 2024-09-15T22:23:17.074 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:17.074 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config directory 2024-09-15T22:23:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:17 smithi022 ceph-mon[30634]: mgrmap e13: x(active, since 6s) 2024-09-15T22:23:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:17 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/69924812' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T22:23:18.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.560+0000 7f75e9800640 1 Processor -- start 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.560+0000 7f75e9800640 1 -- start start 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.561+0000 7f75e9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e4107a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.561+0000 7f75e9800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f75e4108040 con 0x7f75e4107670 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.561+0000 7f75e3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e4107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.561+0000 7f75e3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e4107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37884/0 (socket says 172.21.15.22:37884) 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.561+0000 7f75e3e00640 1 -- 172.21.15.22:0/2358121495 learned_addr learned my addr 172.21.15.22:0/2358121495 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.561+0000 7f75e3e00640 1 -- 172.21.15.22:0/2358121495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e4108820 con 0x7f75e4107670 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.562+0000 7f75e3e00640 1 --2- 172.21.15.22:0/2358121495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e4107a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009e80 tx=0x7f75d402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6203f83c5f693a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.562+0000 7f75e3400640 1 -- 172.21.15.22:0/2358121495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4036070 con 0x7f75e4107670 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e3400640 1 -- 172.21.15.22:0/2358121495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d40318e0 con 0x7f75e4107670 2024-09-15T22:23:18.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e3400640 1 -- 172.21.15.22:0/2358121495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4007a00 con 0x7f75e4107670 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 -- 172.21.15.22:0/2358121495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 msgr2=0x7f75e4107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 --2- 172.21.15.22:0/2358121495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e4107a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009e80 tx=0x7f75d402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 -- 172.21.15.22:0/2358121495 shutdown_connections 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 --2- 172.21.15.22:0/2358121495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e4107a70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 -- 172.21.15.22:0/2358121495 >> 172.21.15.22:0/2358121495 conn(0x7f75e4102e20 msgr2=0x7f75e4105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 -- 172.21.15.22:0/2358121495 shutdown_connections 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.563+0000 7f75e9800640 1 -- 172.21.15.22:0/2358121495 wait complete. 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.564+0000 7f75e9800640 1 Processor -- start 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.564+0000 7f75e9800640 1 -- start start 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.565+0000 7f75e9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e419d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.565+0000 7f75e9800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f75e410bbd0 con 0x7f75e4107670 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.565+0000 7f75e3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e419d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.565+0000 7f75e3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e419d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37888/0 (socket says 172.21.15.22:37888) 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.565+0000 7f75e3e00640 1 -- 172.21.15.22:0/3683516813 learned_addr learned my addr 172.21.15.22:0/3683516813 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:18.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.565+0000 7f75e3e00640 1 -- 172.21.15.22:0/3683516813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e419de00 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.566+0000 7f75e3e00640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e419d8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75d402acc0 tx=0x7f75d4031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.566+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4036050 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.566+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d4037040 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.566+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e419e090 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.566+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d403b890 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.566+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e41a0d80 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.567+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e410bd50 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.567+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f75d4044020 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.568+0000 7f75e1600640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f75c80392a0 0x7f75c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.568+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f75d4042020 con 0x7f75e4107670 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.568+0000 7f75db400640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f75c80392a0 0x7f75c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.569+0000 7f75db400640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f75c80392a0 0x7f75c803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0098c0 tx=0x7f75cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:18.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.572+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75d404b020 con 0x7f75e4107670 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.850+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f75e41a0f50 con 0x7f75e4107670 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.853+0000 7f75e1600640 1 -- 172.21.15.22:0/3683516813 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f75d4039900 con 0x7f75e4107670 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f75c80392a0 msgr2=0x7f75c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f75c80392a0 0x7f75c803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0098c0 tx=0x7f75cc006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 msgr2=0x7f75e419d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e419d8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75d402acc0 tx=0x7f75d4031cc0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 shutdown_connections 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f75c80392a0 0x7f75c803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 --2- 172.21.15.22:0/3683516813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75e4107670 0x7f75e419d8c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.855+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 >> 172.21.15.22:0/3683516813 conn(0x7f75e4102e20 msgr2=0x7f75e4103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.856+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 shutdown_connections 2024-09-15T22:23:18.477 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-15T22:23:17.856+0000 7f75e9800640 1 -- 172.21.15.22:0/3683516813 wait complete. 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2024-09-15T22:23:18.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.479 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T22:23:18.479 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:18.479 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2024-09-15T22:23:18.529 INFO:tasks.cephadm:Fetching config... 2024-09-15T22:23:18.529 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:23:18.529 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T22:23:18.566 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T22:23:18.566 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:23:18.566 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T22:23:18.644 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T22:23:18.644 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:23:18.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T22:23:18.740 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T22:23:18.740 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:23:18.741 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T22:23:18.816 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T22:23:18.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:23:18.959 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:18.975 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:18 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3683516813' entity='client.admin' 2024-09-15T22:23:18.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:23:19.024 INFO:teuthology.orchestra.run.smithi110.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:19.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:23:19.080 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTYFM5SvXdjN65q6UlPycof42weLr4ZdRCljrkHzi2J65fkRaHEKGt8YCFZ301xZQHJmLU0tL+ispzuvvf6UF/Cx/wy4t2eWMkn7W5rjM5K/I2I5/7q/zPWfkTFANhw0Qpej9Dc1B18xkuTaoRHZ3Qqs+nf1yhMQFCmKsJXdD5Eu3PHGQLepiQt6YIgQKlWI6dDk1W/4OjzcZFh0gOSqVJG4Yla6xI4AL2e+a9Z5ofkvCfPFtK8fM6diEo6mWyHmrViZT3az8B3yyn/UhTH8AugkkuAXpjKCv7xqwNT71MsmQOEanXAexSdJoCX52CmFUAiPVdiBTZEIFxCxDmAs/OmhFg6CUTRnKjC0t7fw4/CsLf8Y3sNRMV6P0H/enKMJT3CgDfEH0soq3j4vP0PHPdwfY5+enjD4Y1hzQEEqyTg15azD6AfZ20He4uSKHTJF+IMliOHd69PTN1VrmS273BgCLEBr3lu1aT4AZM5HIfVYUghH9PZciKuEsV4lx1Xsc= ceph-d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:19.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T22:23:19.461 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 -- 172.21.15.22:0/108907056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 msgr2=0x7f2948103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 --2- 172.21.15.22:0/108907056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948103bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2938009880 tx=0x7f293802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 -- 172.21.15.22:0/108907056 shutdown_connections 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 --2- 172.21.15.22:0/108907056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948103bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 -- 172.21.15.22:0/108907056 >> 172.21.15.22:0/108907056 conn(0x7f29480fefc0 msgr2=0x7f2948101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 -- 172.21.15.22:0/108907056 shutdown_connections 2024-09-15T22:23:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.995+0000 7f294f000640 1 -- 172.21.15.22:0/108907056 wait complete. 2024-09-15T22:23:19.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.996+0000 7f294f000640 1 Processor -- start 2024-09-15T22:23:19.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.997+0000 7f294f000640 1 -- start start 2024-09-15T22:23:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.997+0000 7f294f000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.997+0000 7f294f000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2948109900 con 0x7f29481037f0 2024-09-15T22:23:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.997+0000 7f2947e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.997+0000 7f2947e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44594/0 (socket says 172.21.15.22:44594) 2024-09-15T22:23:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.997+0000 7f2947e00640 1 -- 172.21.15.22:0/1346433350 learned_addr learned my addr 172.21.15.22:0/1346433350 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.998+0000 7f2947e00640 1 -- 172.21.15.22:0/1346433350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2948199470 con 0x7f29481037f0 2024-09-15T22:23:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.998+0000 7f2947e00640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948198f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2938004f60 tx=0x7f29380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.998+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f293803f070 con 0x7f29481037f0 2024-09-15T22:23:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.998+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2938004cc0 con 0x7f29481037f0 2024-09-15T22:23:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.998+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938035030 con 0x7f29481037f0 2024-09-15T22:23:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.998+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2948199700 con 0x7f29481037f0 2024-09-15T22:23:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:19.999+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294819c3f0 con 0x7f29481037f0 2024-09-15T22:23:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.000+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2938042070 con 0x7f29481037f0 2024-09-15T22:23:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.000+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294810a080 con 0x7f29481037f0 2024-09-15T22:23:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.000+0000 7f2945600640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f292c039300 0x7f292c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.000+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f293806d000 con 0x7f29481037f0 2024-09-15T22:23:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.001+0000 7f293fe00640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f292c039300 0x7f292c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.001+0000 7f293fe00640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f292c039300 0x7f292c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f29300098c0 tx=0x7f2930006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:20.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.005+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2938040260 con 0x7f29481037f0 2024-09-15T22:23:20.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.201+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f294802d830 con 0x7f29481037f0 2024-09-15T22:23:20.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.204+0000 7f2945600640 1 -- 172.21.15.22:0/1346433350 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2938003dd0 con 0x7f29481037f0 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.206+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f292c039300 msgr2=0x7f292c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.206+0000 7f294f000640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f292c039300 0x7f292c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f29300098c0 tx=0x7f2930006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.206+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 msgr2=0x7f2948198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.206+0000 7f294f000640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948198f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2938004f60 tx=0x7f29380048f0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.206+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 shutdown_connections 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.206+0000 7f294f000640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f292c039300 0x7f292c03b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.207+0000 7f294f000640 1 --2- 172.21.15.22:0/1346433350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29481037f0 0x7f2948198f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.207+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 >> 172.21.15.22:0/1346433350 conn(0x7f29480fefc0 msgr2=0x7f29480ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.207+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 shutdown_connections 2024-09-15T22:23:20.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:20.207+0000 7f294f000640 1 -- 172.21.15.22:0/1346433350 wait complete. 2024-09-15T22:23:21.039 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T22:23:21.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T22:23:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:21 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1346433350' entity='client.admin' 2024-09-15T22:23:21.468 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:22.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 -- 172.21.15.22:0/890565579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 msgr2=0x7f2760103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 --2- 172.21.15.22:0/890565579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760103bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2750009880 tx=0x7f275002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 -- 172.21.15.22:0/890565579 shutdown_connections 2024-09-15T22:23:22.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 --2- 172.21.15.22:0/890565579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760103bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 -- 172.21.15.22:0/890565579 >> 172.21.15.22:0/890565579 conn(0x7f27600fefc0 msgr2=0x7f2760101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 -- 172.21.15.22:0/890565579 shutdown_connections 2024-09-15T22:23:22.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.217+0000 7f2764c00640 1 -- 172.21.15.22:0/890565579 wait complete. 2024-09-15T22:23:22.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f2764c00640 1 Processor -- start 2024-09-15T22:23:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f2764c00640 1 -- start start 2024-09-15T22:23:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f2764c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f2764c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2760109900 con 0x7f27601037f0 2024-09-15T22:23:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f275de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f275de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44604/0 (socket says 172.21.15.22:44604) 2024-09-15T22:23:22.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.218+0000 7f275de00640 1 -- 172.21.15.22:0/3864305824 learned_addr learned my addr 172.21.15.22:0/3864305824 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.219+0000 7f275de00640 1 -- 172.21.15.22:0/3864305824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27601994b0 con 0x7f27601037f0 2024-09-15T22:23:22.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.219+0000 7f275de00640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760198f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2750004f60 tx=0x7f27500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.219+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f275003f070 con 0x7f27601037f0 2024-09-15T22:23:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.219+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2750004cc0 con 0x7f27601037f0 2024-09-15T22:23:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.219+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2750035030 con 0x7f27601037f0 2024-09-15T22:23:22.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.219+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2760199740 con 0x7f27601037f0 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.220+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276019c430 con 0x7f27601037f0 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.221+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2750042070 con 0x7f27601037f0 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.221+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276010a080 con 0x7f27601037f0 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.221+0000 7f2757400640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2744039300 0x7f274403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.221+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f275006d0c0 con 0x7f27601037f0 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.222+0000 7f2755400640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2744039300 0x7f274403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.222+0000 7f2755400640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2744039300 0x7f274403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f27480098c0 tx=0x7f2748006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.226+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2750040260 con 0x7f27601037f0 2024-09-15T22:23:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.418+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f276002d860 con 0x7f2744039300 2024-09-15T22:23:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.422+0000 7f2757400640 1 -- 172.21.15.22:0/3864305824 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f276002d860 con 0x7f2744039300 2024-09-15T22:23:22.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2744039300 msgr2=0x7f274403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2744039300 0x7f274403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f27480098c0 tx=0x7f2748006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 msgr2=0x7f2760198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760198f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2750004f60 tx=0x7f27500048f0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 shutdown_connections 2024-09-15T22:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2744039300 0x7f274403b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 --2- 172.21.15.22:0/3864305824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27601037f0 0x7f2760198f70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 >> 172.21.15.22:0/3864305824 conn(0x7f27600fefc0 msgr2=0x7f27600ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 shutdown_connections 2024-09-15T22:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:22.424+0000 7f2764c00640 1 -- 172.21.15.22:0/3864305824 wait complete. 2024-09-15T22:23:23.119 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi110 2024-09-15T22:23:23.119 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:23:23.120 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:23:23.138 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:23:23.138 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:23.198 INFO:tasks.cephadm:Adding host smithi110 to orchestrator... 2024-09-15T22:23:23.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch host add smithi110 2024-09-15T22:23:23.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:23 smithi022 ceph-mon[30634]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:23.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:24.088 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 -- 172.21.15.22:0/1246917655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 msgr2=0x7fe0b0101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 --2- 172.21.15.22:0/1246917655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0101a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009880 tx=0x7fe0a002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 -- 172.21.15.22:0/1246917655 shutdown_connections 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 --2- 172.21.15.22:0/1246917655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0101a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 -- 172.21.15.22:0/1246917655 >> 172.21.15.22:0/1246917655 conn(0x7fe0b00fcdb0 msgr2=0x7fe0b00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 -- 172.21.15.22:0/1246917655 shutdown_connections 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.705+0000 7fe0b5600640 1 -- 172.21.15.22:0/1246917655 wait complete. 2024-09-15T22:23:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.706+0000 7fe0b5600640 1 Processor -- start 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.706+0000 7fe0b5600640 1 -- start start 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0b5600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0b5600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0107710 con 0x7fe0b0101600 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0aea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0aea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44614/0 (socket says 172.21.15.22:44614) 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0aea00640 1 -- 172.21.15.22:0/4130294714 learned_addr learned my addr 172.21.15.22:0/4130294714 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0aea00640 1 -- 172.21.15.22:0/4130294714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b0199510 con 0x7fe0b0101600 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.707+0000 7fe0aea00640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0198fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0004f60 tx=0x7fe0a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.708+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a003f070 con 0x7fe0b0101600 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.708+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a0004cc0 con 0x7fe0b0101600 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.708+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a0035030 con 0x7fe0b0101600 2024-09-15T22:23:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.708+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b01997a0 con 0x7fe0b0101600 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.708+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b019c490 con 0x7fe0b0101600 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.709+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe0a0042070 con 0x7fe0b0101600 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.709+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b0107e90 con 0x7fe0b0101600 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.709+0000 7fe0a7400640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe094039300 0x7fe09403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.710+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe0a006d170 con 0x7fe0b0101600 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.710+0000 7fe0ae000640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe094039300 0x7fe09403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.711+0000 7fe0ae000640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe094039300 0x7fe09403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0098c0 tx=0x7fe09c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.717+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0a003be20 con 0x7fe0b0101600 2024-09-15T22:23:24.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:24.925+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi110", "target": ["mon-mgr", ""]}) -- 0x7fe0b002d830 con 0x7fe094039300 2024-09-15T22:23:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:23:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:25 smithi022 ceph-mon[30634]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-15T22:23:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:26 smithi022 ceph-mon[30634]: Updating smithi022:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:26 smithi022 ceph-mon[30634]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:26 smithi022 ceph-mon[30634]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: Updating smithi022:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:27.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:27.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:27.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:27.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:27.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:27 smithi022 ceph-mon[30634]: Deploying cephadm binary to smithi110 2024-09-15T22:23:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi110' with addr '172.21.15.110' 2024-09-15T22:23:28.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.969+0000 7fe0a7400640 1 -- 172.21.15.22:0/4130294714 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe0b002d830 con 0x7fe094039300 2024-09-15T22:23:28.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe094039300 msgr2=0x7fe09403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:28.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe094039300 0x7fe09403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0098c0 tx=0x7fe09c006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 msgr2=0x7fe0b0198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0198fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0004f60 tx=0x7fe0a00048f0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 shutdown_connections 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe094039300 0x7fe09403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 --2- 172.21.15.22:0/4130294714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0b0101600 0x7fe0b0198fd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 >> 172.21.15.22:0/4130294714 conn(0x7fe0b00fcdb0 msgr2=0x7fe0b00ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.972+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 shutdown_connections 2024-09-15T22:23:28.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:28.973+0000 7fe0b5600640 1 -- 172.21.15.22:0/4130294714 wait complete. 2024-09-15T22:23:29.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:23:30.028 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:30.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:30.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:29 smithi022 ceph-mon[30634]: Added host smithi110 2024-09-15T22:23:30.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:30.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:30.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 -- 172.21.15.22:0/184805928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 msgr2=0x7fee80074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 --2- 172.21.15.22:0/184805928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee80074a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee70009880 tx=0x7fee7002a670 comp rx=0 tx=0).stop 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 -- 172.21.15.22:0/184805928 shutdown_connections 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 --2- 172.21.15.22:0/184805928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee80074a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 -- 172.21.15.22:0/184805928 >> 172.21.15.22:0/184805928 conn(0x7fee800fd290 msgr2=0x7fee800ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 -- 172.21.15.22:0/184805928 shutdown_connections 2024-09-15T22:23:30.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.560+0000 7fee84e00640 1 -- 172.21.15.22:0/184805928 wait complete. 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.561+0000 7fee84e00640 1 Processor -- start 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.561+0000 7fee84e00640 1 -- start start 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.562+0000 7fee84e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee801993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.562+0000 7fee84e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee8010dec0 con 0x7fee80074620 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.562+0000 7fee7de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee801993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.562+0000 7fee7de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee801993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36118/0 (socket says 172.21.15.22:36118) 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.562+0000 7fee7de00640 1 -- 172.21.15.22:0/2558764579 learned_addr learned my addr 172.21.15.22:0/2558764579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:30.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.562+0000 7fee7de00640 1 -- 172.21.15.22:0/2558764579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80199900 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.563+0000 7fee7de00640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee801993c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee70009230 tx=0x7fee70003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.563+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7003f070 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.563+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee7003bd40 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.563+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee70035030 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.563+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee80199b90 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.563+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee80199ff0 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.564+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fee70042070 con 0x7fee80074620 2024-09-15T22:23:30.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.564+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee80075cd0 con 0x7fee80074620 2024-09-15T22:23:30.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.565+0000 7fee76a00640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fee64039300 0x7fee6403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:30.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.565+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fee7006cfc0 con 0x7fee80074620 2024-09-15T22:23:30.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.565+0000 7fee7d400640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fee64039300 0x7fee6403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:30.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.565+0000 7fee7d400640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fee64039300 0x7fee6403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0098c0 tx=0x7fee6c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:30.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.570+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee700412c0 con 0x7fee80074620 2024-09-15T22:23:30.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.761+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee8019a780 con 0x7fee64039300 2024-09-15T22:23:30.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.762+0000 7fee76a00640 1 -- 172.21.15.22:0/2558764579 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fee8019a780 con 0x7fee64039300 2024-09-15T22:23:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:30.764 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}] 2024-09-15T22:23:30.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.764+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fee64039300 msgr2=0x7fee6403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.764+0000 7fee84e00640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fee64039300 0x7fee6403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0098c0 tx=0x7fee6c006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.764+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 msgr2=0x7fee801993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.764+0000 7fee84e00640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee801993c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee70009230 tx=0x7fee70003d80 comp rx=0 tx=0).stop 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.765+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 shutdown_connections 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.765+0000 7fee84e00640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fee64039300 0x7fee6403b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.765+0000 7fee84e00640 1 --2- 172.21.15.22:0/2558764579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee80074620 0x7fee801993c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.765+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 >> 172.21.15.22:0/2558764579 conn(0x7fee800fd290 msgr2=0x7fee80105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.765+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 shutdown_connections 2024-09-15T22:23:30.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:30.765+0000 7fee84e00640 1 -- 172.21.15.22:0/2558764579 wait complete. 2024-09-15T22:23:31.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:31 smithi022 ceph-mon[30634]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:31.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:31 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:31.505 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2024-09-15T22:23:31.505 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:23:31.506 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:23:31.525 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:23:31.525 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:31.583 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2024-09-15T22:23:31.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch host add smithi112 2024-09-15T22:23:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:32.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:32 smithi022 ceph-mon[30634]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 -- 172.21.15.22:0/1146594907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 msgr2=0x7f05c8109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 --2- 172.21.15.22:0/1146594907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c8109b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009880 tx=0x7f05b802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 -- 172.21.15.22:0/1146594907 shutdown_connections 2024-09-15T22:23:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 --2- 172.21.15.22:0/1146594907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c8109b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 -- 172.21.15.22:0/1146594907 >> 172.21.15.22:0/1146594907 conn(0x7f05c80ff450 msgr2=0x7f05c8101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 -- 172.21.15.22:0/1146594907 shutdown_connections 2024-09-15T22:23:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.500+0000 7f05cd200640 1 -- 172.21.15.22:0/1146594907 wait complete. 2024-09-15T22:23:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.501+0000 7f05cd200640 1 Processor -- start 2024-09-15T22:23:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.501+0000 7f05cd200640 1 -- start start 2024-09-15T22:23:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.501+0000 7f05cd200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.501+0000 7f05cd200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f05c810de30 con 0x7f05c8109770 2024-09-15T22:23:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.502+0000 7f05c5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.502+0000 7f05c5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c81993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36132/0 (socket says 172.21.15.22:36132) 2024-09-15T22:23:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.502+0000 7f05c5e00640 1 -- 172.21.15.22:0/1234515209 learned_addr learned my addr 172.21.15.22:0/1234515209 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.502+0000 7f05c5e00640 1 -- 172.21.15.22:0/1234515209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c81998e0 con 0x7f05c8109770 2024-09-15T22:23:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.502+0000 7f05c5e00640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c81993a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009230 tx=0x7f05b8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.503+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b803f070 con 0x7f05c8109770 2024-09-15T22:23:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.503+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05b803bd40 con 0x7f05c8109770 2024-09-15T22:23:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.503+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c8199bd0 con 0x7f05c8109770 2024-09-15T22:23:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.503+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8035030 con 0x7f05c8109770 2024-09-15T22:23:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.503+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c819dc70 con 0x7f05c8109770 2024-09-15T22:23:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.504+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f05b8042070 con 0x7f05c8109770 2024-09-15T22:23:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.504+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c8104eb0 con 0x7f05c8109770 2024-09-15T22:23:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.504+0000 7f05bea00640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f05ac0392a0 0x7f05ac03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.504+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f05b806cfb0 con 0x7f05c8109770 2024-09-15T22:23:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.505+0000 7f05bfe00640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f05ac0392a0 0x7f05ac03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.505+0000 7f05bfe00640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f05ac0392a0 0x7f05ac03b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f05b00098c0 tx=0x7f05b0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:32.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.510+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05b8030d60 con 0x7f05c8109770 2024-09-15T22:23:32.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:32.702+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}) -- 0x7f05c8109c30 con 0x7f05ac0392a0 2024-09-15T22:23:33.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:33.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:33.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:33.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:33.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:33.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:23:33.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:33.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:34.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:34 smithi022 ceph-mon[30634]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:34.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:34 smithi022 ceph-mon[30634]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-15T22:23:34.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:34 smithi022 ceph-mon[30634]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:35 smithi022 ceph-mon[30634]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:35 smithi022 ceph-mon[30634]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:35 smithi022 ceph-mon[30634]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:35 smithi022 ceph-mon[30634]: Deploying cephadm binary to smithi112 2024-09-15T22:23:36.637 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi112' with addr '172.21.15.112' 2024-09-15T22:23:36.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.635+0000 7f05bea00640 1 -- 172.21.15.22:0/1234515209 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f05c8109c30 con 0x7f05ac0392a0 2024-09-15T22:23:36.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.637+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f05ac0392a0 msgr2=0x7f05ac03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.637+0000 7f05cd200640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f05ac0392a0 0x7f05ac03b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f05b00098c0 tx=0x7f05b0006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.637+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 msgr2=0x7f05c81993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.637+0000 7f05cd200640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c81993a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009230 tx=0x7f05b8003d80 comp rx=0 tx=0).stop 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.638+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 shutdown_connections 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.638+0000 7f05cd200640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f05ac0392a0 0x7f05ac03b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.638+0000 7f05cd200640 1 --2- 172.21.15.22:0/1234515209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05c8109770 0x7f05c81993a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.638+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 >> 172.21.15.22:0/1234515209 conn(0x7f05c80ff450 msgr2=0x7f05c8107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.638+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 shutdown_connections 2024-09-15T22:23:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:36.638+0000 7f05cd200640 1 -- 172.21.15.22:0/1234515209 wait complete. 2024-09-15T22:23:37.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:23:37.736 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:37 smithi022 ceph-mon[30634]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 -- 172.21.15.22:0/1293294165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 msgr2=0x7f3280109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 --2- 172.21.15.22:0/1293294165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f3280109b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3270009880 tx=0x7f327002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 -- 172.21.15.22:0/1293294165 shutdown_connections 2024-09-15T22:23:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 --2- 172.21.15.22:0/1293294165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f3280109b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 -- 172.21.15.22:0/1293294165 >> 172.21.15.22:0/1293294165 conn(0x7f32800ff450 msgr2=0x7f3280101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 -- 172.21.15.22:0/1293294165 shutdown_connections 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.241+0000 7f3286400640 1 -- 172.21.15.22:0/1293294165 wait complete. 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f3286400640 1 Processor -- start 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f3286400640 1 -- start start 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f3286400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f32801993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f3286400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f328010de30 con 0x7f3280109770 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f327f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f32801993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f327f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f32801993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36156/0 (socket says 172.21.15.22:36156) 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.242+0000 7f327f400640 1 -- 172.21.15.22:0/3038500986 learned_addr learned my addr 172.21.15.22:0/3038500986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f327f400640 1 -- 172.21.15.22:0/3038500986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32801998e0 con 0x7f3280109770 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f327f400640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f32801993a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3270009230 tx=0x7f3270003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:38.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f327003f070 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3280199bd0 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f327003bd40 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3270035030 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.243+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328019dc70 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.245+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3270042070 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.245+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3280104eb0 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.245+0000 7f3277e00640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32640392a0 0x7f326403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.245+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f327006cb40 con 0x7f3280109770 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.245+0000 7f327ea00640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32640392a0 0x7f326403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.246+0000 7f327ea00640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32640392a0 0x7f326403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f326c0098c0 tx=0x7f326c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.250+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3270044e10 con 0x7f3280109770 2024-09-15T22:23:38.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.441+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3280109c30 con 0x7f32640392a0 2024-09-15T22:23:38.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:38 smithi022 ceph-mon[30634]: Added host smithi112 2024-09-15T22:23:38.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:38.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.442+0000 7f3277e00640 1 -- 172.21.15.22:0/3038500986 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f3280109c30 con 0x7f32640392a0 2024-09-15T22:23:38.444 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:23:38.444 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2024-09-15T22:23:38.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32640392a0 msgr2=0x7f326403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32640392a0 0x7f326403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f326c0098c0 tx=0x7f326c006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 msgr2=0x7f32801993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f32801993a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3270009230 tx=0x7f3270003d80 comp rx=0 tx=0).stop 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 shutdown_connections 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32640392a0 0x7f326403b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 --2- 172.21.15.22:0/3038500986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3280109770 0x7f32801993a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.444+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 >> 172.21.15.22:0/3038500986 conn(0x7f32800ff450 msgr2=0x7f3280107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.445+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 shutdown_connections 2024-09-15T22:23:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:38.445+0000 7f3286400640 1 -- 172.21.15.22:0/3038500986 wait complete. 2024-09-15T22:23:39.114 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T22:23:39.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T22:23:39.488 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:39.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:39 smithi022 ceph-mon[30634]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:40.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 -- 172.21.15.22:0/582399559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 msgr2=0x7fefd01019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 --2- 172.21.15.22:0/582399559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd01019f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009880 tx=0x7fefc002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 -- 172.21.15.22:0/582399559 shutdown_connections 2024-09-15T22:23:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 --2- 172.21.15.22:0/582399559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd01019f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 -- 172.21.15.22:0/582399559 >> 172.21.15.22:0/582399559 conn(0x7fefd00fd0b0 msgr2=0x7fefd00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 -- 172.21.15.22:0/582399559 shutdown_connections 2024-09-15T22:23:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.008+0000 7fefd5800640 1 -- 172.21.15.22:0/582399559 wait complete. 2024-09-15T22:23:40.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.010+0000 7fefd5800640 1 Processor -- start 2024-09-15T22:23:40.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.010+0000 7fefd5800640 1 -- start start 2024-09-15T22:23:40.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.010+0000 7fefd5800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.011+0000 7fefd5800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fefd010ba60 con 0x7fefd0101610 2024-09-15T22:23:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.011+0000 7fefcfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.011+0000 7fefcfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd0199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60700/0 (socket says 172.21.15.22:60700) 2024-09-15T22:23:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.011+0000 7fefcfe00640 1 -- 172.21.15.22:0/4108629328 learned_addr learned my addr 172.21.15.22:0/4108629328 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:23:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.011+0000 7fefcfe00640 1 -- 172.21.15.22:0/4108629328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd01996b0 con 0x7fefd0101610 2024-09-15T22:23:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.012+0000 7fefcfe00640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd0199170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009230 tx=0x7fefc0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.012+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc003f070 con 0x7fefd0101610 2024-09-15T22:23:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.012+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc003bc80 con 0x7fefd0101610 2024-09-15T22:23:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.012+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd01999a0 con 0x7fefd0101610 2024-09-15T22:23:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.012+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc0035030 con 0x7fefd0101610 2024-09-15T22:23:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.012+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd019da40 con 0x7fefd0101610 2024-09-15T22:23:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.013+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fefc0042070 con 0x7fefd0101610 2024-09-15T22:23:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.013+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd0102af0 con 0x7fefd0101610 2024-09-15T22:23:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.014+0000 7fefccc00640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fefb4039300 0x7fefb403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.014+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fefc006d020 con 0x7fefd0101610 2024-09-15T22:23:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.014+0000 7fefcf400640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fefb4039300 0x7fefb403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.015+0000 7fefcf400640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fefb4039300 0x7fefb403b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0098c0 tx=0x7fefbc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:40.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.018+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fefc00314c0 con 0x7fefd0101610 2024-09-15T22:23:40.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.207+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fefd019a4d0 con 0x7fefd0101610 2024-09-15T22:23:40.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.329+0000 7fefccc00640 1 -- 172.21.15.22:0/4108629328 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fefc003a8e0 con 0x7fefd0101610 2024-09-15T22:23:40.332 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-09-15T22:23:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fefb4039300 msgr2=0x7fefb403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fefb4039300 0x7fefb403b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0098c0 tx=0x7fefbc006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 msgr2=0x7fefd0199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd0199170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009230 tx=0x7fefc0003d40 comp rx=0 tx=0).stop 2024-09-15T22:23:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 shutdown_connections 2024-09-15T22:23:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fefb4039300 0x7fefb403b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 --2- 172.21.15.22:0/4108629328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefd0101610 0x7fefd0199170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:40.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 >> 172.21.15.22:0/4108629328 conn(0x7fefd00fd0b0 msgr2=0x7fefd0075f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:40.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 shutdown_connections 2024-09-15T22:23:40.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:23:40.332+0000 7fefd5800640 1 -- 172.21.15.22:0/4108629328 wait complete. 2024-09-15T22:23:40.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:40 smithi022 ceph-mon[30634]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:40.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:40 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/4108629328' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:23:41.051 INFO:tasks.cephadm:Adding mon.a on smithi022 2024-09-15T22:23:41.051 INFO:tasks.cephadm:Adding mon.b on smithi110 2024-09-15T22:23:41.051 INFO:tasks.cephadm:Adding mon.c on smithi112 2024-09-15T22:23:41.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c' 2024-09-15T22:23:41.296 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/4108629328' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:23:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:23:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:41.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:41.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:41.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:23:41.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:41.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 -- 172.21.15.112:0/2082941716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 msgr2=0x7faa8c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 --2- 172.21.15.112:0/2082941716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c106940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa88009880 tx=0x7faa8802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 -- 172.21.15.112:0/2082941716 shutdown_connections 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 --2- 172.21.15.112:0/2082941716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c106940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 -- 172.21.15.112:0/2082941716 >> 172.21.15.112:0/2082941716 conn(0x7faa8c0fc1b0 msgr2=0x7faa8c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 -- 172.21.15.112:0/2082941716 shutdown_connections 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.774+0000 7faa93a14640 1 -- 172.21.15.112:0/2082941716 wait complete. 2024-09-15T22:23:41.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa93a14640 1 Processor -- start 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa93a14640 1 -- start start 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa93a14640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa93a14640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c10ab90 con 0x7faa8c106560 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa917b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa917b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.112:42546/0 (socket says 172.21.15.112:42546) 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.775+0000 7faa917b0640 1 -- 172.21.15.112:0/1713496692 learned_addr learned my addr 172.21.15.112:0/1713496692 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa917b0640 1 -- 172.21.15.112:0/1713496692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c0fe550 con 0x7faa8c106560 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa917b0640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c0fc660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa88009230 tx=0x7faa88003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa8803f070 con 0x7faa8c106560 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa8803bd40 con 0x7faa8c106560 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c0fcba0 con 0x7faa8c106560 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa88035030 con 0x7faa8c106560 2024-09-15T22:23:41.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.776+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c0fd060 con 0x7faa8c106560 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.777+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7faa88042070 con 0x7faa8c106560 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.777+0000 7faa7e7fc640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa780392a0 0x7faa7803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.777+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c101bd0 con 0x7faa8c106560 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.777+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7faa8806d240 con 0x7faa8c106560 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.777+0000 7faa90faf640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa780392a0 0x7faa7803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.778+0000 7faa90faf640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa780392a0 0x7faa7803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa800098c0 tx=0x7faa80006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:41.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.783+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa88000ed0 con 0x7faa8c106560 2024-09-15T22:23:41.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.958+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}) -- 0x7faa8c0fd290 con 0x7faa780392a0 2024-09-15T22:23:41.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.963+0000 7faa7e7fc640 1 -- 172.21.15.112:0/1713496692 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7faa8c0fd290 con 0x7faa780392a0 2024-09-15T22:23:41.966 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mon update... 2024-09-15T22:23:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa780392a0 msgr2=0x7faa7803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa780392a0 0x7faa7803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa800098c0 tx=0x7faa80006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 msgr2=0x7faa8c0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c0fc660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa88009230 tx=0x7faa88003d80 comp rx=0 tx=0).stop 2024-09-15T22:23:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 shutdown_connections 2024-09-15T22:23:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa780392a0 0x7faa7803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 --2- 172.21.15.112:0/1713496692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa8c106560 0x7faa8c0fc660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.965+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 >> 172.21.15.112:0/1713496692 conn(0x7faa8c0fc1b0 msgr2=0x7faa8c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.966+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 shutdown_connections 2024-09-15T22:23:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:41.966+0000 7faa93a14640 1 -- 172.21.15.112:0/1713496692 wait complete. 2024-09-15T22:23:42.598 DEBUG:teuthology.orchestra.run.smithi110:mon.b> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T22:23:42.601 DEBUG:teuthology.orchestra.run.smithi112:mon.c> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T22:23:42.604 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:23:42.604 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:23:42.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T22:23:42.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:23:42.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:43.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:43 smithi022 ceph-mon[30634]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:43.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:43 smithi022 ceph-mon[30634]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:43.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:43 smithi022 ceph-mon[30634]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c;count:3 2024-09-15T22:23:43.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:43 smithi022 ceph-mon[30634]: Deploying daemon mon.c on smithi112 2024-09-15T22:23:44.493 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:23:45.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 -- 172.21.15.112:0/3717644131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 msgr2=0x7f5578102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 --2- 172.21.15.112:0/3717644131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f5578102c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5568009880 tx=0x7f556802a670 comp rx=0 tx=0).stop 2024-09-15T22:23:45.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 -- 172.21.15.112:0/3717644131 shutdown_connections 2024-09-15T22:23:45.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 --2- 172.21.15.112:0/3717644131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f5578102c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 -- 172.21.15.112:0/3717644131 >> 172.21.15.112:0/3717644131 conn(0x7f55780fc280 msgr2=0x7f55780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 -- 172.21.15.112:0/3717644131 shutdown_connections 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.077+0000 7f557d9ca640 1 -- 172.21.15.112:0/3717644131 wait complete. 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.078+0000 7f557d9ca640 1 Processor -- start 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.078+0000 7f557d9ca640 1 -- start start 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.078+0000 7f557d9ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f55781972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.078+0000 7f557d9ca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f557810bdb0 con 0x7f5578102840 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.079+0000 7f5576ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f55781972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.079+0000 7f5576ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f55781972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.112:42554/0 (socket says 172.21.15.112:42554) 2024-09-15T22:23:45.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.079+0000 7f5576ffd640 1 -- 172.21.15.112:0/1787253588 learned_addr learned my addr 172.21.15.112:0/1787253588 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.079+0000 7f5576ffd640 1 -- 172.21.15.112:0/1787253588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55781977e0 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.079+0000 7f5576ffd640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f55781972a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5568009230 tx=0x7f5568003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.079+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f556803f070 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.080+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f556803bc80 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.080+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5578197a70 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.080+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5568035030 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.080+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5578197ed0 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.081+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f557806a4f0 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.081+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5568042070 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.081+0000 7f557c9c8640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f55600392a0 0x7f556003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.081+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f556806d030 con 0x7f5578102840 2024-09-15T22:23:45.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.081+0000 7f55767fc640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f55600392a0 0x7f556003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:45.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.082+0000 7f55767fc640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f55600392a0 0x7f556003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f556c0098c0 tx=0x7f556c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:45.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.086+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55680372d0 con 0x7f5578102840 2024-09-15T22:23:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.330+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5578198600 con 0x7f5578102840 2024-09-15T22:23:45.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.331+0000 7f557c9c8640 1 -- 172.21.15.112:0/1787253588 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f5568031570 con 0x7f5578102840 2024-09-15T22:23:45.333 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:23:45.333 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","modified":"2024-09-15T22:22:10.805617Z","created":"2024-09-15T22:22:10.805617Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T22:23:45.333 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-15T22:23:45.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f55600392a0 msgr2=0x7f556003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f55600392a0 0x7f556003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f556c0098c0 tx=0x7f556c006db0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 msgr2=0x7f55781972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f55781972a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5568009230 tx=0x7f5568003d40 comp rx=0 tx=0).stop 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 shutdown_connections 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f55600392a0 0x7f556003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 --2- 172.21.15.112:0/1787253588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5578102840 0x7f55781972a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 >> 172.21.15.112:0/1787253588 conn(0x7f55780fc280 msgr2=0x7f5578105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:45.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 shutdown_connections 2024-09-15T22:23:45.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:45.333+0000 7f557d9ca640 1 -- 172.21.15.112:0/1787253588 wait complete. 2024-09-15T22:23:45.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:45 smithi022 ceph-mon[30634]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:45.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:45 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/1787253588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:23:46.465 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 bash[35012]: 28db664a0ea5d5ab161888f7c7f6c645f94d6fb3929bfe2c85e63f91d2c9c4d3 2024-09-15T22:23:46.466 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).mds e1 new map 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: e1 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: btime 2024-09-15T22:22:15:226409+0000 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: legacy client fscid: -1 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout: No filesystems configured 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 systemd[1]: Started Ceph mon.c for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:23:46.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:46.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Deploying cephadm binary to smithi112 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Added host smithi112 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/4108629328' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/4108629328' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.856 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:46.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c;count:3 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: Deploying daemon mon.c on smithi112 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/1787253588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:23:46.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:46 smithi112 ceph-mon[35032]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:23:46.946 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:23:46.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:23:47.211 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: mon.a calling monitor election 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: mon.c calling monitor election 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:51.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: monmap epoch 2 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: last_changed 2024-09-15T22:23:46.471456+0000 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: min_mon_release 19 (squid) 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: election_strategy: 1 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: fsmap 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: mgrmap e13: x(active, since 42s) 2024-09-15T22:23:51.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: overall HEALTH_OK 2024-09-15T22:23:51.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:51.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:51.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:51.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:23:51.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:52.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: mon.a calling monitor election 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: mon.c calling monitor election 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: monmap epoch 2 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:52.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: last_changed 2024-09-15T22:23:46.471456+0000 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: min_mon_release 19 (squid) 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: election_strategy: 1 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: fsmap 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: mgrmap e13: x(active, since 42s) 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: overall HEALTH_OK 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:23:52.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 -- 172.21.15.112:0/263892579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e0003530 msgr2=0x7f92e00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 --2- 172.21.15.112:0/263892579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e0003530 0x7f92e00059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f92f41016a0 tx=0x7f92f002c490 comp rx=0 tx=0).stop 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 -- 172.21.15.112:0/263892579 shutdown_connections 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 --2- 172.21.15.112:0/263892579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92e0003530 0x7f92e00059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 -- 172.21.15.112:0/263892579 >> 172.21.15.112:0/263892579 conn(0x7f92f40fc220 msgr2=0x7f92f40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 -- 172.21.15.112:0/263892579 shutdown_connections 2024-09-15T22:23:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.051+0000 7f92fbd54640 1 -- 172.21.15.112:0/263892579 wait complete. 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.052+0000 7f92fbd54640 1 Processor -- start 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.052+0000 7f92fbd54640 1 -- start start 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.052+0000 7f92fbd54640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.052+0000 7f92fbd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4103e30 0x7f92f4102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.052+0000 7f92fbd54640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4108670 con 0x7f92f4103e30 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.052+0000 7f92fbd54640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41084f0 con 0x7f92e0003530 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48644/0 (socket says 172.21.15.112:48644) 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 -- 172.21.15.112:0/1292138237 learned_addr learned my addr 172.21.15.112:0/1292138237 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:23:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 -- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 msgr2=0x7f92f41021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 -- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 msgr2=0x7f92f41021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f92ef640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4103e30 0x7f92f4102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f9af0640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f92ef640 1 -- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 msgr2=0x7f92f41021f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f92ef640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f92ef640 1 -- 172.21.15.112:0/1292138237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f4102c70 con 0x7f92f4103e30 2024-09-15T22:23:52.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.053+0000 7f92f92ef640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4103e30 0x7f92f4102730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92e400b3d0 tx=0x7f92e400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:52.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.054+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f92e4011630 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.054+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e4011cb0 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.054+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f92e4010df0 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.054+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f4102f60 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.054+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41a7eb0 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.055+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f92e4018020 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.055+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f4101ca0 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.055+0000 7f92eaffd640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f92d8039040 0x7f92d803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.055+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f92e404bff0 con 0x7f92f4103e30 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.056+0000 7f92f9af0640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f92d8039040 0x7f92d803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.056+0000 7f92f9af0640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f92d8039040 0x7f92d803b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92f002ca80 tx=0x7f92f002c9f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:52.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.061+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92e401f020 con 0x7f92f4103e30 2024-09-15T22:23:52.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.295+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f92f41a82a0 con 0x7f92f4103e30 2024-09-15T22:23:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.295+0000 7f92eaffd640 1 -- 172.21.15.112:0/1292138237 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f92e4018310 con 0x7f92f4103e30 2024-09-15T22:23:52.297 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:23:52.297 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","modified":"2024-09-15T22:23:46.471456Z","created":"2024-09-15T22:22:10.805617Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:23:52.297 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 2 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f92d8039040 msgr2=0x7f92d803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f92d8039040 0x7f92d803b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92f002ca80 tx=0x7f92f002c9f0 comp rx=0 tx=0).stop 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4103e30 msgr2=0x7f92f4102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4103e30 0x7f92f4102730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92e400b3d0 tx=0x7f92e400b890 comp rx=0 tx=0).stop 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 shutdown_connections 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f92d8039040 0x7f92d803b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:52.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4103e30 0x7f92f4102730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:52.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 --2- 172.21.15.112:0/1292138237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92e0003530 0x7f92f41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:52.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 >> 172.21.15.112:0/1292138237 conn(0x7f92f40fc220 msgr2=0x7f92f406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:52.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 shutdown_connections 2024-09-15T22:23:52.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:52.297+0000 7f92fbd54640 1 -- 172.21.15.112:0/1292138237 wait complete. 2024-09-15T22:23:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:52 smithi112 ceph-mon[35032]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:52 smithi112 ceph-mon[35032]: Deploying daemon mon.b on smithi110 2024-09-15T22:23:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:52 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/1292138237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:23:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:53.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:52 smithi022 ceph-mon[30634]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:53.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:52 smithi022 ceph-mon[30634]: Deploying daemon mon.b on smithi110 2024-09-15T22:23:53.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:52 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/1292138237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:23:53.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:53.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:23:53 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:23:53.471+0000 7f4fad600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:23:53.965 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:23:53.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:23:54.216 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:23:54.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:23:54 smithi112 ceph-mon[35032]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:54.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 -- 172.21.15.112:0/3851615872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 msgr2=0x7f403c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 --2- 172.21.15.112:0/3851615872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c106a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f402c009880 tx=0x7f402c02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 -- 172.21.15.112:0/3851615872 shutdown_connections 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 --2- 172.21.15.112:0/3851615872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c106a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 -- 172.21.15.112:0/3851615872 >> 172.21.15.112:0/3851615872 conn(0x7f403c0fc280 msgr2=0x7f403c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 -- 172.21.15.112:0/3851615872 shutdown_connections 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.720+0000 7f4042632640 1 -- 172.21.15.112:0/3851615872 wait complete. 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.721+0000 7f4042632640 1 Processor -- start 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.721+0000 7f4042632640 1 -- start start 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f4042632640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f4042632640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f4042632640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f403c10ac80 con 0x7f403c106650 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f4042632640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f403c10ab00 con 0x7f403c196810 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48648/0 (socket says 172.21.15.112:48648) 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 -- 172.21.15.112:0/1861438816 learned_addr learned my addr 172.21.15.112:0/1861438816 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 -- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 msgr2=0x7f403c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 -- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 msgr2=0x7f403c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:23:54.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403b7fe640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403bfff640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403bfff640 1 -- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 msgr2=0x7f403c19aba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403bfff640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.722+0000 7f403bfff640 1 -- 172.21.15.112:0/1861438816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c196e30 con 0x7f403c106650 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.723+0000 7f403bfff640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c1962d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f402c005ab0 tx=0x7f402c032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.723+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f402c035070 con 0x7f403c106650 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.723+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c19b0e0 con 0x7f403c106650 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.723+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f402c032e40 con 0x7f403c106650 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.723+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f402c03bc10 con 0x7f403c106650 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.723+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c19b640 con 0x7f403c106650 2024-09-15T22:23:54.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.724+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f402c042030 con 0x7f403c106650 2024-09-15T22:23:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.724+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c101cc0 con 0x7f403c106650 2024-09-15T22:23:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.724+0000 7f40397fa640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4024039040 0x7f402403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.724+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f402c040070 con 0x7f403c106650 2024-09-15T22:23:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.724+0000 7f403b7fe640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4024039040 0x7f402403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.725+0000 7f403b7fe640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4024039040 0x7f402403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4030009100 tx=0x7f4030008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.729+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f402c04a260 con 0x7f403c106650 2024-09-15T22:23:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.958+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f403c0008d0 con 0x7f403c106650 2024-09-15T22:23:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.959+0000 7f40397fa640 1 -- 172.21.15.112:0/1861438816 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f402c03bdb0 con 0x7f403c106650 2024-09-15T22:23:54.960 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:23:54.960 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","modified":"2024-09-15T22:23:46.471456Z","created":"2024-09-15T22:22:10.805617Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:23:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 2 2024-09-15T22:23:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.961+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4024039040 msgr2=0x7f402403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.961+0000 7f4042632640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4024039040 0x7f402403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4030009100 tx=0x7f4030008040 comp rx=0 tx=0).stop 2024-09-15T22:23:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.961+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 msgr2=0x7f403c1962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.961+0000 7f4042632640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c1962d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f402c005ab0 tx=0x7f402c032c50 comp rx=0 tx=0).stop 2024-09-15T22:23:54.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 shutdown_connections 2024-09-15T22:23:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f403c196810 0x7f403c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4024039040 0x7f402403b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 --2- 172.21.15.112:0/1861438816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c106650 0x7f403c1962d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 >> 172.21.15.112:0/1861438816 conn(0x7f403c0fc280 msgr2=0x7f403c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 shutdown_connections 2024-09-15T22:23:54.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:23:54.962+0000 7f4042632640 1 -- 172.21.15.112:0/1861438816 wait complete. 2024-09-15T22:23:55.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:23:54 smithi022 ceph-mon[30634]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.286 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 podman[35263]: 2024-09-15 22:23:55.284733328 +0000 UTC m=+0.366919916 container init c31de8c6da4b884b05291181f6d0de889cd6ab86eed6f0492c637ef6b1d47e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 podman[35263]: 2024-09-15 22:23:55.288172874 +0000 UTC m=+0.370359458 container start c31de8c6da4b884b05291181f6d0de889cd6ab86eed6f0492c637ef6b1d47e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pidfile_write: ignore empty --pid-file 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: load: jerasure load: lrc 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Git sha 0 2024-09-15T22:23:55.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: DB SUMMARY 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: DB Session ID: DCHR3HESWM3SQ2GI4J79 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:23:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.env: 0x558dd14a9940 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.info_log: 0x558dd1fd76e0 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.statistics: (nil) 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.use_fsync: 0 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:23:55.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:23:55.709 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.db_log_dir: 2024-09-15T22:23:55.710 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.wal_dir: 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.write_buffer_manager: 0x558dd1fe6dc0 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:23:55.711 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.unordered_write: 0 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.row_cache: None 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.wal_filter: None 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:23:55.712 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.wal_compression: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:23:55.713 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:23:55.714 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_open_files: -1 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Compression algorithms supported: 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kZSTD supported: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:23:55.715 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.merge_operator: 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_filter: None 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:23:55.716 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558dd1fd7320) 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: index_type: 0 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: data_block_index_type: 0 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: index_shortening: 1 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: checksum: 4 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: no_block_cache: 0 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_cache: 0x558dd1fcb1f0 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_cache_options: 2024-09-15T22:23:55.717 INFO:journalctl@ceph.mon.b.smithi110.stdout: capacity : 536870912 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: num_shard_bits : 4 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: strict_capacity_limit : 0 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_cache_compressed: (nil) 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: persistent_cache: (nil) 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_size: 4096 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_size_deviation: 10 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_restart_interval: 16 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: index_block_restart_interval: 1 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: metadata_block_size: 4096 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: partition_filters: 0 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: use_delta_encoding: 1 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: filter_policy: bloomfilter 2024-09-15T22:23:55.718 INFO:journalctl@ceph.mon.b.smithi110.stdout: whole_key_filtering: 1 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: verify_compression: 0 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: format_version: 5 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: enable_index_compression: 1 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: block_align: 0 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: max_auto_readahead_size: 262144 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: prepopulate_block_cache: 0 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression: NoCompression 2024-09-15T22:23:55.719 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.num_levels: 7 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:23:55.720 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:23:55.721 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:23:55.722 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:23:55.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:23:55.724 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.ttl: 2592000 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:23:55.725 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T22:23:55.726 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7a58d16c-1a82-45c0-bc4d-a03d80200f59 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439035314645, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439035315043, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726439035, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7a58d16c-1a82-45c0-bc4d-a03d80200f59", "db_session_id": "DCHR3HESWM3SQ2GI4J79", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439035315136, "job": 1, "event": "recovery_finished"} 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558dd1ff8e00 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: DB pointer 0x558dd20f4000 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout: ** DB Stats ** 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:23:55.727 INFO:journalctl@ceph.mon.b.smithi110.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:23:55.728 INFO:journalctl@ceph.mon.b.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: 2024-09-15T22:23:55.729 INFO:journalctl@ceph.mon.b.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: Block cache BinnedLRUCache@0x558dd1fcb1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:23:55.730 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: using public_addr v2:172.21.15.110:0/0 -> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: starting mon.b rank -1 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(???) e0 preinit fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).mds e1 new map 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: e1 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: btime 2024-09-15T22:22:15:226409+0000 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: legacy client fscid: -1 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout: No filesystems configured 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:23:55.731 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.732 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Deploying cephadm binary to smithi112 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Added host smithi112 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.733 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/4108629328' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/4108629328' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T22:23:55.734 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:55.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.736 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:23:55.736 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:55.736 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.736 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:23:55.736 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c;count:3 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Deploying daemon mon.c on smithi112 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/1787253588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.a calling monitor election 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.c calling monitor election 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: monmap epoch 2 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: last_changed 2024-09-15T22:23:46.471456+0000 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: min_mon_release 19 (squid) 2024-09-15T22:23:55.738 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: election_strategy: 1 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: fsmap 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mgrmap e13: x(active, since 42s) 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: overall HEALTH_OK 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.739 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: Deploying daemon mon.b on smithi110 2024-09-15T22:23:55.740 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/1292138237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:23:55.740 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:23:55.740 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:23:55.740 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 ceph-mon[35282]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:23:55.740 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 bash[35263]: c31de8c6da4b884b05291181f6d0de889cd6ab86eed6f0492c637ef6b1d47e26 2024-09-15T22:23:55.740 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:23:55 smithi110 systemd[1]: Started Ceph mon.b for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:23:56.563 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:23:56.563 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:23:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:24:00.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 -- 172.21.15.112:0/398587022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faad4003530 msgr2=0x7faad40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 --2- 172.21.15.112:0/398587022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faad4003530 0x7faad40059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faae8102b00 tx=0x7faad802bd70 comp rx=0 tx=0).stop 2024-09-15T22:24:00.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 -- 172.21.15.112:0/398587022 shutdown_connections 2024-09-15T22:24:00.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 --2- 172.21.15.112:0/398587022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faad4003530 0x7faad40059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 -- 172.21.15.112:0/398587022 >> 172.21.15.112:0/398587022 conn(0x7faae80fd330 msgr2=0x7faae80ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:00.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 -- 172.21.15.112:0/398587022 shutdown_connections 2024-09-15T22:24:00.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.426+0000 7faaecdf3640 1 -- 172.21.15.112:0/398587022 wait complete. 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 Processor -- start 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 -- start start 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 0x7faae80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faae81a3560 0x7faae81a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faae8109790 con 0x7faae81a3560 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faae8109610 con 0x7faad4003530 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.427+0000 7faaecdf3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faae8109910 con 0x7faae8074a30 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55652/0 (socket says 172.21.15.112:55652) 2024-09-15T22:24:00.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 -- 172.21.15.112:0/3585993083 learned_addr learned my addr 172.21.15.112:0/3585993083 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:24:00.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faae81a3560 0x7faae81a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae659c640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 0x7faae80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 msgr2=0x7faae8074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 msgr2=0x7faae8074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae5d9b640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae659c640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 msgr2=0x7faae80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae659c640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 msgr2=0x7faae80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:24:00.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae659c640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 0x7faae80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae659c640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 0x7faae80744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 msgr2=0x7faae8074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 msgr2=0x7faae80744f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 0x7faae80744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 -- 172.21.15.112:0/3585993083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae81a6020 con 0x7faae81a3560 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faae6d9d640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faae81a3560 0x7faae81a5950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faae0009fd0 tx=0x7faae000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.428+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0015020 con 0x7faae81a3560 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.429+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faae0011d10 con 0x7faae81a3560 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.429+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000f2e0 con 0x7faae81a3560 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.429+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae81a6310 con 0x7faae81a3560 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.429+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae81a6850 con 0x7faae81a3560 2024-09-15T22:24:00.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.430+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7faae0018020 con 0x7faae81a3560 2024-09-15T22:24:00.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.430+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae810a940 con 0x7faae81a3560 2024-09-15T22:24:00.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.430+0000 7faadf7fe640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faac8039730 0x7faac803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:00.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.430+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7faae004bff0 con 0x7faae81a3560 2024-09-15T22:24:00.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.430+0000 7faae659c640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faac8039730 0x7faac803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:00.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.431+0000 7faae659c640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faac8039730 0x7faac803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faad802c360 tx=0x7faad80099b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:00.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.435+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faae001f020 con 0x7faae81a3560 2024-09-15T22:24:00.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.676+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7faae802d7c0 con 0x7faae81a3560 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: mon.c calling monitor election 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: mon.a calling monitor election 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: monmap epoch 3 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: last_changed 2024-09-15T22:23:55.338707+0000 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: min_mon_release 19 (squid) 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: election_strategy: 1 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:24:00.679 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: 2: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: fsmap 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: mgrmap e13: x(active, since 50s) 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: overall HEALTH_OK 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.680 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.677+0000 7faadf7fe640 1 -- 172.21.15.112:0/3585993083 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7faae0018310 con 0x7faae81a3560 2024-09-15T22:24:00.681 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:24:00.681 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","modified":"2024-09-15T22:23:55.338707Z","created":"2024-09-15T22:22:10.805617Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:24:00.681 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 3 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faac8039730 msgr2=0x7faac803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faac8039730 0x7faac803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faad802c360 tx=0x7faad80099b0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faae81a3560 msgr2=0x7faae81a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faae81a3560 0x7faae81a5950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faae0009fd0 tx=0x7faae000b870 comp rx=0 tx=0).stop 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 shutdown_connections 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae8074a30 0x7faae8074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faac8039730 0x7faac803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faae81a3560 0x7faae81a5950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 --2- 172.21.15.112:0/3585993083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faad4003530 0x7faae80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 >> 172.21.15.112:0/3585993083 conn(0x7faae80fd330 msgr2=0x7faae80ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 shutdown_connections 2024-09-15T22:24:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:00.679+0000 7faaecdf3640 1 -- 172.21.15.112:0/3585993083 wait complete. 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: mon.c calling monitor election 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: mon.a calling monitor election 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:00.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: monmap epoch 3 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: last_changed 2024-09-15T22:23:55.338707+0000 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: min_mon_release 19 (squid) 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: election_strategy: 1 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: 2: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: fsmap 2024-09-15T22:24:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:24:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: mgrmap e13: x(active, since 50s) 2024-09-15T22:24:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: overall HEALTH_OK 2024-09-15T22:24:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:01.386 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T22:24:01.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T22:24:01.728 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:01 smithi112 ceph-mon[35032]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:01.728 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:01.728 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:01 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/3585993083' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:24:01.728 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:01.769 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:01 smithi022 ceph-mon[30634]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:01 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/3585993083' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:24:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 -- 172.21.15.22:0/1311230949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 msgr2=0x7f70f8109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 --2- 172.21.15.22:0/1311230949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8109b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009880 tx=0x7f70ec02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 -- 172.21.15.22:0/1311230949 shutdown_connections 2024-09-15T22:24:02.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 --2- 172.21.15.22:0/1311230949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8109b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 -- 172.21.15.22:0/1311230949 >> 172.21.15.22:0/1311230949 conn(0x7f70f80ff450 msgr2=0x7f70f8101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:02.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 -- 172.21.15.22:0/1311230949 shutdown_connections 2024-09-15T22:24:02.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.332+0000 7f7100800640 1 -- 172.21.15.22:0/1311230949 wait complete. 2024-09-15T22:24:02.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.333+0000 7f7100800640 1 Processor -- start 2024-09-15T22:24:02.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 -- start start 2024-09-15T22:24:02.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f8199b50 0x7f70f819dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 0x7f70f819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70f810ddd0 con 0x7f70f8109770 2024-09-15T22:24:02.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f70f810dc50 con 0x7f70f819e420 2024-09-15T22:24:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f7100800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70f810df50 con 0x7f70f8199b50 2024-09-15T22:24:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f70fde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f70fd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f8199b50 0x7f70f819dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f70fde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57258/0 (socket says 172.21.15.22:57258) 2024-09-15T22:24:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f70fde00640 1 -- 172.21.15.22:0/2389654673 learned_addr learned my addr 172.21.15.22:0/2389654673 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:24:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.334+0000 7f70fe800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 0x7f70f819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fd400640 1 -- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 msgr2=0x7f70f819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fe800640 1 -- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 msgr2=0x7f70f819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-15T22:24:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fe800640 1 -- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 msgr2=0x7f70f819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:24:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fe800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 0x7f70f819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:24:02.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fe800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 0x7f70f819e8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fd400640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 0x7f70f819e8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fd400640 1 -- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 msgr2=0x7f70f8199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fd400640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fd400640 1 -- 172.21.15.22:0/2389654673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f81a6190 con 0x7f70f8199b50 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fde00640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.335+0000 7f70fd400640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f8199b50 0x7f70f819dee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b450 tx=0x7f70e800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.336+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8004230 con 0x7f70f8199b50 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.336+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e80043d0 con 0x7f70f8199b50 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.336+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f81a63c0 con 0x7f70f8199b50 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.336+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8003cb0 con 0x7f70f8199b50 2024-09-15T22:24:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.336+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81a6920 con 0x7f70f8199b50 2024-09-15T22:24:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.337+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f70e800f050 con 0x7f70f8199b50 2024-09-15T22:24:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.337+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f8109bd0 con 0x7f70f8199b50 2024-09-15T22:24:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.338+0000 7f70f2a00640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70e0039730 0x7f70e003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.338+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70e804c150 con 0x7f70f8199b50 2024-09-15T22:24:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.338+0000 7f70fde00640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70e0039730 0x7f70e003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.339+0000 7f70fde00640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70e0039730 0x7f70e003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009230 tx=0x7f70ec02aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:02.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.343+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70e800d040 con 0x7f70f8199b50 2024-09-15T22:24:02.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.540+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f70f81a6c80 con 0x7f70f8199b50 2024-09-15T22:24:02.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.541+0000 7f70f2a00640 1 -- 172.21.15.22:0/2389654673 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f70e801a920 con 0x7f70f8199b50 2024-09-15T22:24:02.543 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:02.543 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-09-15T22:24:02.543 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:02.544 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-09-15T22:24:02.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70e0039730 msgr2=0x7f70e003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70e0039730 0x7f70e003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009230 tx=0x7f70ec02aad0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f8199b50 msgr2=0x7f70f819dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f8199b50 0x7f70f819dee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b450 tx=0x7f70e800b910 comp rx=0 tx=0).stop 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 shutdown_connections 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f8199b50 0x7f70f819dee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70e0039730 0x7f70e003bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f819e420 0x7f70f819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 --2- 172.21.15.22:0/2389654673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f8109770 0x7f70f8199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.543+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 >> 172.21.15.22:0/2389654673 conn(0x7f70f80ff450 msgr2=0x7f70f80ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.544+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 shutdown_connections 2024-09-15T22:24:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:02.544+0000 7f7100800640 1 -- 172.21.15.22:0/2389654673 wait complete. 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: mon.c calling monitor election 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: mon.a calling monitor election 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: monmap epoch 3 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: last_changed 2024-09-15T22:23:55.338707+0000 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: min_mon_release 19 (squid) 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: election_strategy: 1 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: 2: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: fsmap 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:24:02.693 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: mgrmap e13: x(active, since 50s) 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: overall HEALTH_OK 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/3585993083' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:24:02.694 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: mon.b calling monitor election 2024-09-15T22:24:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: mon.b calling monitor election 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: mon.c calling monitor election 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: mon.a calling monitor election 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: monmap epoch 3 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: last_changed 2024-09-15T22:23:55.338707+0000 2024-09-15T22:24:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: min_mon_release 19 (squid) 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: election_strategy: 1 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: 2: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: fsmap 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: mgrmap e13: x(active, since 52s) 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: overall HEALTH_OK 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:03 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2389654673' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:03.329 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T22:24:03.330 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:24:03.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:24:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: mon.b calling monitor election 2024-09-15T22:24:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-15T22:24:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-15T22:24:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: mon.b calling monitor election 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: mon.c calling monitor election 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: mon.a calling monitor election 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: monmap epoch 3 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: last_changed 2024-09-15T22:23:55.338707+0000 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: min_mon_release 19 (squid) 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: election_strategy: 1 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:24:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: 2: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: fsmap 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: mgrmap e13: x(active, since 52s) 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: overall HEALTH_OK 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:03 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2389654673' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:03.387 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:24:03.387 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:24:03.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: mon.b calling monitor election 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: Updating smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: Updating smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: mon.b calling monitor election 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: mon.c calling monitor election 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: mon.a calling monitor election 2024-09-15T22:24:03.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: monmap epoch 3 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: last_changed 2024-09-15T22:23:55.338707+0000 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: created 2024-09-15T22:22:10.805617+0000 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: min_mon_release 19 (squid) 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: election_strategy: 1 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.c 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: 2: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: fsmap 2024-09-15T22:24:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: mgrmap e13: x(active, since 52s) 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: overall HEALTH_OK 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:03.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:03 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2389654673' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:03.485 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:24:03.485 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:24:03.512 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:24:03.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:24:03.577 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:24:03.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:24:03.609 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:24:03.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:24:03.678 INFO:tasks.cephadm:Adding mgr.x on smithi022 2024-09-15T22:24:03.678 INFO:tasks.cephadm:Adding mgr.y on smithi110 2024-09-15T22:24:03.678 INFO:tasks.cephadm:Adding mgr.z on smithi112 2024-09-15T22:24:03.678 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi022=x;smithi110=y;smithi112=z' 2024-09-15T22:24:03.958 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:24:04.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: Updating smithi022:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:24:04.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:04.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:04.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:04.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: Reconfiguring daemon mon.a on smithi022 2024-09-15T22:24:04.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1972583884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 msgr2=0x7f9b98101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1972583884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98101b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009880 tx=0x7f9b8802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1972583884 shutdown_connections 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1972583884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98101b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1972583884 >> 172.21.15.112:0/1972583884 conn(0x7f9b980fcec0 msgr2=0x7f9b980ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1972583884 shutdown_connections 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.380+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1972583884 wait complete. 2024-09-15T22:24:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.381+0000 7f9b9da5b640 1 Processor -- start 2024-09-15T22:24:04.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.381+0000 7f9b9da5b640 1 -- start start 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b9da5b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98190830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b9da5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 0x7f9b9818d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b9da5b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b9818d7d0 0x7f9b981a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b9da5b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98107820 con 0x7f9b98101710 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b9da5b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9b981076a0 con 0x7f9b9818d7d0 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b9da5b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b981079a0 con 0x7f9b98190d70 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 0x7f9b9818d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 0x7f9b9818d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55664/0 (socket says 172.21.15.112:55664) 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 -- 172.21.15.112:0/1488030337 learned_addr learned my addr 172.21.15.112:0/1488030337 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b96ffd640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98190830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b977fe640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b9818d7d0 0x7f9b981a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 -- 172.21.15.112:0/1488030337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b9818d7d0 msgr2=0x7f9b981a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b9818d7d0 0x7f9b981a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 -- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 msgr2=0x7f9b98190830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98190830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b967fc640 1 -- 172.21.15.112:0/1488030337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b981a5b60 con 0x7f9b98190d70 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.382+0000 7f9b96ffd640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98190830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.383+0000 7f9b967fc640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 0x7f9b9818d290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00b520 tx=0x7f9b8c00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.383+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c004230 con 0x7f9b98190d70 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.383+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8c0043d0 con 0x7f9b98190d70 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.383+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b981a5d30 con 0x7f9b98190d70 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.383+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c003d60 con 0x7f9b98190d70 2024-09-15T22:24:04.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.383+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b981a6250 con 0x7f9b98190d70 2024-09-15T22:24:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.384+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9b8c00e070 con 0x7f9b98190d70 2024-09-15T22:24:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.384+0000 7f9b9ca59640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9b80039730 0x7f9b8003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.384+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9b8c04cc40 con 0x7f9b98190d70 2024-09-15T22:24:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.384+0000 7f9b96ffd640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9b80039730 0x7f9b8003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.384+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b98192950 con 0x7f9b98190d70 2024-09-15T22:24:04.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.385+0000 7f9b96ffd640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9b80039730 0x7f9b8003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b88005ab0 tx=0x7f9b880315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:04.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.389+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b8c014020 con 0x7f9b98190d70 2024-09-15T22:24:04.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: Updating smithi022:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:04.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:24:04.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:04.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:04.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:04.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: Reconfiguring daemon mon.a on smithi022 2024-09-15T22:24:04.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:04.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: Updating smithi022:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:24:04.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: Reconfiguring daemon mon.a on smithi022 2024-09-15T22:24:04.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:24:04.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.564+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi110=y;smithi112=z", "target": ["mon-mgr", ""]}) -- 0x7f9b980626c0 con 0x7f9b80039730 2024-09-15T22:24:04.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.569+0000 7f9b9ca59640 1 -- 172.21.15.112:0/1488030337 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9b980626c0 con 0x7f9b80039730 2024-09-15T22:24:04.571 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mgr update... 2024-09-15T22:24:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9b80039730 msgr2=0x7f9b8003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9b80039730 0x7f9b8003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b88005ab0 tx=0x7f9b880315d0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 msgr2=0x7f9b9818d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 0x7f9b9818d290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00b520 tx=0x7f9b8c00b9e0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 shutdown_connections 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b98190d70 0x7f9b9818d290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9b80039730 0x7f9b8003bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b9818d7d0 0x7f9b981a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 --2- 172.21.15.112:0/1488030337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b98101710 0x7f9b98190830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 >> 172.21.15.112:0/1488030337 conn(0x7f9b980fcec0 msgr2=0x7f9b980ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 shutdown_connections 2024-09-15T22:24:04.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:24:04.571+0000 7f9b9da5b640 1 -- 172.21.15.112:0/1488030337 wait complete. 2024-09-15T22:24:05.169 DEBUG:teuthology.orchestra.run.smithi110:mgr.y> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T22:24:05.172 DEBUG:teuthology.orchestra.run.smithi112:mgr.z> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T22:24:05.175 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T22:24:05.175 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:24:05.175 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:24:05.214 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:24:05.214 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 640 Links: 1 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-15 22:23:23.113950275 +0000 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-15 22:18:46.956103074 +0000 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-15 22:18:46.956103074 +0000 2024-09-15T22:24:05.293 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-15 22:18:46.956103074 +0000 2024-09-15T22:24:05.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-15T22:24:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-15T22:24:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000532856 s, 961 kB/s 2024-09-15T22:24:05.391 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:24:05.428 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-09-15T22:24:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 660 Links: 1 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-15 22:23:23.162949656 +0000 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-15 22:18:47.454096983 +0000 2024-09-15T22:24:05.507 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-15 22:18:47.454096983 +0000 2024-09-15T22:24:05.508 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-15 22:18:47.454096983 +0000 2024-09-15T22:24:05.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:24:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:05.594 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-15T22:24:05.594 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-15T22:24:05.594 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.0001875 s, 2.7 MB/s 2024-09-15T22:24:05.598 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:24:05.637 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-09-15T22:24:05.716 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:24:05.716 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:05.716 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 680 Links: 1 2024-09-15T22:24:05.716 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:05.717 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:05.717 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-15 22:23:23.212949025 +0000 2024-09-15T22:24:05.717 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-15 22:18:47.883091737 +0000 2024-09-15T22:24:05.717 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-15 22:18:47.883091737 +0000 2024-09-15T22:24:05.717 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-15 22:18:47.883091737 +0000 2024-09-15T22:24:05.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:24:05.817 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-15T22:24:05.818 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-15T22:24:05.818 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000181892 s, 2.8 MB/s 2024-09-15T22:24:05.820 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:24:05.859 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-09-15T22:24:05.937 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:24:05.937 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:05.937 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 698 Links: 1 2024-09-15T22:24:05.938 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:05.938 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:05.938 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-15 22:23:23.264948368 +0000 2024-09-15T22:24:05.938 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-15 22:18:48.334086221 +0000 2024-09-15T22:24:05.938 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-15 22:18:48.334086221 +0000 2024-09-15T22:24:05.938 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-15 22:18:48.334086221 +0000 2024-09-15T22:24:05.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:24:06.033 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-15T22:24:06.033 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-15T22:24:06.033 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000181937 s, 2.8 MB/s 2024-09-15T22:24:06.036 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:24:06.073 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-15T22:24:06.073 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:24:06.093 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:24:06.093 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-15 22:23:54.735607249 +0000 2024-09-15T22:24:06.152 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-15 22:18:05.217603948 +0000 2024-09-15T22:24:06.153 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-15 22:18:05.217603948 +0000 2024-09-15T22:24:06.153 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-15 22:18:05.217603948 +0000 2024-09-15T22:24:06.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:24:06.220 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-15T22:24:06.220 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-15T22:24:06.220 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.3989e-05 s, 5.4 MB/s 2024-09-15T22:24:06.221 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:24:06.280 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-15T22:24:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:24:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:06.337 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-15T22:24:06.337 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:06.338 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:06.338 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-15 22:23:54.735607249 +0000 2024-09-15T22:24:06.338 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-15 22:18:05.523598478 +0000 2024-09-15T22:24:06.338 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-15 22:18:05.523598478 +0000 2024-09-15T22:24:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-15 22:18:05.523598478 +0000 2024-09-15T22:24:06.338 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:24:06.403 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-15T22:24:06.403 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-15T22:24:06.403 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000120086 s, 4.3 MB/s 2024-09-15T22:24:06.404 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:24:06.462 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-15T22:24:06.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:06 smithi022 ceph-mon[30634]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi110=y;smithi112=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:06.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:06 smithi022 ceph-mon[30634]: Saving service mgr spec with placement smithi022=x;smithi110=y;smithi112=z;count:3 2024-09-15T22:24:06.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:06 smithi022 ceph-mon[30634]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:24:06.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:06 smithi022 ceph-mon[30634]: Reconfiguring daemon mgr.x on smithi022 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-15 22:23:54.736607232 +0000 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-15 22:18:05.840592811 +0000 2024-09-15T22:24:06.519 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-15 22:18:05.840592811 +0000 2024-09-15T22:24:06.520 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-15 22:18:05.840592811 +0000 2024-09-15T22:24:06.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:24:06.582 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:06 smithi110 ceph-mon[35282]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi110=y;smithi112=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:06.582 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:06 smithi110 ceph-mon[35282]: Saving service mgr spec with placement smithi022=x;smithi110=y;smithi112=z;count:3 2024-09-15T22:24:06.582 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:06 smithi110 ceph-mon[35282]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:24:06.582 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:06 smithi110 ceph-mon[35282]: Reconfiguring daemon mgr.x on smithi022 2024-09-15T22:24:06.584 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-15T22:24:06.584 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-15T22:24:06.584 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 8.6337e-05 s, 5.9 MB/s 2024-09-15T22:24:06.585 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:24:06.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:06 smithi112 ceph-mon[35032]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi110=y;smithi112=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:06.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:06 smithi112 ceph-mon[35032]: Saving service mgr spec with placement smithi022=x;smithi110=y;smithi112=z;count:3 2024-09-15T22:24:06.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:06 smithi112 ceph-mon[35032]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:24:06.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:06 smithi112 ceph-mon[35032]: Reconfiguring daemon mgr.x on smithi022 2024-09-15T22:24:06.641 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-15T22:24:06.698 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:24:06.698 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:06.698 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-15T22:24:06.698 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:06.698 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:06.699 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-15 22:23:54.736607232 +0000 2024-09-15T22:24:06.699 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-15 22:18:06.148587305 +0000 2024-09-15T22:24:06.699 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-15 22:18:06.148587305 +0000 2024-09-15T22:24:06.699 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-15 22:18:06.148587305 +0000 2024-09-15T22:24:06.699 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:24:06.761 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-15T22:24:06.761 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-15T22:24:06.761 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000110349 s, 4.6 MB/s 2024-09-15T22:24:06.763 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:24:06.819 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:24:06.819 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:24:06.838 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:24:06.839 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-15T22:24:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:24:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:06.898 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-15T22:24:06.898 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:06.898 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:06.899 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 22:23:45.475844763 +0000 2024-09-15T22:24:06.899 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 22:18:05.240643427 +0000 2024-09-15T22:24:06.899 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 22:18:05.240643427 +0000 2024-09-15T22:24:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 22:18:05.240643427 +0000 2024-09-15T22:24:06.899 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:24:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T22:24:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T22:24:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000236197 s, 2.2 MB/s 2024-09-15T22:24:06.969 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:24:07.029 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-15T22:24:07.088 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:24:07.088 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:07.088 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T22:24:07.088 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:07.088 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:07.089 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 22:23:45.476844738 +0000 2024-09-15T22:24:07.089 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 22:18:05.580634558 +0000 2024-09-15T22:24:07.089 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 22:18:05.580634558 +0000 2024-09-15T22:24:07.089 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 22:18:05.580634558 +0000 2024-09-15T22:24:07.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:24:07.157 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T22:24:07.157 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T22:24:07.157 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000252675 s, 2.0 MB/s 2024-09-15T22:24:07.158 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:24:07.218 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-15T22:24:07.276 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 22:23:45.476844738 +0000 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 22:18:05.900626210 +0000 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 22:18:05.900626210 +0000 2024-09-15T22:24:07.277 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 22:18:05.900626210 +0000 2024-09-15T22:24:07.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:24:07.344 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T22:24:07.344 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T22:24:07.344 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000217628 s, 2.4 MB/s 2024-09-15T22:24:07.345 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:24:07.404 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-15T22:24:07.463 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:24:07.463 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:24:07.463 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-15T22:24:07.464 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:24:07.464 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:24:07.464 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 22:23:45.476844738 +0000 2024-09-15T22:24:07.464 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 22:18:06.225617732 +0000 2024-09-15T22:24:07.464 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 22:18:06.225617732 +0000 2024-09-15T22:24:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 22:18:06.225617732 +0000 2024-09-15T22:24:07.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:24:07.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:07 smithi112 ceph-mon[35032]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:07.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:07.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:07.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:07.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:07.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T22:24:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T22:24:07.530 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000262748 s, 1.9 MB/s 2024-09-15T22:24:07.531 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:24:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:07 smithi022 ceph-mon[30634]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:07.589 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2024-09-15T22:24:07.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:24:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:07 smithi110 ceph-mon[35282]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:07.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:07.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:24:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: Reconfiguring daemon mon.b on smithi110 2024-09-15T22:24:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:08.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:08.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:24:08.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: Reconfiguring daemon mon.b on smithi110 2024-09-15T22:24:08.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:08.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:08.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:08.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:08.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:08.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:24:08.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: Reconfiguring daemon mon.b on smithi110 2024-09-15T22:24:08.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:08.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:08.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:24:08.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:24:08.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:24:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: Reconfiguring daemon mon.c on smithi112 2024-09-15T22:24:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:09.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: Reconfiguring daemon mon.c on smithi112 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:24:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: Reconfiguring daemon mon.c on smithi112 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:09.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:10 smithi022 ceph-mon[30634]: Deploying daemon mgr.z on smithi112 2024-09-15T22:24:10.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:10 smithi112 ceph-mon[35032]: Deploying daemon mgr.z on smithi112 2024-09-15T22:24:10.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:10 smithi110 ceph-mon[35282]: Deploying daemon mgr.z on smithi112 2024-09-15T22:24:10.755 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:24:10.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-09-15T22:24:10.852 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:10 smithi112 systemd[1]: Starting Ceph mgr.z for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:24:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:11.161 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:10 smithi112 podman[36821]: 2024-09-15 22:24:10.900179411 +0000 UTC m=+0.099630164 container create cef4b2736c69cfa09b2726ad5dd6e5befd675df03550b85911761f936a23b887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T22:24:11.162 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:10 smithi112 podman[36821]: 2024-09-15 22:24:10.816407377 +0000 UTC m=+0.015858097 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:24:11.162 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 podman[36821]: 2024-09-15 22:24:11.085697994 +0000 UTC m=+0.285148701 container init cef4b2736c69cfa09b2726ad5dd6e5befd675df03550b85911761f936a23b887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T22:24:11.162 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 podman[36821]: 2024-09-15 22:24:11.088459536 +0000 UTC m=+0.287910243 container start cef4b2736c69cfa09b2726ad5dd6e5befd675df03550b85911761f936a23b887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T22:24:11.162 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-mgr[36840]: -- 172.21.15.112:0/2706660665 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55672bc4d0e0 con 0x55672bc2b000 2024-09-15T22:24:11.422 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-mon[35032]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:11.422 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:11.422 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 bash[36821]: cef4b2736c69cfa09b2726ad5dd6e5befd675df03550b85911761f936a23b887 2024-09-15T22:24:11.423 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 systemd[1]: Started Ceph mgr.z for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:24:11.423 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:11.210+0000 7fc6f2969040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:24:11.423 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:11.274+0000 7fc6f2969040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:24:11.423 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:11.420+0000 7fc6f2969040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:24:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:11 smithi022 ceph-mon[30634]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:11.669 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:11 smithi110 ceph-mon[35282]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:11.669 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 -- 172.21.15.22:0/4088307628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 msgr2=0x7f4ff410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/4088307628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 0x7f4ff410c240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009ca0 tx=0x7f4fec02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 -- 172.21.15.22:0/4088307628 shutdown_connections 2024-09-15T22:24:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/4088307628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 0x7f4ff410c240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/4088307628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4104f60 0x7f4ff41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/4088307628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ff4103e00 0x7f4ff4104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 -- 172.21.15.22:0/4088307628 >> 172.21.15.22:0/4088307628 conn(0x7f4ff40ff5b0 msgr2=0x7f4ff41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 -- 172.21.15.22:0/4088307628 shutdown_connections 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.732+0000 7f4ffaa00640 1 -- 172.21.15.22:0/4088307628 wait complete. 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 Processor -- start 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 -- start start 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410fb00 con 0x7f4ff4104f60 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410f980 con 0x7f4ff4103e00 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.733+0000 7f4ffaa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410fc80 con 0x7f4ff4105920 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38482/0 (socket says 172.21.15.22:38482) 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 -- 172.21.15.22:0/2721831495 learned_addr learned my addr 172.21.15.22:0/2721831495 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4feb400640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff8a00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 -- 172.21.15.22:0/2721831495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 msgr2=0x7f4ff41a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 -- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ff4104f60 msgr2=0x7f4ff419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 -- 172.21.15.22:0/2721831495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff41a1cc0 con 0x7f4ff4103e00 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.734+0000 7f4ff3e00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a090 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e9f0 tx=0x7f4fe400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.735+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400cd80 con 0x7f4ff4103e00 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.735+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe4010910 con 0x7f4ff4103e00 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.735+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41a1fb0 con 0x7f4ff4103e00 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.735+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4018990 con 0x7f4ff4103e00 2024-09-15T22:24:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.735+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a2460 con 0x7f4ff4103e00 2024-09-15T22:24:11.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.736+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff410b120 con 0x7f4ff4103e00 2024-09-15T22:24:11.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.736+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4fe4010ac0 con 0x7f4ff4103e00 2024-09-15T22:24:11.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.737+0000 7f4ff1600640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4fd8039500 0x7f4fd803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:11.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.737+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fe404cbd0 con 0x7f4ff4103e00 2024-09-15T22:24:11.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.737+0000 7f4feb400640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4fd8039500 0x7f4fd803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:11.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.738+0000 7f4feb400640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4fd8039500 0x7f4fd803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ff419b5b0 tx=0x7f4fdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:11.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.742+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fe400b2c0 con 0x7f4ff4103e00 2024-09-15T22:24:11.770 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:11.487+0000 7fc6f2969040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:24:11.770 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:11.630+0000 7fc6f2969040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:24:11.770 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:11.768+0000 7fc6f2969040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:24:11.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:11.936+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4ff4062630 con 0x7f4fd8039500 2024-09-15T22:24:12.331 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:12.079+0000 7fc6f2969040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:24:12.331 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:12.139+0000 7fc6f2969040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:24:12.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: Deploying daemon mgr.y on smithi110 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:24:12.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: Deploying daemon mgr.y on smithi110 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:24:12.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: Deploying daemon mgr.y on smithi110 2024-09-15T22:24:12.533 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:24:12.534 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:24:12.534 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:12.602 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:12.329+0000 7fc6f2969040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:24:13.183 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:12 smithi110 systemd[1]: Starting Ceph mgr.y for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:24:13.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-mon[35282]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:13.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-mon[35282]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:13.456 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 podman[36632]: 2024-09-15 22:24:13.084755735 +0000 UTC m=+0.015669998 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:24:13.456 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 podman[36632]: 2024-09-15 22:24:13.184305989 +0000 UTC m=+0.115220240 container create b8ab4bbf1cf1e52c65d7b73c8f133ffa754fbe99a967304363632d4944813888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:24:13.456 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 podman[36632]: 2024-09-15 22:24:13.395005744 +0000 UTC m=+0.325919994 container init b8ab4bbf1cf1e52c65d7b73c8f133ffa754fbe99a967304363632d4944813888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:24:13.456 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 podman[36632]: 2024-09-15 22:24:13.3984712 +0000 UTC m=+0.329385450 container start b8ab4bbf1cf1e52c65d7b73c8f133ffa754fbe99a967304363632d4944813888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:24:13.456 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-mgr[36651]: -- 172.21.15.110:0/459508918 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7641850e0 con 0x55a764162800 2024-09-15T22:24:13.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:13 smithi022 ceph-mon[30634]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:13.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:13 smithi022 ceph-mon[30634]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:13.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:13 smithi112 ceph-mon[35032]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:13.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:13 smithi112 ceph-mon[35032]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:13.603 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:13.253+0000 7fc6f2969040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:24:13.603 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:13.322+0000 7fc6f2969040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:24:13.802 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 bash[36632]: b8ab4bbf1cf1e52c65d7b73c8f133ffa754fbe99a967304363632d4944813888 2024-09-15T22:24:13.802 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 systemd[1]: Started Ceph mgr.y for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:24:13.802 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:13.517+0000 7f66675eb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:24:13.802 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:13.578+0000 7f66675eb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:24:13.802 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:13.730+0000 7f66675eb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:24:13.802 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:13.800+0000 7f66675eb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:24:14.114 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:13 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:13.952+0000 7f66675eb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:24:14.114 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:14.112+0000 7f66675eb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:24:14.334 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.074+0000 7fc6f2969040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:24:14.334 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.199+0000 7fc6f2969040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:24:14.598 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:14.598 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.343+0000 7fc6f2969040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.407+0000 7fc6f2969040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:24:14.599 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.563+0000 7fc6f2969040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:24:14.691 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:14.691 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.691 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.691 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.691 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:14.692 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:14.692 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:14.436+0000 7f66675eb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:24:14.692 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:14.496+0000 7f66675eb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:24:14.852 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.632+0000 7fc6f2969040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:24:14.852 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.693+0000 7fc6f2969040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:24:14.955 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:14 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:14.689+0000 7f66675eb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:24:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:15.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.150 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.871+0000 7fc6f2969040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:24:15.150 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:14.938+0000 7fc6f2969040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:24:15.150 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:15.004+0000 7fc6f2969040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:24:15.150 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:15.088+0000 7fc6f2969040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:24:15.150 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:15.148+0000 7fc6f2969040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:24:15.602 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:15.210+0000 7fc6f2969040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:24:15.955 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:15.578+0000 7f66675eb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:24:15.955 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:15.644+0000 7f66675eb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:24:15.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/135175799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]: dispatch 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]: dispatch 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]': finished 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:15.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:15.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:15.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:15 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/677077533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.993 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/135175799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]: dispatch 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]: dispatch 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]': finished 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:15.994 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/677077533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:24:16.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:16.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/135175799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa244aa0-6f2d-4a42-9b2a-09f860eb8225"}]': finished 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:16.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:16.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:16.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:15 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/677077533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:24:16.352 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:24:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z[36836]: 2024-09-15T22:24:15.991+0000 7fc6f2969040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:24:16.608 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.353+0000 7f66675eb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:24:16.608 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.466+0000 7f66675eb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:24:16.608 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.606+0000 7f66675eb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:24:16.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:16.700+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f4fe4018b30 con 0x7f4ff4103e00 2024-09-15T22:24:16.883 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-mon[35282]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-mon[35282]: Standby manager daemon z started 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.666+0000 7f66675eb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.815+0000 7f66675eb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:24:16.884 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.881+0000 7f66675eb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:24:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:16 smithi022 ceph-mon[30634]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:16 smithi022 ceph-mon[30634]: Standby manager daemon z started 2024-09-15T22:24:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:16 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:24:17.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:16 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:24:17.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:16 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:24:17.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:16 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:24:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:16 smithi112 ceph-mon[35032]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:16 smithi112 ceph-mon[35032]: Standby manager daemon z started 2024-09-15T22:24:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:16 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:24:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:16 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:24:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:16 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:24:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:16 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.112:0/2730468314' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:24:17.162 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:16.941+0000 7f66675eb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:24:17.162 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:17.096+0000 7f66675eb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:24:17.162 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:17.160+0000 7f66675eb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:24:17.425 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:17.226+0000 7f66675eb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:24:17.426 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:17.306+0000 7f66675eb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:24:17.426 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:17.365+0000 7f66675eb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:24:17.426 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:17.423+0000 7f66675eb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:24:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-mon[35282]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:24:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:17 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:24:18.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:17 smithi022 ceph-mon[30634]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:24:18.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:17 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:24:18.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:17 smithi112 ceph-mon[35032]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:24:18.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:17 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:24:18.455 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y[36647]: 2024-09-15T22:24:18.202+0000 7f66675eb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:24:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:18.712+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mon.2 v2:172.21.15.110:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f4fe4010430 con 0x7f4ff4103e00 2024-09-15T22:24:19.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:18 smithi022 ceph-mon[30634]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:19.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:18 smithi022 ceph-mon[30634]: Standby manager daemon y started 2024-09-15T22:24:19.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:18 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:24:19.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:18 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:24:19.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:18 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:24:19.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:18 smithi022 ceph-mon[30634]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:24:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:18 smithi112 ceph-mon[35032]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:18 smithi112 ceph-mon[35032]: Standby manager daemon y started 2024-09-15T22:24:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:18 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:24:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:18 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:24:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:18 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:24:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:18 smithi112 ceph-mon[35032]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:24:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-mon[35282]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-mon[35282]: Standby manager daemon y started 2024-09-15T22:24:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:24:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:24:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:24:19.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:18 smithi110 ceph-mon[35282]: from='mgr.? 172.21.15.110:0/3704887244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:24:20.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:19 smithi022 ceph-mon[30634]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:24:20.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:24:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:19 smithi112 ceph-mon[35032]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:24:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:24:20.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:19 smithi110 ceph-mon[35282]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:24:20.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:24:21.003 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:20 smithi112 ceph-mon[35032]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:21.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:20 smithi022 ceph-mon[30634]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:21.106 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:20 smithi110 ceph-mon[35282]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:22 smithi022 ceph-mon[30634]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:23.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:22 smithi112 ceph-mon[35032]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:23.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:22 smithi110 ceph-mon[35282]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:25.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:24 smithi022 ceph-mon[30634]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:25.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:24:25.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:25.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:24 smithi022 ceph-mon[30634]: Deploying daemon osd.0 on smithi022 2024-09-15T22:24:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:24 smithi112 ceph-mon[35032]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:24:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:24 smithi112 ceph-mon[35032]: Deploying daemon osd.0 on smithi022 2024-09-15T22:24:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:24 smithi110 ceph-mon[35282]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:24:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:24 smithi110 ceph-mon[35282]: Deploying daemon osd.0 on smithi022 2024-09-15T22:24:26.986 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:26 smithi022 ceph-mon[30634]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:26 smithi112 ceph-mon[35032]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:26 smithi110 ceph-mon[35282]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:29.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:28 smithi022 ceph-mon[30634]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:28 smithi112 ceph-mon[35032]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:29.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:28 smithi110 ceph-mon[35282]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:30.986 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:30 smithi022 ceph-mon[30634]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:31.053 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:30 smithi112 ceph-mon[35032]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:31.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:30 smithi110 ceph-mon[35282]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:32.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:32 smithi022 ceph-mon[30634]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:32.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:32.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:32.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:33.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:32 smithi112 ceph-mon[35032]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:33.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:33.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:33.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:32 smithi110 ceph-mon[35282]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:33.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:33.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:34.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:34 smithi022 ceph-mon[30634]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:34.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:34.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:34.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:34.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:34.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:35.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:34 smithi112 ceph-mon[35032]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:35.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:35.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:35.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:35.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:35.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:35.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:34 smithi110 ceph-mon[35282]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:35.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:35.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:35.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:35.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:35.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:36.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:36 smithi022 ceph-mon[30634]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:37.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.012+0000 7f4ff1600640 1 -- 172.21.15.22:0/2721831495 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4ff4062630 con 0x7f4fd8039500 2024-09-15T22:24:37.014 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2024-09-15T22:24:37.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.015+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4fd8039500 msgr2=0x7f4fd803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.015+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4fd8039500 0x7f4fd803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ff419b5b0 tx=0x7f4fdc005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:37.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 msgr2=0x7f4ff419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:37.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a090 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e9f0 tx=0x7f4fe400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 shutdown_connections 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4fd8039500 0x7f4fd803b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 --2- 172.21.15.22:0/2721831495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a090 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 >> 172.21.15.22:0/2721831495 conn(0x7f4ff40ff5b0 msgr2=0x7f4ff41082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 shutdown_connections 2024-09-15T22:24:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:24:37.016+0000 7f4ffaa00640 1 -- 172.21.15.22:0/2721831495 wait complete. 2024-09-15T22:24:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:36 smithi112 ceph-mon[35032]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:37.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:36 smithi110 ceph-mon[35282]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:37.783 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T22:24:37.787 INFO:tasks.cephadm:Deploying osd.1 on smithi110 with /dev/vg_nvme/lv_4... 2024-09-15T22:24:37.787 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:24:38.008 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:38.008 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:38.008 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:38.035 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:24:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:38.156 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:38.157 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:38.157 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:39.016 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:24:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0[44625]: 2024-09-15T22:24:38.652+0000 7f5a2aa3c640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:24:39.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:39 smithi022 ceph-mon[30634]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:39.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:39 smithi022 ceph-mon[30634]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:24:39.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:39 smithi110 ceph-mon[35282]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:39.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:39 smithi110 ceph-mon[35282]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:24:39.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:39 smithi112 ceph-mon[35032]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:39.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:39 smithi112 ceph-mon[35032]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:24:40.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-mon[30634]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:24:40.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-mon[30634]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:24:40.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-mon[30634]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:24:40.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:40.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-mon[30634]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:24:40.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-mon[30634]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:24:40.302 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:40 smithi110 ceph-mon[35282]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:24:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:40 smithi110 ceph-mon[35282]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:24:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:40 smithi110 ceph-mon[35282]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:24:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:40 smithi110 ceph-mon[35282]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:24:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:40 smithi110 ceph-mon[35282]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:24:40.305 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:24:40.331 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_4 2024-09-15T22:24:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:40 smithi112 ceph-mon[35032]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:24:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:40 smithi112 ceph-mon[35032]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:24:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:40 smithi112 ceph-mon[35032]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:24:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:40 smithi112 ceph-mon[35032]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:24:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:40 smithi112 ceph-mon[35032]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:24:40.578 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:24:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 -- 172.21.15.110:0/631138521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 msgr2=0x7f5e94074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 --2- 172.21.15.110:0/631138521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e94074620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009900 tx=0x7f5e8402a480 comp rx=0 tx=0).stop 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 -- 172.21.15.110:0/631138521 shutdown_connections 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 --2- 172.21.15.110:0/631138521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94074bf0 0x7f5e94075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 --2- 172.21.15.110:0/631138521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e94109a90 0x7f5e9410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 --2- 172.21.15.110:0/631138521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e94074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 -- 172.21.15.110:0/631138521 >> 172.21.15.110:0/631138521 conn(0x7f5e940fd3c0 msgr2=0x7f5e940ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 -- 172.21.15.110:0/631138521 shutdown_connections 2024-09-15T22:24:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.989+0000 7f5e9b994640 1 -- 172.21.15.110:0/631138521 wait complete. 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 Processor -- start 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 -- start start 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e94074bf0 0x7f5e9419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e9419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94109a90 0x7f5e941a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9410fad0 con 0x7f5e94074bf0 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9410f950 con 0x7f5e940761c0 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e9b994640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9410fc50 con 0x7f5e94109a90 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e9419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e9419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45588/0 (socket says 172.21.15.110:45588) 2024-09-15T22:24:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 -- 172.21.15.110:0/1803883618 learned_addr learned my addr 172.21.15.110:0/1803883618 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e99f31640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94109a90 0x7f5e941a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 -- 172.21.15.110:0/1803883618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94109a90 msgr2=0x7f5e941a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94109a90 0x7f5e941a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 -- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e94074bf0 msgr2=0x7f5e9419a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e94074bf0 0x7f5e9419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e98f2f640 1 -- 172.21.15.110:0/1803883618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e941a1d80 con 0x7f5e940761c0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.990+0000 7f5e99f31640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94109a90 0x7f5e941a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.991+0000 7f5e98f2f640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e9419a690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000d950 tx=0x7f5e9000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.991+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90017030 con 0x7f5e940761c0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.991+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e90004020 con 0x7f5e940761c0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.991+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e941a2070 con 0x7f5e940761c0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.991+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e900047a0 con 0x7f5e940761c0 2024-09-15T22:24:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.991+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e941a2600 con 0x7f5e940761c0 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.992+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e94108850 con 0x7f5e940761c0 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.993+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f5e900041d0 con 0x7f5e940761c0 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.994+0000 7f5e8a7fc640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5e800a3260 0x7f5e800a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.994+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f5e900cdee0 con 0x7f5e940761c0 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.995+0000 7f5e99730640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5e800a3260 0x7f5e800a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.995+0000 7f5e99730640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5e800a3260 0x7f5e800a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e840096c0 tx=0x7f5e84031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:40.997+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e9009c770 con 0x7f5e940761c0 2024-09-15T22:24:41.025 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0[44625]: 2024-09-15T22:24:40.943+0000 7f5a24800640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:24:41.025 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:24:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0[44625]: 2024-09-15T22:24:40.955+0000 7f5a1b200640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:24:41.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:41 smithi110 ceph-mon[35282]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:41.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:41.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:41.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:41 smithi110 ceph-mon[35282]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' 2024-09-15T22:24:41.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:24:41.226+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5e94062630 con 0x7f5e800a3260 2024-09-15T22:24:41.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:41 smithi022 ceph-mon[30634]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:41.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:41.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:41.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:41 smithi022 ceph-mon[30634]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' 2024-09-15T22:24:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:41 smithi112 ceph-mon[35032]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:41 smithi112 ceph-mon[35032]: from='osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806]' entity='osd.0' 2024-09-15T22:24:42.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:24:42.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:24:42.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:42.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:42.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:24:42.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:24:42.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:42.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:24:42.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:42.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:42.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] boot 2024-09-15T22:24:42.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:24:42.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:24:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:42.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:42.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] boot 2024-09-15T22:24:42.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:24:42.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:42.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:24:42.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:24:42.354 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:42.355 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:42.356 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: osd.0 [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] boot 2024-09-15T22:24:42.356 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:24:42.356 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:24:43.173 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:43 smithi110 ceph-mon[35282]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:43.173 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:43 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi022 2024-09-15T22:24:43.173 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:43 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi022 to 17094M 2024-09-15T22:24:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:43 smithi112 ceph-mon[35032]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:43 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi022 2024-09-15T22:24:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:43 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi022 to 17094M 2024-09-15T22:24:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:43 smithi022 ceph-mon[30634]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:24:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:43 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi022 2024-09-15T22:24:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:43 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi022 to 17094M 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/2614708153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]: dispatch 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]: dispatch 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]': finished 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:24:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:44 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/730945089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:24:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:24:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/2614708153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]: dispatch 2024-09-15T22:24:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]: dispatch 2024-09-15T22:24:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]': finished 2024-09-15T22:24:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:24:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:24:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:44 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/730945089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:24:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:24:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/2614708153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]: dispatch 2024-09-15T22:24:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]: dispatch 2024-09-15T22:24:44.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce9db823-3025-4c1c-ad9f-30f700ded503"}]': finished 2024-09-15T22:24:44.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:24:44.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:24:44.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:44 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/730945089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:24:45.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:45 smithi112 ceph-mon[35032]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:45 smithi110 ceph-mon[35282]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:45 smithi022 ceph-mon[30634]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:47.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:47 smithi112 ceph-mon[35032]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:47 smithi110 ceph-mon[35282]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:47 smithi022 ceph-mon[30634]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:49 smithi110 ceph-mon[35282]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:49.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:49 smithi112 ceph-mon[35032]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:49.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:49 smithi022 ceph-mon[30634]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:51.298 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:51 smithi110 ceph-mon[35282]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:51.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:51 smithi112 ceph-mon[35032]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:51 smithi022 ceph-mon[30634]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:52.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:52 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:24:52.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:52 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:52.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:24:52.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:52.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:24:52.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:53.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:53 smithi110 ceph-mon[35282]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:53.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:53 smithi110 ceph-mon[35282]: Deploying daemon osd.1 on smithi110 2024-09-15T22:24:53.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:53 smithi112 ceph-mon[35032]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:53.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:53 smithi112 ceph-mon[35032]: Deploying daemon osd.1 on smithi110 2024-09-15T22:24:53.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:53 smithi022 ceph-mon[30634]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:53.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:53 smithi022 ceph-mon[30634]: Deploying daemon osd.1 on smithi110 2024-09-15T22:24:55.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:55 smithi112 ceph-mon[35032]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:55.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:55 smithi110 ceph-mon[35282]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:55 smithi022 ceph-mon[30634]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:57.204 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:57 smithi110 ceph-mon[35282]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:57.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:57 smithi112 ceph-mon[35032]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:57.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:57 smithi022 ceph-mon[30634]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:58.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:58.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:58.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:58.353 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:58.353 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:58.353 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:58.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:58.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:58.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:24:59.204 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:24:59 smithi110 ceph-mon[35282]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:59.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:24:59 smithi112 ceph-mon[35032]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:24:59.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:24:59 smithi022 ceph-mon[30634]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:01.023 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 1 on host 'smithi110' 2024-09-15T22:25:01.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.020+0000 7f5e8a7fc640 1 -- 172.21.15.110:0/1803883618 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e94062630 con 0x7f5e800a3260 2024-09-15T22:25:01.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5e800a3260 msgr2=0x7f5e800a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5e800a3260 0x7f5e800a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e840096c0 tx=0x7f5e84031400 comp rx=0 tx=0).stop 2024-09-15T22:25:01.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 msgr2=0x7f5e9419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e9419a690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000d950 tx=0x7f5e9000de10 comp rx=0 tx=0).stop 2024-09-15T22:25:01.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 shutdown_connections 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e94109a90 0x7f5e941a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5e800a3260 0x7f5e800a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e940761c0 0x7f5e9419a690 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 --2- 172.21.15.110:0/1803883618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e94074bf0 0x7f5e9419a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 >> 172.21.15.110:0/1803883618 conn(0x7f5e940fd3c0 msgr2=0x7f5e94105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 shutdown_connections 2024-09-15T22:25:01.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:01.023+0000 7f5e9b994640 1 -- 172.21.15.110:0/1803883618 wait complete. 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:01.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.602 DEBUG:teuthology.orchestra.run.smithi110:osd.1> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T22:25:01.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:01.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:01.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:01.606 INFO:tasks.cephadm:Deploying osd.2 on smithi112 with /dev/vg_nvme/lv_4... 2024-09-15T22:25:01.606 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:25:01.856 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:25:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:03 smithi110 ceph-mon[35282]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:03 smithi112 ceph-mon[35032]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:03.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:03 smithi022 ceph-mon[30634]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:04.142 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1[39776]: 2024-09-15T22:25:04.050+0000 7f1ba9597640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:25:04.168 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:04 smithi112 ceph-mon[35032]: from='osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:25:04.169 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:04 smithi112 ceph-mon[35032]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:25:04.172 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:25:04.204 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-09-15T22:25:04.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:04 smithi110 ceph-mon[35282]: from='osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:25:04.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:04 smithi110 ceph-mon[35282]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:25:04.458 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:25:04.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:04 smithi022 ceph-mon[30634]: from='osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:25:04.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:04 smithi022 ceph-mon[30634]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:25:04.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1678340267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc100ad0 msgr2=0x7f2acc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:04.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1678340267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc100ad0 0x7f2acc100ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009900 tx=0x7f2ac802a410 comp rx=0 tx=0).stop 2024-09-15T22:25:04.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1678340267 shutdown_connections 2024-09-15T22:25:04.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1678340267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2acc102690 0x7f2acc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1678340267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc101cd0 0x7f2acc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1678340267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc100ad0 0x7f2acc100ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1678340267 >> 172.21.15.112:0/1678340267 conn(0x7f2acc0fc280 msgr2=0x7f2acc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1678340267 shutdown_connections 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.896+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1678340267 wait complete. 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 Processor -- start 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 -- start start 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2acc100ad0 0x7f2acc06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 0x7f2acc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102690 0x7f2acc19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10c830 con 0x7f2acc102690 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10c6b0 con 0x7f2acc100ad0 2024-09-15T22:25:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad42d6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc10c9b0 con 0x7f2acc101cd0 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad1871640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 0x7f2acc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad2072640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2acc100ad0 0x7f2acc06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad1871640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 0x7f2acc19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56330/0 (socket says 172.21.15.112:56330) 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.897+0000 7f2ad1871640 1 -- 172.21.15.112:0/1477946463 learned_addr learned my addr 172.21.15.112:0/1477946463 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad1871640 1 -- 172.21.15.112:0/1477946463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2acc100ad0 msgr2=0x7f2acc06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad1871640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2acc100ad0 0x7f2acc06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad1871640 1 -- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102690 msgr2=0x7f2acc19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad1871640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102690 0x7f2acc19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad1871640 1 -- 172.21.15.112:0/1477946463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc19fcd0 con 0x7f2acc101cd0 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad1871640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 0x7f2acc19cda0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b4a0 tx=0x7f2abc00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc014070 con 0x7f2acc101cd0 2024-09-15T22:25:04.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2abc010af0 con 0x7f2acc101cd0 2024-09-15T22:25:04.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc19ff60 con 0x7f2acc101cd0 2024-09-15T22:25:04.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc017d10 con 0x7f2acc101cd0 2024-09-15T22:25:04.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.898+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc1a04e0 con 0x7f2acc101cd0 2024-09-15T22:25:04.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.899+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc107f10 con 0x7f2acc101cd0 2024-09-15T22:25:04.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.901+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f2abc017070 con 0x7f2acc101cd0 2024-09-15T22:25:04.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.902+0000 7f2ac37fe640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2ab80a32b0 0x7f2ab80a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:04.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.902+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f2abc0cd320 con 0x7f2acc101cd0 2024-09-15T22:25:04.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.902+0000 7f2ad2072640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2ab80a32b0 0x7f2ab80a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:04.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.903+0000 7f2ad2072640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2ab80a32b0 0x7f2ab80a5770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8005ab0 tx=0x7f2ac8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:04.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:04.905+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2abc09b990 con 0x7f2acc101cd0 2024-09-15T22:25:05.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:05.080+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2acc062630 con 0x7f2ab80a32b0 2024-09-15T22:25:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:25:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:25:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:25:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi110 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi110 to 17088M 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:25:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:25:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:25:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:25:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:25:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi110 2024-09-15T22:25:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:25:05.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi110 to 17088M 2024-09-15T22:25:05.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:05.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:05.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:25:05.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:25:05.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:25:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi110 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi110 to 17088M 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:05.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:05.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:25:05.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:25:05.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:06.153 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1[39776]: 2024-09-15T22:25:05.802+0000 7f1ba4cf7640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:25:06.154 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1[39776]: 2024-09-15T22:25:05.805+0000 7f1b9d329640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:25:06.440 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:06 smithi112 ceph-mon[35032]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:25:06.440 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:06 smithi112 ceph-mon[35032]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:25:06.440 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:06 smithi112 ceph-mon[35032]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:25:06.440 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:06.440 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:06.440 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:06 smithi112 ceph-mon[35032]: from='osd.1 ' entity='osd.1' 2024-09-15T22:25:06.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:06 smithi110 ceph-mon[35282]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:25:06.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:06 smithi110 ceph-mon[35282]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:25:06.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:06 smithi110 ceph-mon[35282]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:25:06.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:06.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:06.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:06 smithi110 ceph-mon[35282]: from='osd.1 ' entity='osd.1' 2024-09-15T22:25:06.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:06 smithi022 ceph-mon[30634]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:25:06.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:06 smithi022 ceph-mon[30634]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:25:06.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:06 smithi022 ceph-mon[30634]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:25:06.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:06.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:06.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:06 smithi022 ceph-mon[30634]: from='osd.1 ' entity='osd.1' 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] boot 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:25:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:25:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:25:07.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:07.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:07.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] boot 2024-09-15T22:25:07.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:25:07.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:25:07.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:25:07.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:25:07.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:07.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: osd.1 [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] boot 2024-09-15T22:25:07.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:25:07.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:25:08.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:08 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/660439253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]: dispatch 2024-09-15T22:25:08.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:08 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]: dispatch 2024-09-15T22:25:08.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:08 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]': finished 2024-09-15T22:25:08.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:08 smithi022 ceph-mon[30634]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:25:08.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:08.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:08 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/3988882057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:25:08.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:08 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/660439253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]: dispatch 2024-09-15T22:25:08.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:08 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]: dispatch 2024-09-15T22:25:08.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:08 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]': finished 2024-09-15T22:25:08.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:08 smithi110 ceph-mon[35282]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:25:08.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:08.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:08 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/3988882057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:25:08.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:08 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/660439253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]: dispatch 2024-09-15T22:25:08.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:08 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]: dispatch 2024-09-15T22:25:08.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:08 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15d10045-c544-42a2-b986-99217d81c454"}]': finished 2024-09-15T22:25:08.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:08 smithi112 ceph-mon[35032]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:25:08.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:08.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:08 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/3988882057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:25:09.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:09 smithi022 ceph-mon[30634]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:09.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:09 smithi112 ceph-mon[35032]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:09 smithi110 ceph-mon[35282]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:11.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:11 smithi112 ceph-mon[35032]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:11 smithi110 ceph-mon[35282]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:11 smithi022 ceph-mon[30634]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:13.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:13 smithi112 ceph-mon[35032]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:13 smithi110 ceph-mon[35282]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:13.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:13 smithi022 ceph-mon[30634]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:15.409 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:15 smithi112 ceph-mon[35032]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:15 smithi110 ceph-mon[35282]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:15 smithi022 ceph-mon[30634]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:16.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:16 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:25:16.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:16 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:16.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:16 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:25:16.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:16 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:16.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:16 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:25:16.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:16 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:17.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:17 smithi112 ceph-mon[35032]: Deploying daemon osd.2 on smithi112 2024-09-15T22:25:17.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:17 smithi112 ceph-mon[35032]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:17 smithi110 ceph-mon[35282]: Deploying daemon osd.2 on smithi112 2024-09-15T22:25:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:17 smithi110 ceph-mon[35282]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:17 smithi022 ceph-mon[30634]: Deploying daemon osd.2 on smithi112 2024-09-15T22:25:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:17 smithi022 ceph-mon[30634]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:19.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:19 smithi112 ceph-mon[35032]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:19 smithi110 ceph-mon[35282]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:19.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:19 smithi022 ceph-mon[30634]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:21 smithi112 ceph-mon[35032]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:21.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:21 smithi110 ceph-mon[35282]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:21 smithi022 ceph-mon[30634]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:22.420 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:22 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:22.421 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:22 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:22.421 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:22 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:22.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:22 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:22.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:22 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:22.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:22 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:22 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:22 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:22 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:23.593 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:23 smithi112 ceph-mon[35032]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:23.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:23 smithi110 ceph-mon[35282]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:23 smithi022 ceph-mon[30634]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:25.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:25 smithi112 ceph-mon[35032]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:25.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:25.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:25.442 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:25 smithi022 ceph-mon[30634]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:25.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:25 smithi110 ceph-mon[35282]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:25.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:25.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:25.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.749+0000 7f2ac37fe640 1 -- 172.21.15.112:0/1477946463 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2acc062630 con 0x7f2ab80a32b0 2024-09-15T22:25:25.751 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 2 on host 'smithi112' 2024-09-15T22:25:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2ab80a32b0 msgr2=0x7f2ab80a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2ab80a32b0 0x7f2ab80a5770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8005ab0 tx=0x7f2ac8000bc0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 msgr2=0x7f2acc19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 0x7f2acc19cda0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b4a0 tx=0x7f2abc00b960 comp rx=0 tx=0).stop 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 shutdown_connections 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2acc101cd0 0x7f2acc19cda0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2ab80a32b0 0x7f2ab80a5770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102690 0x7f2acc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 --2- 172.21.15.112:0/1477946463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2acc100ad0 0x7f2acc06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 >> 172.21.15.112:0/1477946463 conn(0x7f2acc0fc280 msgr2=0x7f2acc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 shutdown_connections 2024-09-15T22:25:25.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:25:25.751+0000 7f2ad42d6640 1 -- 172.21.15.112:0/1477946463 wait complete. 2024-09-15T22:25:26.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:26 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:26.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:26 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:26.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:26 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:26.381 DEBUG:teuthology.orchestra.run.smithi112:osd.2> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T22:25:26.384 INFO:tasks.cephadm:Deploying osd.3 on smithi022 with /dev/vg_nvme/lv_3... 2024-09-15T22:25:26.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:25:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:26 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:26 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:26 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:26.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:26 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:26.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:26 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:26.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:26 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:26.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:27 smithi022 ceph-mon[30634]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:27.537 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:27 smithi112 ceph-mon[35032]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:27.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:27 smithi110 ceph-mon[35282]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:27.822 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2[40002]: 2024-09-15T22:25:27.535+0000 7fdd30c63640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:25:28.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:28 smithi022 ceph-mon[30634]: from='osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:25:28.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:28 smithi022 ceph-mon[30634]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:25:28.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:28 smithi112 ceph-mon[35032]: from='osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:25:28.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:28 smithi112 ceph-mon[35032]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:25:28.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:28 smithi110 ceph-mon[35282]: from='osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:25:28.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:28 smithi110 ceph-mon[35282]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:25:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:25:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:25:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:29.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:29 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:25:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:25:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:25:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:29.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:29 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:29.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:25:29.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:25:29.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:29.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:29 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:25:29.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-09-15T22:25:30.277 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:30.352 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2[40002]: 2024-09-15T22:25:30.024+0000 7fdd2d3fa640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:25:30.352 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2[40002]: 2024-09-15T22:25:30.028+0000 7fdd249f5640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:25:30.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi112 2024-09-15T22:25:30.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-15T22:25:30.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:25:30.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:25:30.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:30.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:30.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:30 smithi112 ceph-mon[35032]: from='osd.2 ' entity='osd.2' 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi112 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:30.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:30 smithi022 ceph-mon[30634]: from='osd.2 ' entity='osd.2' 2024-09-15T22:25:30.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi112 2024-09-15T22:25:30.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-15T22:25:30.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:25:30.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:25:30.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:30.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:30.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:30 smithi110 ceph-mon[35282]: from='osd.2 ' entity='osd.2' 2024-09-15T22:25:30.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2979303416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 msgr2=0x7fd8bc10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2979303416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc10c240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009ca0 tx=0x7fd8b402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2979303416 shutdown_connections 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2979303416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc104f60 0x7fd8bc1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2979303416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc10c240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2979303416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc103e00 0x7fd8bc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2979303416 >> 172.21.15.22:0/2979303416 conn(0x7fd8bc0ff5b0 msgr2=0x7fd8bc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2979303416 shutdown_connections 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.839+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2979303416 wait complete. 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 Processor -- start 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 -- start start 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 0x7fd8bc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc104f60 0x7fd8bc19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc10fab0 con 0x7fd8bc105920 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc10f930 con 0x7fd8bc104f60 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc10fc30 con 0x7fd8bc103e00 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.840+0000 7fd8c1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 0x7fd8bc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 0x7fd8bc19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:39152/0 (socket says 172.21.15.22:39152) 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 -- 172.21.15.22:0/2333366111 learned_addr learned my addr 172.21.15.22:0/2333366111 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8b3e00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc104f60 0x7fd8bc19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 -- 172.21.15.22:0/2333366111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc104f60 msgr2=0x7fd8bc19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc104f60 0x7fd8bc19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:30.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 -- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 msgr2=0x7fd8bc1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 -- 172.21.15.22:0/2333366111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc1a1cb0 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8b3e00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc104f60 0x7fd8bc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.841+0000 7fd8c1200640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 0x7fd8bc19a080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00ea60 tx=0x7fd8ac00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.842+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00cde0 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.842+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8bc1a1fa0 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.842+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8ac0035f0 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.842+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac010670 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.842+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8bc1a2450 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.843+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc10b120 con 0x7fd8bc103e00 2024-09-15T22:25:30.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.845+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fd8ac0037a0 con 0x7fd8bc103e00 2024-09-15T22:25:30.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.846+0000 7fd8ba000640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd8a00a3260 0x7fd8a00a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:30.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.846+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fd8ac0ce850 con 0x7fd8bc103e00 2024-09-15T22:25:30.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.846+0000 7fd8b3e00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd8a00a3260 0x7fd8a00a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:30.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.847+0000 7fd8b3e00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd8a00a3260 0x7fd8a00a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc19b5a0 tx=0x7fd8a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:30.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:30.848+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8ac09cc20 con 0x7fd8bc103e00 2024-09-15T22:25:31.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:31.045+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd8bc062630 con 0x7fd8a00a3260 2024-09-15T22:25:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:25:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:25:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] boot 2024-09-15T22:25:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T22:25:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:25:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:25:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:31 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:25:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:25:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] boot 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:25:31.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:31 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:31.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:25:31.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:25:31.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:25:31.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:31.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: osd.2 [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] boot 2024-09-15T22:25:31.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T22:25:31.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:25:31.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:25:31.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:25:31.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:31 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:32 smithi022 ceph-mon[30634]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:25:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:32.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:32 smithi112 ceph-mon[35032]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:25:32.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:32.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:32 smithi110 ceph-mon[35282]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:25:32.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:33.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:33 smithi112 ceph-mon[35032]: pgmap v78: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:33.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:33 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:33.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:33 smithi112 ceph-mon[35032]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:25:33.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:33 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:33 smithi022 ceph-mon[30634]: pgmap v78: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:33 smithi022 ceph-mon[30634]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:25:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:33 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:33.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:33 smithi110 ceph-mon[35282]: pgmap v78: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:33.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:33 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:33.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:33 smithi110 ceph-mon[35282]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:25:33.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:33 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:34.282 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:33 smithi022 sudo[49502]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:25:34.282 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:33 smithi022 sudo[49502]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:34.282 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:33 smithi022 sudo[49502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:34.282 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:33 smithi022 sudo[49502]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:34.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:34.300+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd8ac098b90 con 0x7fd8bc103e00 2024-09-15T22:25:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:34 smithi112 ceph-mon[35032]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:25:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:34 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/26057288' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22c855e6-5548-457e-8a07-3f65c3c9189c"}]: dispatch 2024-09-15T22:25:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:34 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/26057288' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22c855e6-5548-457e-8a07-3f65c3c9189c"}]': finished 2024-09-15T22:25:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:34 smithi112 ceph-mon[35032]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:25:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:25:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:34 smithi110 ceph-mon[35282]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:25:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:34 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/26057288' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22c855e6-5548-457e-8a07-3f65c3c9189c"}]: dispatch 2024-09-15T22:25:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:34 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/26057288' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22c855e6-5548-457e-8a07-3f65c3c9189c"}]': finished 2024-09-15T22:25:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:34 smithi110 ceph-mon[35282]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:25:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:25:34.782 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:34 smithi022 sudo[49519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:25:34.782 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:34 smithi022 sudo[49519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:34.782 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:34 smithi022 sudo[49519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:34.782 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:25:34 smithi022 sudo[49519]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:34 smithi022 ceph-mon[30634]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:25:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:34 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/26057288' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22c855e6-5548-457e-8a07-3f65c3c9189c"}]: dispatch 2024-09-15T22:25:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:34 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/26057288' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22c855e6-5548-457e-8a07-3f65c3c9189c"}]': finished 2024-09-15T22:25:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:34 smithi022 ceph-mon[30634]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:25:34.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:25:35.063 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:34 smithi110 sudo[43494]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:25:35.064 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:34 smithi110 sudo[43494]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:35.064 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:34 smithi110 sudo[43494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:35.064 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:34 smithi110 sudo[43494]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:35.455 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:35 smithi110 sudo[43497]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:25:35.455 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:35 smithi110 sudo[43497]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:35.456 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:35 smithi110 sudo[43497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:35.456 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:25:35 smithi110 sudo[43497]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:35.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:35 smithi110 ceph-mon[35282]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:35.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:35 smithi110 ceph-mon[35282]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:25:35.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:35 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:35.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:35 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1664759467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:25:35.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:35 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:35.588 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:25:35.589 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:35.589 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:35.589 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44076]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:35.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:35 smithi112 ceph-mon[35032]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:35.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:35 smithi112 ceph-mon[35032]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:25:35.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:35 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:35.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:35 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1664759467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:25:35.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:35 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:35 smithi022 ceph-mon[30634]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:35 smithi022 ceph-mon[30634]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:25:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:35 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:35 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1664759467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:25:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:35 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:35.852 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44079]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:25:35.852 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44079]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:35.852 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:35.852 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:25:35 smithi112 sudo[44079]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:25:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49781]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49977]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:25:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49977]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 sudo[49977]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:36 smithi022 ceph-mon[30634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:37.044 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:37.044 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:36 smithi112 ceph-mon[35032]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:37.044 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:25:37.044 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:37.044 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:37.045 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44082]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:37.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:37.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:36 smithi110 ceph-mon[35282]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:37.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44085]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:25:37.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:37.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:37.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 sudo[44085]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:37.779 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43500]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:25:37.779 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43500]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:37.779 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:37.779 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43500]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:37 smithi112 ceph-mon[35032]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43503]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:25:38.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43503]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 sudo[43503]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:37 smithi110 ceph-mon[35282]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:25:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:25:38.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:25:38.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:25:38.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:37 smithi022 ceph-mon[30634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:25:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:38 smithi112 ceph-mon[35032]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:39.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:38 smithi022 ceph-mon[30634]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:39.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:38 smithi110 ceph-mon[35282]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:40 smithi112 ceph-mon[35032]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:41.183 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:40 smithi022 ceph-mon[30634]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:41.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:40 smithi110 ceph-mon[35282]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:43.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:42 smithi022 ceph-mon[30634]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:43.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:42 smithi112 ceph-mon[35032]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:43.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:42 smithi110 ceph-mon[35282]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:44.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:25:44.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:44.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:43 smithi112 ceph-mon[35032]: Deploying daemon osd.3 on smithi022 2024-09-15T22:25:44.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:25:44.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:44.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:43 smithi022 ceph-mon[30634]: Deploying daemon osd.3 on smithi022 2024-09-15T22:25:44.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:25:44.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:44.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:43 smithi110 ceph-mon[35282]: Deploying daemon osd.3 on smithi022 2024-09-15T22:25:45.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:44 smithi112 ceph-mon[35032]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:25:45.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:44 smithi110 ceph-mon[35282]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:25:45.216 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:44 smithi022 ceph-mon[30634]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:25:46.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:46 smithi022 ceph-mon[30634]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:25:47.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:46 smithi112 ceph-mon[35032]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:25:47.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:46 smithi110 ceph-mon[35282]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:25:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:48 smithi112 ceph-mon[35032]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:25:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:48 smithi110 ceph-mon[35282]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:25:49.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:48 smithi022 ceph-mon[30634]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:25:50.932 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:50 smithi022 ceph-mon[30634]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:50 smithi112 ceph-mon[35032]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:51.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:50 smithi110 ceph-mon[35282]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:52.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:52.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:52.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:52.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:52.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:52.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:52.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:51 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:52.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:51 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:52.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:51 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:53.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:53 smithi112 ceph-mon[35032]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:53 smithi110 ceph-mon[35282]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:53.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:53 smithi022 ceph-mon[30634]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:55.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:55 smithi022 ceph-mon[30634]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:55.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:55.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:55.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:55 smithi112 ceph-mon[35032]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:55 smithi110 ceph-mon[35282]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:25:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:55.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.868+0000 7fd8ba000640 1 -- 172.21.15.22:0/2333366111 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd8bc062630 con 0x7fd8a00a3260 2024-09-15T22:25:55.870 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 3 on host 'smithi022' 2024-09-15T22:25:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd8a00a3260 msgr2=0x7fd8a00a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd8a00a3260 0x7fd8a00a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc19b5a0 tx=0x7fd8a4005f90 comp rx=0 tx=0).stop 2024-09-15T22:25:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 msgr2=0x7fd8bc19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 0x7fd8bc19a080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00ea60 tx=0x7fd8ac00ef20 comp rx=0 tx=0).stop 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 shutdown_connections 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd8a00a3260 0x7fd8a00a5720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc105920 0x7fd8bc1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8bc104f60 0x7fd8bc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 --2- 172.21.15.22:0/2333366111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8bc103e00 0x7fd8bc19a080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.870+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 >> 172.21.15.22:0/2333366111 conn(0x7fd8bc0ff5b0 msgr2=0x7fd8bc1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.871+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 shutdown_connections 2024-09-15T22:25:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:25:55.871+0000 7fd8c3c00640 1 -- 172.21.15.22:0/2333366111 wait complete. 2024-09-15T22:25:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:56.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:56.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:56.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:56.650 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T22:25:56.655 INFO:tasks.cephadm:Deploying osd.4 on smithi110 with /dev/vg_nvme/lv_3... 2024-09-15T22:25:56.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:25:56.684 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:56.684 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:56.684 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:25:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:25:57.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:57 smithi022 ceph-mon[30634]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:57.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:57 smithi112 ceph-mon[35032]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:57.685 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:57 smithi110 ceph-mon[35282]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:57.854 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:25:57 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:25:57.712+0000 7fbf5548c640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:25:58.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:58 smithi022 ceph-mon[30634]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:25:58.389 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:58 smithi110 ceph-mon[35282]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:25:58.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:58 smithi112 ceph-mon[35032]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:25:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:25:59.254 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_3 2024-09-15T22:25:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:59 smithi110 ceph-mon[35282]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:59 smithi110 ceph-mon[35282]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:25:59.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:59 smithi110 ceph-mon[35282]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:25:59.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:59 smithi110 ceph-mon[35282]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:25:59.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:25:59 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:25:59.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:59 smithi022 ceph-mon[30634]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:59.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:59 smithi022 ceph-mon[30634]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:25:59.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:59 smithi022 ceph-mon[30634]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:25:59.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:59 smithi022 ceph-mon[30634]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:25:59.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:25:59 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:25:59.540 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:25:59.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:59 smithi112 ceph-mon[35032]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:25:59.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:59 smithi112 ceph-mon[35032]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:25:59.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:59 smithi112 ceph-mon[35032]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:25:59.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:59 smithi112 ceph-mon[35032]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:25:59.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:25:59 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:25:59.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 -- 172.21.15.110:0/2340837074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 msgr2=0x7fbf38100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 --2- 172.21.15.110:0/2340837074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38100ed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009900 tx=0x7fbf2802a410 comp rx=0 tx=0).stop 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 -- 172.21.15.110:0/2340837074 shutdown_connections 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 --2- 172.21.15.110:0/2340837074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf38102690 0x7fbf38108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 --2- 172.21.15.110:0/2340837074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 0x7fbf38102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 --2- 172.21.15.110:0/2340837074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38100ed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.978+0000 7fbf3db67640 1 -- 172.21.15.110:0/2340837074 >> 172.21.15.110:0/2340837074 conn(0x7fbf380fc280 msgr2=0x7fbf380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 -- 172.21.15.110:0/2340837074 shutdown_connections 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 -- 172.21.15.110:0/2340837074 wait complete. 2024-09-15T22:25:59.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 Processor -- start 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 -- start start 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 0x7fbf381030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.979+0000 7fbf3db67640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf38102690 0x7fbf381035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf3db67640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3810c730 con 0x7fbf38101cd0 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf3db67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3810c5b0 con 0x7fbf38100ad0 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf3db67640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3810c8b0 con 0x7fbf38102690 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:59.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47380/0 (socket says 172.21.15.110:47380) 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 -- 172.21.15.110:0/4235303556 learned_addr learned my addr 172.21.15.110:0/4235303556 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf37fff640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf38102690 0x7fbf381035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf36ffd640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 0x7fbf381030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 -- 172.21.15.110:0/4235303556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf38102690 msgr2=0x7fbf381035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf38102690 0x7fbf381035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 -- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 msgr2=0x7fbf381030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 0x7fbf381030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 -- 172.21.15.110:0/4235303556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf38103eb0 con 0x7fbf38100ad0 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf36ffd640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 0x7fbf381030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:59.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf377fe640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38104a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf28031610 tx=0x7fbf280043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:59.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2803f030 con 0x7fbf38100ad0 2024-09-15T22:25:59.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf28003ce0 con 0x7fbf38100ad0 2024-09-15T22:25:59.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf381a2070 con 0x7fbf38100ad0 2024-09-15T22:25:59.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.980+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28035070 con 0x7fbf38100ad0 2024-09-15T22:25:59.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.981+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf381a2520 con 0x7fbf38100ad0 2024-09-15T22:25:59.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.982+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf381a2810 con 0x7fbf38100ad0 2024-09-15T22:25:59.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.983+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbf28042030 con 0x7fbf38100ad0 2024-09-15T22:25:59.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.983+0000 7fbf34ff9640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbf200a3240 0x7fbf200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:59.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.983+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7fbf280ee8b0 con 0x7fbf38100ad0 2024-09-15T22:25:59.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.984+0000 7fbf36ffd640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbf200a3240 0x7fbf200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:59.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.984+0000 7fbf36ffd640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbf200a3240 0x7fbf200a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf381047e0 tx=0x7fbf2c005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:59.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:25:59.988+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf280bc910 con 0x7fbf38100ad0 2024-09-15T22:26:00.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:00.175+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbf3806a6d0 con 0x7fbf200a3240 2024-09-15T22:26:00.303 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:26:00.209+0000 7fbf4f600640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:26:00.303 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:26:00.224+0000 7fbf46000640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:26:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:26:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' 2024-09-15T22:26:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] boot 2024-09-15T22:26:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:00 smithi110 ceph-mon[35282]: osdmap e23: 4 total, 4 up, 4 in 2024-09-15T22:26:00.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:26:00.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:26:00.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:00.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:00.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] boot 2024-09-15T22:26:00.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:00 smithi112 ceph-mon[35032]: osdmap e23: 4 total, 4 up, 4 in 2024-09-15T22:26:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:26:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:26:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:00.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: from='osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016]' entity='osd.3' 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: osd.3 [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] boot 2024-09-15T22:26:00.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:00 smithi022 ceph-mon[30634]: osdmap e23: 4 total, 4 up, 4 in 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi022 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi022 to 8547M 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:01.575 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:01 smithi110 ceph-mon[35282]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:26:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:26:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:26:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:26:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi022 2024-09-15T22:26:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi022 to 8547M 2024-09-15T22:26:01.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:01.605 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:01.605 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:01 smithi112 ceph-mon[35032]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:26:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi022 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi022 to 8547M 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:26:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:01 smithi022 ceph-mon[30634]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:26:03.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 533 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:03.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:26:03.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/3742269729' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]: dispatch 2024-09-15T22:26:03.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]: dispatch 2024-09-15T22:26:03.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]': finished 2024-09-15T22:26:03.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:26:03.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:03.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:03 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/2642980838' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 533 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:26:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/3742269729' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]: dispatch 2024-09-15T22:26:03.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]: dispatch 2024-09-15T22:26:03.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]': finished 2024-09-15T22:26:03.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:26:03.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:03.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:03 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/2642980838' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 533 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:26:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/3742269729' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]: dispatch 2024-09-15T22:26:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]: dispatch 2024-09-15T22:26:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b2c8bcb-5000-4dc8-aa69-67617f69c5f7"}]': finished 2024-09-15T22:26:03.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:26:03.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:03.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:03 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/2642980838' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:04.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:04 smithi112 ceph-mon[35032]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:26:04.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:04.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:04 smithi112 ceph-mon[35032]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 532 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:04.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:04 smithi022 ceph-mon[30634]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:26:04.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:04.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:04 smithi022 ceph-mon[30634]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 532 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:04 smithi110 ceph-mon[35282]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:26:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:04 smithi110 ceph-mon[35282]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 532 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:06.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:06 smithi112 ceph-mon[35032]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:06.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:06 smithi110 ceph-mon[35282]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:06 smithi022 ceph-mon[30634]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:08.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:08 smithi112 ceph-mon[35032]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:26:08.872 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:08 smithi110 ceph-mon[35282]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:26:09.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:08 smithi022 ceph-mon[30634]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:26:10.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:10 smithi110 ceph-mon[35282]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-15T22:26:10.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:10 smithi022 ceph-mon[30634]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-15T22:26:10.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:10 smithi112 ceph-mon[35032]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-15T22:26:11.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:26:11.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:11.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:11 smithi022 ceph-mon[30634]: Deploying daemon osd.4 on smithi110 2024-09-15T22:26:11.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:26:11.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:11.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:11 smithi110 ceph-mon[35282]: Deploying daemon osd.4 on smithi110 2024-09-15T22:26:11.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:26:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:11 smithi112 ceph-mon[35032]: Deploying daemon osd.4 on smithi110 2024-09-15T22:26:12.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:12 smithi110 ceph-mon[35282]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:26:12.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:12 smithi112 ceph-mon[35032]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:26:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:12 smithi022 ceph-mon[30634]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:26:14.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:14 smithi112 ceph-mon[35032]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:26:14.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:14 smithi110 ceph-mon[35282]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:26:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:14 smithi022 ceph-mon[30634]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:26:16.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:16 smithi110 ceph-mon[35282]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:26:16.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:16 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:16.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:16 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:16.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:16 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:16.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:16 smithi112 ceph-mon[35032]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:26:16.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:16 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:16.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:16 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:16.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:16 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:16 smithi022 ceph-mon[30634]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:26:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:16 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:16 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:16 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:18.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:18 smithi112 ceph-mon[35032]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:26:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:18 smithi110 ceph-mon[35282]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:26:19.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:18 smithi022 ceph-mon[30634]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:26:19.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.994+0000 7fbf34ff9640 1 -- 172.21.15.110:0/4235303556 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf3806a6d0 con 0x7fbf200a3240 2024-09-15T22:26:19.995 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 4 on host 'smithi110' 2024-09-15T22:26:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbf200a3240 msgr2=0x7fbf200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbf200a3240 0x7fbf200a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf381047e0 tx=0x7fbf2c005d30 comp rx=0 tx=0).stop 2024-09-15T22:26:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 msgr2=0x7fbf38104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38104a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf28031610 tx=0x7fbf280043b0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 shutdown_connections 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf38102690 0x7fbf381035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbf200a3240 0x7fbf200a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf38101cd0 0x7fbf381030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 --2- 172.21.15.110:0/4235303556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf38100ad0 0x7fbf38104a60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.996+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 >> 172.21.15.110:0/4235303556 conn(0x7fbf380fc280 msgr2=0x7fbf38069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.997+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 shutdown_connections 2024-09-15T22:26:19.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:26:19.997+0000 7fbf3db67640 1 -- 172.21.15.110:0/4235303556 wait complete. 2024-09-15T22:26:20.007 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.007 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.007 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:20.007 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:20.007 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:20.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:20.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:20.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:20.526 DEBUG:teuthology.orchestra.run.smithi110:osd.4> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T22:26:20.528 INFO:tasks.cephadm:Deploying osd.5 on smithi112 with /dev/vg_nvme/lv_3... 2024-09-15T22:26:20.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:26:20.781 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:26:21.067 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:20 smithi112 ceph-mon[35032]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:21.068 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:21.068 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:21.068 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:21.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:20 smithi110 ceph-mon[35282]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:21.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:21.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:21.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:20 smithi022 ceph-mon[30634]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:23.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:22 smithi022 ceph-mon[30634]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:23.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:22 smithi022 ceph-mon[30634]: from='osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:26:23.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:22 smithi022 ceph-mon[30634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:26:23.071 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:22 smithi110 ceph-mon[35282]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:23.071 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:22 smithi110 ceph-mon[35282]: from='osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:26:23.072 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:22 smithi110 ceph-mon[35282]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:26:23.072 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:26:22 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:26:22.761+0000 7f04dcf20640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:26:23.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:22 smithi112 ceph-mon[35032]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:23.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:22 smithi112 ceph-mon[35032]: from='osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:26:23.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:22 smithi112 ceph-mon[35032]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:26:23.290 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:26:23.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-09-15T22:26:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:26:24.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 -- 172.21.15.112:0/3083555624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102e00 msgr2=0x7fbb38103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:24.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/3083555624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102e00 0x7fbb38103280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009900 tx=0x7fbb2802a410 comp rx=0 tx=0).stop 2024-09-15T22:26:24.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 -- 172.21.15.112:0/3083555624 shutdown_connections 2024-09-15T22:26:24.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/3083555624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102e00 0x7fbb38103280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/3083555624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb381037c0 0x7fbb3810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/3083555624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38101c00 0x7fbb38102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 -- 172.21.15.112:0/3083555624 >> 172.21.15.112:0/3083555624 conn(0x7fbb380fd390 msgr2=0x7fbb380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 -- 172.21.15.112:0/3083555624 shutdown_connections 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.039+0000 7fbb3d34c640 1 -- 172.21.15.112:0/3083555624 wait complete. 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 Processor -- start 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 -- start start 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38101c00 0x7fbb38197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb38102e00 0x7fbb38198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 0x7fbb3819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d880 con 0x7fbb38101c00 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d700 con 0x7fbb38102e00 2024-09-15T22:26:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.040+0000 7fbb3d34c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810da00 con 0x7fbb381037c0 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 0x7fbb3819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 0x7fbb3819f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48146/0 (socket says 172.21.15.112:48146) 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 -- 172.21.15.112:0/2447493848 learned_addr learned my addr 172.21.15.112:0/2447493848 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb367fc640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb38102e00 0x7fbb38198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb36ffd640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38101c00 0x7fbb38197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 -- 172.21.15.112:0/2447493848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb38102e00 msgr2=0x7fbb38198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb38102e00 0x7fbb38198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 -- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38101c00 msgr2=0x7fbb38197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38101c00 0x7fbb38197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 -- 172.21.15.112:0/2447493848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3819fb30 con 0x7fbb381037c0 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb377fe640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 0x7fbb3819f4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000eaa0 tx=0x7fbb3000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000cdb0 con 0x7fbb381037c0 2024-09-15T22:26:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.041+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb30005020 con 0x7fbb381037c0 2024-09-15T22:26:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.042+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300116b0 con 0x7fbb381037c0 2024-09-15T22:26:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.042+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3819fe20 con 0x7fbb381037c0 2024-09-15T22:26:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.042+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb381a02d0 con 0x7fbb381037c0 2024-09-15T22:26:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.043+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb38109050 con 0x7fbb381037c0 2024-09-15T22:26:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.044+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb30005560 con 0x7fbb381037c0 2024-09-15T22:26:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.045+0000 7fbb1ffff640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbb200a3270 0x7fbb200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.045+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7fbb300ced00 con 0x7fbb381037c0 2024-09-15T22:26:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.045+0000 7fbb36ffd640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbb200a3270 0x7fbb200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.046+0000 7fbb36ffd640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbb200a3270 0x7fbb200a5730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005db0 tx=0x7fbb2c005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.048+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb30016030 con 0x7fbb381037c0 2024-09-15T22:26:24.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:26:24.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:26:24.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:26:24.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:24.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi110 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi110 to 8544M 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:26:24.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:23 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:24.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:26:23.822+0000 7f04d8680640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:26:24.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:26:23.827+0000 7f04d4cba640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi110 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi110 to 8544M 2024-09-15T22:26:24.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:24.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:24.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:26:24.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:26:24.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:23 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:24.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:24.225+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbb38062630 con 0x7fbb200a3270 2024-09-15T22:26:24.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:26:24.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:26:24.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:26:24.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:24.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi110 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi110 to 8544M 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:26:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:23 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:24 smithi112 ceph-mon[35032]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:24 smithi112 ceph-mon[35032]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:25.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:24 smithi110 ceph-mon[35282]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:24 smithi110 ceph-mon[35282]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:24 smithi022 ceph-mon[30634]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:25.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:24 smithi022 ceph-mon[30634]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:25.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:25.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:25.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:25.870 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:25 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:26:25.870 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:25 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:26:25.870 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:25.870 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:25 smithi112 ceph-mon[35032]: osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] boot 2024-09-15T22:26:25.870 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:25 smithi112 ceph-mon[35032]: osdmap e30: 5 total, 5 up, 5 in 2024-09-15T22:26:25.870 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:26.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:25 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:26:26.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:25 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:26:26.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:26.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:25 smithi110 ceph-mon[35282]: osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] boot 2024-09-15T22:26:26.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:25 smithi110 ceph-mon[35282]: osdmap e30: 5 total, 5 up, 5 in 2024-09-15T22:26:26.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:26.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:25 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:26:26.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:25 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:26:26.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:26.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:25 smithi022 ceph-mon[30634]: osd.4 [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] boot 2024-09-15T22:26:26.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:25 smithi022 ceph-mon[30634]: osdmap e30: 5 total, 5 up, 5 in 2024-09-15T22:26:26.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:26:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:26:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/519656468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]: dispatch 2024-09-15T22:26:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]: dispatch 2024-09-15T22:26:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]': finished 2024-09-15T22:26:27.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:26:27.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:26 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:26:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/519656468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]: dispatch 2024-09-15T22:26:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]: dispatch 2024-09-15T22:26:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]': finished 2024-09-15T22:26:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:26:27.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:26 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:27.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:26:27.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:26:27.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/519656468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]: dispatch 2024-09-15T22:26:27.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]: dispatch 2024-09-15T22:26:27.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c23e30e-e3fb-472d-9fb8-8ca3f9742c49"}]': finished 2024-09-15T22:26:27.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:26:27.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:26 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:28.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:27 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/678575283' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:28.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:27 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/678575283' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:28.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:27 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/678575283' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:28 smithi112 ceph-mon[35032]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:29.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:28 smithi110 ceph-mon[35282]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:29.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:28 smithi022 ceph-mon[30634]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:31.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:30 smithi112 ceph-mon[35032]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:31.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:30 smithi110 ceph-mon[35282]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:31.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:30 smithi022 ceph-mon[30634]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:33.147 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:32 smithi112 ceph-mon[35032]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:33.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:32 smithi110 ceph-mon[35282]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:33.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:32 smithi022 ceph-mon[30634]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:35.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:34 smithi110 ceph-mon[35282]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:35.209 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:34 smithi112 ceph-mon[35032]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:35.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:34 smithi022 ceph-mon[30634]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:35.912 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:35 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:26:35.912 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:35 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:35.912 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:35 smithi112 ceph-mon[35032]: Deploying daemon osd.5 on smithi112 2024-09-15T22:26:36.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:35 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:26:36.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:35 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:36.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:35 smithi110 ceph-mon[35282]: Deploying daemon osd.5 on smithi112 2024-09-15T22:26:36.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:35 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:26:36.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:35 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:36.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:35 smithi022 ceph-mon[30634]: Deploying daemon osd.5 on smithi112 2024-09-15T22:26:37.082 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:36 smithi112 ceph-mon[35032]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:37.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:36 smithi110 ceph-mon[35282]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:37.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:36 smithi022 ceph-mon[30634]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:38 smithi112 ceph-mon[35032]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:39.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:38 smithi110 ceph-mon[35282]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:39.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:38 smithi022 ceph-mon[30634]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:40 smithi112 ceph-mon[35032]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:41.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:40 smithi110 ceph-mon[35282]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:41.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:40 smithi022 ceph-mon[30634]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:42.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:42.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:42.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:43 smithi110 ceph-mon[35282]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:43.496 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:43 smithi112 ceph-mon[35032]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:43.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:43 smithi022 ceph-mon[30634]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:44.408 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 5 on host 'smithi112' 2024-09-15T22:26:44.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.406+0000 7fbb1ffff640 1 -- 172.21.15.112:0/2447493848 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbb38062630 con 0x7fbb200a3270 2024-09-15T22:26:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.408+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbb200a3270 msgr2=0x7fbb200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.408+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbb200a3270 0x7fbb200a5730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005db0 tx=0x7fbb2c005d40 comp rx=0 tx=0).stop 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 msgr2=0x7fbb3819f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 0x7fbb3819f4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000eaa0 tx=0x7fbb3000ef60 comp rx=0 tx=0).stop 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 shutdown_connections 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb381037c0 0x7fbb3819f4c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbb200a3270 0x7fbb200a5730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb38102e00 0x7fbb38198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 --2- 172.21.15.112:0/2447493848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38101c00 0x7fbb38197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 >> 172.21.15.112:0/2447493848 conn(0x7fbb380fd390 msgr2=0x7fbb38106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 shutdown_connections 2024-09-15T22:26:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:26:44.409+0000 7fbb3d34c640 1 -- 172.21.15.112:0/2447493848 wait complete. 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.062 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.088 DEBUG:teuthology.orchestra.run.smithi112:osd.5> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T22:26:45.090 INFO:tasks.cephadm:Deploying osd.6 on smithi022 with /dev/vg_nvme/lv_2... 2024-09-15T22:26:45.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:26:45.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:45.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:45.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:45.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:45.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:45.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:47.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:46 smithi022 ceph-mon[30634]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:47.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:46 smithi112 ceph-mon[35032]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:47.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:46 smithi110 ceph-mon[35282]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:47.525 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:26:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:26:47.234+0000 7f30fab94640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:26:48.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:47 smithi022 ceph-mon[30634]: from='osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:26:48.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:47 smithi022 ceph-mon[30634]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:26:48.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:47 smithi112 ceph-mon[35032]: from='osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:26:48.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:47 smithi112 ceph-mon[35032]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:26:48.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:47 smithi110 ceph-mon[35282]: from='osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:26:48.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:47 smithi110 ceph-mon[35282]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:26:48.687 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:26:48.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi112 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:49.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:26:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:26:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:26:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi112 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:49.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:26:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:26:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi112 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:49.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.598+0000 7fe713c00640 1 -- 172.21.15.22:0/357130758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c104f60 msgr2=0x7fe70c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.598+0000 7fe713c00640 1 --2- 172.21.15.22:0/357130758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c104f60 0x7fe70c1053e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009900 tx=0x7fe6f402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 -- 172.21.15.22:0/357130758 shutdown_connections 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 --2- 172.21.15.22:0/357130758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c104f60 0x7fe70c1053e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 --2- 172.21.15.22:0/357130758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c105920 0x7fe70c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 --2- 172.21.15.22:0/357130758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe70c103e00 0x7fe70c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 -- 172.21.15.22:0/357130758 >> 172.21.15.22:0/357130758 conn(0x7fe70c0ff5b0 msgr2=0x7fe70c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 -- 172.21.15.22:0/357130758 shutdown_connections 2024-09-15T22:26:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.599+0000 7fe713c00640 1 -- 172.21.15.22:0/357130758 wait complete. 2024-09-15T22:26:49.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 Processor -- start 2024-09-15T22:26:49.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 -- start start 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 0x7fe70c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe70c104f60 0x7fe70c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c105920 0x7fe70c1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c10fab0 con 0x7fe70c103e00 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c10f930 con 0x7fe70c104f60 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe713c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c10fc30 con 0x7fe70c105920 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe711200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 0x7fe70c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe711200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 0x7fe70c19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32844/0 (socket says 172.21.15.22:32844) 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe711200640 1 -- 172.21.15.22:0/2475378410 learned_addr learned my addr 172.21.15.22:0/2475378410 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:26:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe711c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c105920 0x7fe70c1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.600+0000 7fe703e00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe70c104f60 0x7fe70c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711c00640 1 -- 172.21.15.22:0/2475378410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe70c104f60 msgr2=0x7fe70c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe70c104f60 0x7fe70c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711c00640 1 -- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 msgr2=0x7fe70c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 0x7fe70c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711c00640 1 -- 172.21.15.22:0/2475378410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c1a1da0 con 0x7fe70c105920 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711200640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 0x7fe70c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe711c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c105920 0x7fe70c1a1730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe70400ec50 tx=0x7fe70400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704003b70 con 0x7fe70c105920 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70c1a2090 con 0x7fe70c105920 2024-09-15T22:26:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe704003d10 con 0x7fe70c105920 2024-09-15T22:26:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704010890 con 0x7fe70c105920 2024-09-15T22:26:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.601+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70c1a25a0 con 0x7fe70c105920 2024-09-15T22:26:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.603+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70c10b290 con 0x7fe70c105920 2024-09-15T22:26:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.605+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe704004b40 con 0x7fe70c105920 2024-09-15T22:26:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.606+0000 7fe70a000640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.606+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7fe7040cf190 con 0x7fe70c105920 2024-09-15T22:26:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.606+0000 7fe711200640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.607+0000 7fe711200640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc011500 tx=0x7fe6fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:49.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.608+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe70409cdf0 con 0x7fe70c105920 2024-09-15T22:26:49.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:26:49.806+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe70c062630 con 0x7fe6f00a32f0 2024-09-15T22:26:50.102 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:26:49.722+0000 7f30f62f4640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:26:50.102 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:26:49.731+0000 7f30ee926640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:26:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:26:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:26:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='osd.5 ' entity='osd.5' 2024-09-15T22:26:50.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:50.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:50.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] boot 2024-09-15T22:26:50.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:26:50.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:49 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:50.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:26:50.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:26:50.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:50.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:50.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='osd.5 ' entity='osd.5' 2024-09-15T22:26:50.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:50.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:50.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] boot 2024-09-15T22:26:50.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:26:50.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:49 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='osd.5 ' entity='osd.5' 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:26:50.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:26:50.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: osd.5 [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] boot 2024-09-15T22:26:50.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:26:50.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:49 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:50 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:26:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:50 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:26:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:50 smithi022 ceph-mon[30634]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:50 smithi022 ceph-mon[30634]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:50 smithi022 ceph-mon[30634]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:26:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:50 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:26:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:50 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:26:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:50 smithi112 ceph-mon[35032]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:50 smithi112 ceph-mon[35032]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:50 smithi112 ceph-mon[35032]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:26:51.106 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:50 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:26:51.107 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:50 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:26:51.107 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:50 smithi110 ceph-mon[35282]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:26:51.107 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:50 smithi110 ceph-mon[35282]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:51.107 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:26:51.107 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:50 smithi110 ceph-mon[35282]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:26:53.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:52 smithi112 ceph-mon[35032]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 594 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:26:53.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:52 smithi112 ceph-mon[35032]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:26:53.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:52 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3233835315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55a5401c-0205-407d-bf6b-bd98309df058"}]: dispatch 2024-09-15T22:26:53.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:52 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3233835315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55a5401c-0205-407d-bf6b-bd98309df058"}]': finished 2024-09-15T22:26:53.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:52 smithi112 ceph-mon[35032]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:26:53.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:26:53.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:52 smithi110 ceph-mon[35282]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 594 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:26:53.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:52 smithi110 ceph-mon[35282]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:26:53.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:52 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3233835315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55a5401c-0205-407d-bf6b-bd98309df058"}]: dispatch 2024-09-15T22:26:53.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:52 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3233835315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55a5401c-0205-407d-bf6b-bd98309df058"}]': finished 2024-09-15T22:26:53.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:52 smithi110 ceph-mon[35282]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:26:53.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:52 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:26:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:52 smithi022 ceph-mon[30634]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 594 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:26:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:52 smithi022 ceph-mon[30634]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:26:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:52 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3233835315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55a5401c-0205-407d-bf6b-bd98309df058"}]: dispatch 2024-09-15T22:26:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:52 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3233835315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55a5401c-0205-407d-bf6b-bd98309df058"}]': finished 2024-09-15T22:26:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:52 smithi022 ceph-mon[30634]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:26:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:26:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:53 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3197300525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:53 smithi112 ceph-mon[35032]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:26:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:26:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:53 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3197300525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:53 smithi110 ceph-mon[35282]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:26:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:26:54.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:53 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3197300525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:26:54.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:53 smithi022 ceph-mon[30634]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:26:54.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:26:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:54 smithi112 ceph-mon[35032]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 594 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:26:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:54 smithi110 ceph-mon[35282]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 594 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:26:55.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:54 smithi022 ceph-mon[30634]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 594 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:26:57.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:56 smithi112 ceph-mon[35032]: pgmap v142: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-15T22:26:57.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:56 smithi110 ceph-mon[35282]: pgmap v142: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-15T22:26:57.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:56 smithi022 ceph-mon[30634]: pgmap v142: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-15T22:26:59.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:26:58 smithi112 ceph-mon[35032]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:26:59.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:26:58 smithi110 ceph-mon[35282]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:26:59.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:26:58 smithi022 ceph-mon[30634]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:27:01.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:00 smithi112 ceph-mon[35032]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-15T22:27:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:00 smithi110 ceph-mon[35282]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-15T22:27:01.268 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:00 smithi022 ceph-mon[30634]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-15T22:27:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:02 smithi112 ceph-mon[35032]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:27:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:02 smithi112 ceph-mon[35032]: Deploying daemon osd.6 on smithi022 2024-09-15T22:27:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:02 smithi110 ceph-mon[35282]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:27:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:02 smithi110 ceph-mon[35282]: Deploying daemon osd.6 on smithi022 2024-09-15T22:27:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:02 smithi022 ceph-mon[30634]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:27:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:03.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:02 smithi022 ceph-mon[30634]: Deploying daemon osd.6 on smithi022 2024-09-15T22:27:05.192 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:04 smithi022 ceph-mon[30634]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:05.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:04 smithi110 ceph-mon[35282]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:04 smithi112 ceph-mon[35032]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:06 smithi022 ceph-mon[30634]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:06 smithi110 ceph-mon[35282]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:06 smithi112 ceph-mon[35032]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:08.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:08 smithi022 ceph-mon[30634]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:08 smithi110 ceph-mon[35282]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:08 smithi112 ceph-mon[35032]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:10.184 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:10.184 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:10.184 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:09 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:10.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:10.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:10.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:09 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:09 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:11.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:11 smithi112 ceph-mon[35032]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:11 smithi110 ceph-mon[35282]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:11 smithi022 ceph-mon[30634]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:13.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:13 smithi022 ceph-mon[30634]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:13.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:13 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:13 smithi110 ceph-mon[35282]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:13 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:13 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:13 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:13.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:13 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:13.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:13 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:13 smithi112 ceph-mon[35032]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:13.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:13 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:13 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:13.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:13 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:13.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:13 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:13.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:13 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.064+0000 7fe70a000640 1 -- 172.21.15.22:0/2475378410 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe70c062630 con 0x7fe6f00a32f0 2024-09-15T22:27:14.069 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 6 on host 'smithi022' 2024-09-15T22:27:14.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe6f00a32f0 msgr2=0x7fe6f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:14.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc011500 tx=0x7fe6fc005f90 comp rx=0 tx=0).stop 2024-09-15T22:27:14.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c105920 msgr2=0x7fe70c1a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:14.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c105920 0x7fe70c1a1730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe70400ec50 tx=0x7fe70400c6a0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 shutdown_connections 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe70c105920 0x7fe70c1a1730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe70c104f60 0x7fe70c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 --2- 172.21.15.22:0/2475378410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c103e00 0x7fe70c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 >> 172.21.15.22:0/2475378410 conn(0x7fe70c0ff5b0 msgr2=0x7fe70c108460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.067+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 shutdown_connections 2024-09-15T22:27:14.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:27:14.068+0000 7fe713c00640 1 -- 172.21.15.22:0/2475378410 wait complete. 2024-09-15T22:27:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:14.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:14.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:14.859 DEBUG:teuthology.orchestra.run.smithi022:osd.6> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T22:27:14.863 INFO:tasks.cephadm:Deploying osd.7 on smithi110 with /dev/vg_nvme/lv_2... 2024-09-15T22:27:14.863 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:27:15.114 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:27:15.497 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:15 smithi110 ceph-mon[35282]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:15.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:15 smithi022 ceph-mon[30634]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:15 smithi112 ceph-mon[35032]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:16.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:27:15 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:27:15.744+0000 7fb1ffa1b640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:27:16.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:16 smithi110 ceph-mon[35282]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:27:16.728 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:16 smithi022 ceph-mon[30634]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:27:16.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:16 smithi112 ceph-mon[35032]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:27:17.419 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:27:17.446 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_2 2024-09-15T22:27:17.695 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:27:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:17 smithi110 ceph-mon[35282]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:17 smithi110 ceph-mon[35282]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:27:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:17 smithi110 ceph-mon[35282]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:27:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:17 smithi110 ceph-mon[35282]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:27:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:17 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:17 smithi022 ceph-mon[30634]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:17 smithi022 ceph-mon[30634]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:27:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:17 smithi022 ceph-mon[30634]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:27:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:17 smithi022 ceph-mon[30634]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:27:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:17 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:17 smithi112 ceph-mon[35032]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:17 smithi112 ceph-mon[35032]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:27:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:17 smithi112 ceph-mon[35032]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:27:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:17 smithi112 ceph-mon[35032]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:27:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:17 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.135+0000 7fd9eefa1640 1 -- 172.21.15.110:0/1904577460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8100ad0 msgr2=0x7fd9e8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.135+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/1904577460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8100ad0 0x7fd9e8100ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009900 tx=0x7fd9dc02a410 comp rx=0 tx=0).stop 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 -- 172.21.15.110:0/1904577460 shutdown_connections 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/1904577460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e8101cd0 0x7fd9e8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/1904577460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e8102690 0x7fd9e8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/1904577460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8100ad0 0x7fd9e8100ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 -- 172.21.15.110:0/1904577460 >> 172.21.15.110:0/1904577460 conn(0x7fd9e80fc280 msgr2=0x7fd9e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 -- 172.21.15.110:0/1904577460 shutdown_connections 2024-09-15T22:27:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 -- 172.21.15.110:0/1904577460 wait complete. 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 Processor -- start 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 -- start start 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e8100ad0 0x7fd9e806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.136+0000 7fd9eefa1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e8101cd0 0x7fd9e819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9eefa1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 0x7fd9e819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9eefa1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e810c750 con 0x7fd9e8100ad0 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9eefa1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e810c5d0 con 0x7fd9e8102690 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9eefa1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e810c8d0 con 0x7fd9e8101cd0 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 0x7fd9e819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 0x7fd9e819f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46032/0 (socket says 172.21.15.110:46032) 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 -- 172.21.15.110:0/2141125947 learned_addr learned my addr 172.21.15.110:0/2141125947 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ecd3d640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e8100ad0 0x7fd9e806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9e7fff640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e8101cd0 0x7fd9e819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 -- 172.21.15.110:0/2141125947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e8101cd0 msgr2=0x7fd9e819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e8101cd0 0x7fd9e819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 -- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e8100ad0 msgr2=0x7fd9e806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e8100ad0 0x7fd9e806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 -- 172.21.15.110:0/2141125947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e819fc00 con 0x7fd9e8102690 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9ed53e640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 0x7fd9e819f2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000eaa0 tx=0x7fd9e000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000cdb0 con 0x7fd9e8102690 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9e0005020 con 0x7fd9e8102690 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e819fe90 con 0x7fd9e8102690 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.137+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00116b0 con 0x7fd9e8102690 2024-09-15T22:27:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.138+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a0350 con 0x7fd9e8102690 2024-09-15T22:27:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.139+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e8100ed0 con 0x7fd9e8102690 2024-09-15T22:27:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.140+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd9e0005560 con 0x7fd9e8102690 2024-09-15T22:27:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.140+0000 7fd9e5ffb640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd9d80a3240 0x7fd9d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.140+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fd9e00ced50 con 0x7fd9e8102690 2024-09-15T22:27:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.141+0000 7fd9ecd3d640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd9d80a3240 0x7fd9d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.141+0000 7fd9ecd3d640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd9d80a3240 0x7fd9d80a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc005ab0 tx=0x7fd9dc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:18.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.144+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9e0016030 con 0x7fd9e8102690 2024-09-15T22:27:18.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:18.324+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd9e8062630 con 0x7fd9d80a3240 2024-09-15T22:27:18.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:27:18.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:27:18.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' 2024-09-15T22:27:18.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:27:18.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:27:18.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:18.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:18.782 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:27:18.314+0000 7fb1f9c00640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:27:18.782 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:27:18.337+0000 7fb1f0600640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:27:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:27:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:27:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' 2024-09-15T22:27:18.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:27:18.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:27:18.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:18.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036]' entity='osd.6' 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:27:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:27:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi022 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi022 to 5698M 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] boot 2024-09-15T22:27:19.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:27:19.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:19 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:19.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi022 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi022 to 5698M 2024-09-15T22:27:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:19.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:19.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] boot 2024-09-15T22:27:19.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:27:19.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:19 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:27:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:27:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:27:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:27:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi022 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi022 to 5698M 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:19.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: osd.6 [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] boot 2024-09-15T22:27:19.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:27:19.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:19 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:27:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:27:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/2424970066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]: dispatch 2024-09-15T22:27:21.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]: dispatch 2024-09-15T22:27:21.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]': finished 2024-09-15T22:27:21.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:27:21.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:21.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:21 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/77794454' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:27:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:27:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/2424970066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]: dispatch 2024-09-15T22:27:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]: dispatch 2024-09-15T22:27:21.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]': finished 2024-09-15T22:27:21.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:27:21.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:21.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:21 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/77794454' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:27:21.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:21.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:27:21.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/2424970066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]: dispatch 2024-09-15T22:27:21.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]: dispatch 2024-09-15T22:27:21.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1c41c5d-3218-4783-9c59-e49c4a97c43a"}]': finished 2024-09-15T22:27:21.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:27:21.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:21.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:21 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/77794454' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:27:22.753 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:22 smithi112 ceph-mon[35032]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:22 smithi022 ceph-mon[30634]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:22.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:22 smithi110 ceph-mon[35282]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:24 smithi112 ceph-mon[35032]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:24 smithi110 ceph-mon[35282]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:25.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:24 smithi022 ceph-mon[30634]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:26.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:26 smithi110 ceph-mon[35282]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:26 smithi112 ceph-mon[35032]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:27.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:26 smithi022 ceph-mon[30634]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:28.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:28 smithi110 ceph-mon[35282]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:28.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:27:28.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:28.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:28 smithi110 ceph-mon[35282]: Deploying daemon osd.7 on smithi110 2024-09-15T22:27:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:28 smithi112 ceph-mon[35032]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:27:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:28 smithi112 ceph-mon[35032]: Deploying daemon osd.7 on smithi110 2024-09-15T22:27:29.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:28 smithi022 ceph-mon[30634]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:29.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:27:29.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:29.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:28 smithi022 ceph-mon[30634]: Deploying daemon osd.7 on smithi110 2024-09-15T22:27:30.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:30 smithi112 ceph-mon[35032]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:30.911 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:30 smithi110 ceph-mon[35282]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:31.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:30 smithi022 ceph-mon[30634]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:32 smithi112 ceph-mon[35032]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:32 smithi110 ceph-mon[35282]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:33.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:32 smithi022 ceph-mon[30634]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:34.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:34 smithi112 ceph-mon[35032]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:34.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:34.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:34.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:34.900 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:34 smithi110 ceph-mon[35282]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:34.900 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:34.900 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:34.900 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:35.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:34 smithi022 ceph-mon[30634]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:35.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:35.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:35.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:36 smithi112 ceph-mon[35032]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:36.868 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:36 smithi110 ceph-mon[35282]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:36 smithi022 ceph-mon[30634]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:37.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.945+0000 7fd9e5ffb640 1 -- 172.21.15.110:0/2141125947 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd9e8062630 con 0x7fd9d80a3240 2024-09-15T22:27:37.947 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 7 on host 'smithi110' 2024-09-15T22:27:37.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.947+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd9d80a3240 msgr2=0x7fd9d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:37.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.947+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd9d80a3240 0x7fd9d80a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc005ab0 tx=0x7fd9dc000bc0 comp rx=0 tx=0).stop 2024-09-15T22:27:37.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.947+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 msgr2=0x7fd9e819f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:37.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.947+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 0x7fd9e819f2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000eaa0 tx=0x7fd9e000ef60 comp rx=0 tx=0).stop 2024-09-15T22:27:37.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 shutdown_connections 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9e8101cd0 0x7fd9e819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd9d80a3240 0x7fd9d80a5700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9e8102690 0x7fd9e819f2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 --2- 172.21.15.110:0/2141125947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9e8100ad0 0x7fd9e806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 >> 172.21.15.110:0/2141125947 conn(0x7fd9e80fc280 msgr2=0x7fd9e8105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 shutdown_connections 2024-09-15T22:27:37.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:27:37.948+0000 7fd9eefa1640 1 -- 172.21.15.110:0/2141125947 wait complete. 2024-09-15T22:27:38.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:38.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:38.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:38.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:38.585 DEBUG:teuthology.orchestra.run.smithi110:osd.7> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T22:27:38.587 INFO:tasks.cephadm:Deploying osd.8 on smithi112 with /dev/vg_nvme/lv_2... 2024-09-15T22:27:38.588 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:27:38.844 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:27:39.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:39 smithi110 ceph-mon[35282]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:39.276 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:39 smithi112 ceph-mon[35032]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:39.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:39 smithi022 ceph-mon[30634]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:40.921 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:27:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:27:40.551+0000 7f0b23a05640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:27:41.191 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:41 smithi110 ceph-mon[35282]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:41.191 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:41 smithi110 ceph-mon[35282]: from='osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:27:41.191 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:41 smithi110 ceph-mon[35282]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:27:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:41 smithi112 ceph-mon[35032]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:41 smithi112 ceph-mon[35032]: from='osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:27:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:41 smithi112 ceph-mon[35032]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:27:41.432 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:27:41.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-09-15T22:27:41.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:41 smithi022 ceph-mon[30634]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:41.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:41 smithi022 ceph-mon[30634]: from='osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:27:41.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:41 smithi022 ceph-mon[30634]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:27:41.705 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:27:42.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 -- 172.21.15.112:0/1975362001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4107980 msgr2=0x7ff8c4109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:42.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/1975362001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4107980 0x7ff8c4109d70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009ca0 tx=0x7ff8bc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:27:42.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 -- 172.21.15.112:0/1975362001 shutdown_connections 2024-09-15T22:27:42.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/1975362001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4107980 0x7ff8c4109d70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/1975362001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4105050 0x7ff8c4107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/1975362001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8c4102720 0x7ff8c4104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 -- 172.21.15.112:0/1975362001 >> 172.21.15.112:0/1975362001 conn(0x7ff8c40fc280 msgr2=0x7ff8c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 -- 172.21.15.112:0/1975362001 shutdown_connections 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.189+0000 7ff8cb60b640 1 -- 172.21.15.112:0/1975362001 wait complete. 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 Processor -- start 2024-09-15T22:27:42.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 -- start start 2024-09-15T22:27:42.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8c4102720 0x7ff8c4197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 0x7ff8c41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4107980 0x7ff8c419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c410d890 con 0x7ff8c4102720 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c410d710 con 0x7ff8c4107980 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8cb60b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c410da10 con 0x7ff8c4105050 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8c8ba6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 0x7ff8c41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8c8ba6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 0x7ff8c41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39358/0 (socket says 172.21.15.112:39358) 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8c9ba8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4107980 0x7ff8c419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.190+0000 7ff8c8ba6640 1 -- 172.21.15.112:0/2421578006 learned_addr learned my addr 172.21.15.112:0/2421578006 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c93a7640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8c4102720 0x7ff8c4197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c8ba6640 1 -- 172.21.15.112:0/2421578006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4107980 msgr2=0x7ff8c419f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:42.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c8ba6640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4107980 0x7ff8c419f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c8ba6640 1 -- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8c4102720 msgr2=0x7ff8c4197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c8ba6640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8c4102720 0x7ff8c4197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c8ba6640 1 -- 172.21.15.112:0/2421578006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c419fac0 con 0x7ff8c4105050 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c9ba8640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4107980 0x7ff8c419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8c8ba6640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 0x7ff8c41983d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e9f0 tx=0x7ff8b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400ccc0 con 0x7ff8c4105050 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8b4005500 con 0x7ff8c4105050 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c419fdb0 con 0x7ff8c4105050 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4010690 con 0x7ff8c4105050 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.191+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41a0210 con 0x7ff8c4105050 2024-09-15T22:27:42.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.192+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c40fdd70 con 0x7ff8c4105050 2024-09-15T22:27:42.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.194+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff8b40046c0 con 0x7ff8c4105050 2024-09-15T22:27:42.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.195+0000 7ff8ba7fc640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8b00a3270 0x7ff8b00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:42.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.195+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7ff8b40cf140 con 0x7ff8c4105050 2024-09-15T22:27:42.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.195+0000 7ff8c93a7640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8b00a3270 0x7ff8b00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:42.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.195+0000 7ff8c93a7640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8b00a3270 0x7ff8b00a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000bbe0 tx=0x7ff8c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:42.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.197+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8b40541b0 con 0x7ff8c4105050 2024-09-15T22:27:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:27:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:27:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:27:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:42.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi110 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi110 to 5696M 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:42 smithi022 ceph-mon[30634]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi110 2024-09-15T22:27:42.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi110 to 5696M 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:42 smithi112 ceph-mon[35032]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:27:42.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:27:42.377+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff8c4062630 con 0x7ff8b00a3270 2024-09-15T22:27:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:27:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:27:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:27:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi110 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi110 to 5696M 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:27:42.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:27:42.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-mon[35282]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:27:43.036 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:27:42.723+0000 7f0b1f165640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:27:43.036 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:27:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:27:42.733+0000 7f0b17797640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='osd.7 ' entity='osd.7' 2024-09-15T22:27:43.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] boot 2024-09-15T22:27:43.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:27:43.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:27:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='osd.7 ' entity='osd.7' 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] boot 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:27:43.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:27:43.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='osd.7 ' entity='osd.7' 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: osd.7 [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] boot 2024-09-15T22:27:43.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:27:43.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:27:44.135 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:44 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:27:44.135 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:44 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:27:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:44 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:27:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:44 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:27:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:44 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:27:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:44 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/1290085469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]: dispatch 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]: dispatch 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]': finished 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: osdmap e49: 9 total, 8 up, 9 in 2024-09-15T22:27:45.287 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:45 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:27:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/1290085469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]: dispatch 2024-09-15T22:27:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]: dispatch 2024-09-15T22:27:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]': finished 2024-09-15T22:27:45.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: osdmap e49: 9 total, 8 up, 9 in 2024-09-15T22:27:45.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:45 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:27:45.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/1290085469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]: dispatch 2024-09-15T22:27:45.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]: dispatch 2024-09-15T22:27:45.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db438831-af66-49ce-933e-327537a59442"}]': finished 2024-09-15T22:27:45.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: osdmap e49: 9 total, 8 up, 9 in 2024-09-15T22:27:45.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:45 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:46.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:46 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/4170066068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:27:46.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:46 smithi112 ceph-mon[35032]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:27:46.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:46 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/4170066068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:27:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:46 smithi110 ceph-mon[35282]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:27:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:46 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:46.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:46 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/4170066068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:27:46.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:46 smithi022 ceph-mon[30634]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:27:46.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:46 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:47.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:47 smithi112 ceph-mon[35032]: pgmap v177: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:47.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:47 smithi112 ceph-mon[35032]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:27:47.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:47 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:47 smithi110 ceph-mon[35282]: pgmap v177: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:47 smithi110 ceph-mon[35282]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:27:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:47 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:47 smithi022 ceph-mon[30634]: pgmap v177: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:47 smithi022 ceph-mon[30634]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:27:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:47 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:27:49.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:49 smithi112 ceph-mon[35032]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:49.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:49 smithi110 ceph-mon[35282]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:49.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:49 smithi022 ceph-mon[30634]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:51.308 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:51 smithi112 ceph-mon[35032]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:51.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:51 smithi110 ceph-mon[35282]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:51 smithi022 ceph-mon[30634]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:53 smithi022 ceph-mon[30634]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:53.305 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:53 smithi112 ceph-mon[35032]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:53.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:53 smithi110 ceph-mon[35282]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:27:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:54 smithi112 ceph-mon[35032]: Deploying daemon osd.8 on smithi112 2024-09-15T22:27:54.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:27:54.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:54.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:54 smithi110 ceph-mon[35282]: Deploying daemon osd.8 on smithi112 2024-09-15T22:27:54.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:27:54.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:27:54.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:54 smithi022 ceph-mon[30634]: Deploying daemon osd.8 on smithi112 2024-09-15T22:27:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:55 smithi112 ceph-mon[35032]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:55.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:55 smithi110 ceph-mon[35282]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:55 smithi022 ceph-mon[30634]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:57.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:57 smithi112 ceph-mon[35032]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:57.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:57 smithi110 ceph-mon[35282]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:57.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:57 smithi022 ceph-mon[30634]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:59.169 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:27:59 smithi112 ceph-mon[35032]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:27:59 smithi110 ceph-mon[35282]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:27:59.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:27:59 smithi022 ceph-mon[30634]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:00.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:00.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:00.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:00.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:00.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:00.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:01.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:01 smithi112 ceph-mon[35032]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:01 smithi022 ceph-mon[30634]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:01.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:01 smithi110 ceph-mon[35282]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:02.527 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 8 on host 'smithi112' 2024-09-15T22:28:02.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.525+0000 7ff8ba7fc640 1 -- 172.21.15.112:0/2421578006 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff8c4062630 con 0x7ff8b00a3270 2024-09-15T22:28:02.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.527+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8b00a3270 msgr2=0x7ff8b00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:02.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.527+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8b00a3270 0x7ff8b00a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000bbe0 tx=0x7ff8c000b390 comp rx=0 tx=0).stop 2024-09-15T22:28:02.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 msgr2=0x7ff8c41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 0x7ff8c41983d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e9f0 tx=0x7ff8b400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 shutdown_connections 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8c4105050 0x7ff8c41983d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8b00a3270 0x7ff8b00a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8c4107980 0x7ff8c419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 --2- 172.21.15.112:0/2421578006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8c4102720 0x7ff8c4197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 >> 172.21.15.112:0/2421578006 conn(0x7ff8c40fc280 msgr2=0x7ff8c4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 shutdown_connections 2024-09-15T22:28:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:02.528+0000 7ff8cb60b640 1 -- 172.21.15.112:0/2421578006 wait complete. 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:02 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.159 DEBUG:teuthology.orchestra.run.smithi112:osd.8> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T22:28:03.162 INFO:tasks.cephadm:Deploying osd.9 on smithi022 with /dev/vg_nvme/lv_1... 2024-09-15T22:28:03.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:28:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:02 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:03.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:03.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:03.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:03.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.219 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:02 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:03.547 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:05.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:04 smithi110 ceph-mon[35282]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:05.231 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:04 smithi022 ceph-mon[30634]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:04 smithi112 ceph-mon[35032]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:05.730 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:28:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:28:05.538+0000 7f3dd844e640 -1 osd.8 0 log_to_monitors true 2024-09-15T22:28:06.047 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:05 smithi112 ceph-mon[35032]: from='osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:28:06.048 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:05 smithi112 ceph-mon[35032]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:28:06.183 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:05 smithi022 ceph-mon[30634]: from='osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:28:06.183 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:05 smithi022 ceph-mon[30634]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:28:06.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:05 smithi110 ceph-mon[35282]: from='osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:28:06.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:05 smithi110 ceph-mon[35282]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:28:06.805 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:28:06.840 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-09-15T22:28:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi112 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:07.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:07.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:28:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi112 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:07.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:07.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.232 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:28:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi112 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:07.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:07.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 -- 172.21.15.22:0/3991101405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc105920 msgr2=0x7f10fc10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:07.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 --2- 172.21.15.22:0/3991101405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc105920 0x7f10fc10c240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009ca0 tx=0x7f10f402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:28:07.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 -- 172.21.15.22:0/3991101405 shutdown_connections 2024-09-15T22:28:07.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 --2- 172.21.15.22:0/3991101405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc105920 0x7f10fc10c240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:07.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 --2- 172.21.15.22:0/3991101405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc104f60 0x7f10fc1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:07.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 --2- 172.21.15.22:0/3991101405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10fc103e00 0x7f10fc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 -- 172.21.15.22:0/3991101405 >> 172.21.15.22:0/3991101405 conn(0x7f10fc0ff5b0 msgr2=0x7f10fc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 -- 172.21.15.22:0/3991101405 shutdown_connections 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.782+0000 7f1102200640 1 -- 172.21.15.22:0/3991101405 wait complete. 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.783+0000 7f1102200640 1 Processor -- start 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.783+0000 7f1102200640 1 -- start start 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.783+0000 7f1102200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10fc103e00 0x7f10fc19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.783+0000 7f1102200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc104f60 0x7f10fc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.783+0000 7f1102200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc105920 0x7f10fc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:07.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f1102200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10fa90 con 0x7f10fc105920 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f1102200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10f910 con 0x7f10fc103e00 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f1102200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10fc10 con 0x7f10fc104f60 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10fbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc105920 0x7f10fc1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10fb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10fc103e00 0x7f10fc19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc104f60 0x7f10fc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10fbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc105920 0x7f10fc1a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35690/0 (socket says 172.21.15.22:35690) 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10fbe00640 1 -- 172.21.15.22:0/535585308 learned_addr learned my addr 172.21.15.22:0/535585308 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10f3e00640 1 -- 172.21.15.22:0/535585308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10fc103e00 msgr2=0x7f10fc19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10f3e00640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10fc103e00 0x7f10fc19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10f3e00640 1 -- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc105920 msgr2=0x7f10fc1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10f3e00640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc105920 0x7f10fc1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.784+0000 7f10f3e00640 1 -- 172.21.15.22:0/535585308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc1a1c80 con 0x7f10fc104f60 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.785+0000 7f10f3e00640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc104f60 0x7f10fc19a590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f10e400e9c0 tx=0x7f10e400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.785+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e400ccc0 con 0x7f10fc104f60 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.785+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc1a1f70 con 0x7f10fc104f60 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.785+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10e40035f0 con 0x7f10fc104f60 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.785+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e400ce60 con 0x7f10fc104f60 2024-09-15T22:28:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.785+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc1a2470 con 0x7f10fc104f60 2024-09-15T22:28:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.786+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10fc10b190 con 0x7f10fc104f60 2024-09-15T22:28:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.788+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f10e40037a0 con 0x7f10fc104f60 2024-09-15T22:28:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.790+0000 7f10f8c00640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10e00a3270 0x7f10e00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.790+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7f10e40cf2d0 con 0x7f10fc104f60 2024-09-15T22:28:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.790+0000 7f10fb400640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10e00a3270 0x7f10e00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.791+0000 7f10fb400640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10e00a3270 0x7f10e00a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00bbe0 tx=0x7f10ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.794+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10e409ca20 con 0x7f10fc104f60 2024-09-15T22:28:07.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:07.992+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f10fc062630 con 0x7f10e00a3270 2024-09-15T22:28:08.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:28:07.690+0000 7f3dd4be5640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T22:28:08.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:28:07.702+0000 7f3dcc1e0640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:28:08.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:28:08.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:28:08.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: from='osd.8 ' entity='osd.8' 2024-09-15T22:28:08.104 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] boot 2024-09-15T22:28:08.104 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:28:08.104 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:07 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:28:08.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:28:08.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: from='osd.8 ' entity='osd.8' 2024-09-15T22:28:08.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] boot 2024-09-15T22:28:08.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:28:08.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:07 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:28:08.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:28:08.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:08.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: from='osd.8 ' entity='osd.8' 2024-09-15T22:28:08.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: osd.8 [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] boot 2024-09-15T22:28:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:28:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:07 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:28:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:28:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:28:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:28:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:28:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:28:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:28:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:28:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:10.079 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:09 smithi022 ceph-mon[30634]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:28:10.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:09 smithi110 ceph-mon[35282]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:28:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:09 smithi112 ceph-mon[35032]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:28:11.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:10 smithi022 ceph-mon[30634]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 707 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:11.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:10 smithi022 ceph-mon[30634]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:28:11.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:10 smithi110 ceph-mon[35282]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 707 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:11.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:10 smithi110 ceph-mon[35282]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:28:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:10 smithi112 ceph-mon[35032]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 707 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:10 smithi112 ceph-mon[35032]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:28:12.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:11 smithi110 ceph-mon[35282]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:28:12.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:11 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1634591008' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db7ade71-4c38-48a7-9ea0-520da038202c"}]: dispatch 2024-09-15T22:28:12.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:11 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1634591008' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db7ade71-4c38-48a7-9ea0-520da038202c"}]': finished 2024-09-15T22:28:12.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:11 smithi110 ceph-mon[35282]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:28:12.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:12.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:11 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1968293567' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:28:12.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:11 smithi022 ceph-mon[30634]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:28:12.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:11 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1634591008' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db7ade71-4c38-48a7-9ea0-520da038202c"}]: dispatch 2024-09-15T22:28:12.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:11 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1634591008' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db7ade71-4c38-48a7-9ea0-520da038202c"}]': finished 2024-09-15T22:28:12.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:11 smithi022 ceph-mon[30634]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:28:12.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:12.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:11 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1968293567' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:28:12.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:11 smithi112 ceph-mon[35032]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:28:12.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:11 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1634591008' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db7ade71-4c38-48a7-9ea0-520da038202c"}]: dispatch 2024-09-15T22:28:12.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:11 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1634591008' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db7ade71-4c38-48a7-9ea0-520da038202c"}]': finished 2024-09-15T22:28:12.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:11 smithi112 ceph-mon[35032]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:28:12.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:12.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:11 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1968293567' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:28:13.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:13 smithi110 ceph-mon[35282]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 707 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:13.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:13 smithi022 ceph-mon[30634]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 707 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:13.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:13 smithi112 ceph-mon[35032]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 707 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:15.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:15 smithi110 ceph-mon[35282]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 804 GiB / 805 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-15T22:28:15.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:15 smithi022 ceph-mon[30634]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 804 GiB / 805 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-15T22:28:15.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:15 smithi112 ceph-mon[35032]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 804 GiB / 805 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-15T22:28:17.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:17 smithi110 ceph-mon[35282]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:28:17.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:17 smithi022 ceph-mon[30634]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:28:17.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:17 smithi112 ceph-mon[35032]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:28:19.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:19 smithi110 ceph-mon[35282]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:28:19.474 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:19 smithi022 ceph-mon[30634]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:28:19.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:19 smithi112 ceph-mon[35032]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:28:21.392 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:21 smithi022 ceph-mon[30634]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:28:21.392 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:21 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:28:21.392 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:21 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:21 smithi110 ceph-mon[35282]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:28:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:21 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:28:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:21 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:21.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:21 smithi112 ceph-mon[35032]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:28:21.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:21 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:28:21.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:21 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:22.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:22 smithi110 ceph-mon[35282]: Deploying daemon osd.9 on smithi022 2024-09-15T22:28:22.503 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:22 smithi112 ceph-mon[35032]: Deploying daemon osd.9 on smithi022 2024-09-15T22:28:22.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:22 smithi022 ceph-mon[30634]: Deploying daemon osd.9 on smithi022 2024-09-15T22:28:23.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:23 smithi110 ceph-mon[35282]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T22:28:23.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:23 smithi022 ceph-mon[30634]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T22:28:23.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:23 smithi112 ceph-mon[35032]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T22:28:25.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:25 smithi022 ceph-mon[30634]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:28:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:25 smithi110 ceph-mon[35282]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:28:25.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:25 smithi112 ceph-mon[35032]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:28:27.241 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:27 smithi022 ceph-mon[30634]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:27 smithi110 ceph-mon[35282]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:27.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:27 smithi112 ceph-mon[35032]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:28.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:28.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:28.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:28.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:28.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:28.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:28.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:28.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:28.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:29 smithi110 ceph-mon[35282]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:29 smithi022 ceph-mon[30634]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:29 smithi112 ceph-mon[35032]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:31.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:31 smithi022 ceph-mon[30634]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:31 smithi110 ceph-mon[35282]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:31 smithi112 ceph-mon[35032]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:32.300 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 9 on host 'smithi022' 2024-09-15T22:28:32.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.298+0000 7f10f8c00640 1 -- 172.21.15.22:0/535585308 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10fc062630 con 0x7f10e00a3270 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.300+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10e00a3270 msgr2=0x7f10e00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.300+0000 7f1102200640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10e00a3270 0x7f10e00a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00bbe0 tx=0x7f10ec00b390 comp rx=0 tx=0).stop 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.300+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc104f60 msgr2=0x7f10fc19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.300+0000 7f1102200640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc104f60 0x7f10fc19a590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f10e400e9c0 tx=0x7f10e400ee80 comp rx=0 tx=0).stop 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 shutdown_connections 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10fc104f60 0x7f10fc19a590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10e00a3270 0x7f10e00a5730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10fc105920 0x7f10fc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 --2- 172.21.15.22:0/535585308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10fc103e00 0x7f10fc19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 >> 172.21.15.22:0/535585308 conn(0x7f10fc0ff5b0 msgr2=0x7f10fc108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 shutdown_connections 2024-09-15T22:28:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:28:32.301+0000 7f1102200640 1 -- 172.21.15.22:0/535585308 wait complete. 2024-09-15T22:28:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:32.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:32 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:32.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:32.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:32.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:32 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:32 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:33.110 DEBUG:teuthology.orchestra.run.smithi022:osd.9> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T22:28:33.114 INFO:tasks.cephadm:Deploying osd.10 on smithi110 with /dev/vg_nvme/lv_1... 2024-09-15T22:28:33.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:28:33.368 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:28:33.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:33 smithi112 ceph-mon[35032]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:33.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:33 smithi022 ceph-mon[30634]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:33.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:33 smithi110 ceph-mon[35282]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:34.698 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:28:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:28:34.574+0000 7fc64a01d640 -1 osd.9 0 log_to_monitors true 2024-09-15T22:28:35.487 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:35 smithi110 ceph-mon[35282]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:35.488 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:35 smithi110 ceph-mon[35282]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:28:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:35 smithi022 ceph-mon[30634]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:35 smithi022 ceph-mon[30634]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:28:35.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:35 smithi112 ceph-mon[35032]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:35.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:35 smithi112 ceph-mon[35032]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:28:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-15T22:28:35.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_1 2024-09-15T22:28:36.215 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:28:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:36 smithi022 ceph-mon[30634]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:28:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:36 smithi022 ceph-mon[30634]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:28:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:36 smithi022 ceph-mon[30634]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:28:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:36.623 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:36 smithi110 ceph-mon[35282]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:28:36.623 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:36 smithi110 ceph-mon[35282]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:28:36.623 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:36 smithi110 ceph-mon[35282]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:28:36.623 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:36.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.636+0000 7f0fefb6b640 1 -- 172.21.15.110:0/481360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 msgr2=0x7f0fe8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:36.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.636+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/481360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe8103280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009900 tx=0x7f0fd802a410 comp rx=0 tx=0).stop 2024-09-15T22:28:36.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- 172.21.15.110:0/481360520 shutdown_connections 2024-09-15T22:28:36.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/481360520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fe81037c0 0x7f0fe810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:36.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/481360520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe8103280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:36.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/481360520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fe8101c00 0x7f0fe8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- 172.21.15.110:0/481360520 >> 172.21.15.110:0/481360520 conn(0x7f0fe80fd390 msgr2=0x7f0fe80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- 172.21.15.110:0/481360520 shutdown_connections 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- 172.21.15.110:0/481360520 wait complete. 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 Processor -- start 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- start start 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fe8101c00 0x7f0fe8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fe81037c0 0x7f0fe8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe810d880 con 0x7f0fe8101c00 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe810d700 con 0x7f0fe8102e00 2024-09-15T22:28:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fefb6b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe810da00 con 0x7f0fe81037c0 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.637+0000 7f0fed106640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52646/0 (socket says 172.21.15.110:52646) 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 -- 172.21.15.110:0/1062811556 learned_addr learned my addr 172.21.15.110:0/1062811556 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fee108640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fe81037c0 0x7f0fe8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed907640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fe8101c00 0x7f0fe8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 -- 172.21.15.110:0/1062811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fe81037c0 msgr2=0x7f0fe8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fe81037c0 0x7f0fe8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 -- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fe8101c00 msgr2=0x7f0fe8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fe8101c00 0x7f0fe8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 -- 172.21.15.110:0/1062811556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe80753e0 con 0x7f0fe8102e00 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fed106640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe80745e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009230 tx=0x7f0fd8004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd803f030 con 0x7f0fe8102e00 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe81a2000 con 0x7f0fe8102e00 2024-09-15T22:28:36.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fd8003ce0 con 0x7f0fe8102e00 2024-09-15T22:28:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8035070 con 0x7f0fe8102e00 2024-09-15T22:28:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.638+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe81a2500 con 0x7f0fe8102e00 2024-09-15T22:28:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.639+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe8108fd0 con 0x7f0fe8102e00 2024-09-15T22:28:36.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.640+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0fd8042030 con 0x7f0fe8102e00 2024-09-15T22:28:36.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.641+0000 7f0fdeffd640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0fd40a32c0 0x7f0fd40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:36.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.641+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f0fd80ef890 con 0x7f0fe8102e00 2024-09-15T22:28:36.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.641+0000 7f0fed907640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0fd40a32c0 0x7f0fd40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:36.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.642+0000 7f0fed907640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0fd40a32c0 0x7f0fd40a5780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8102c60 tx=0x7f0fe400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:36.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.645+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fd80bc880 con 0x7f0fe8102e00 2024-09-15T22:28:36.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:36.817+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0fe8062630 con 0x7f0fd40a32c0 2024-09-15T22:28:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:36 smithi112 ceph-mon[35032]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:28:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:36 smithi112 ceph-mon[35032]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:28:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:36 smithi112 ceph-mon[35032]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-15T22:28:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:28:37.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:37.490 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:37 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.695 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:28:37.451+0000 7fc645600640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T22:28:37.695 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:28:37.472+0000 7fc63ac00640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:28:37.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:37.698 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:37.698 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:37 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-15T22:28:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:28:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:37.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:37 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi022 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:38 smithi110 ceph-mon[35282]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' 2024-09-15T22:28:38.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:28:38.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:28:38.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:28:38.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi022 2024-09-15T22:28:38.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-15T22:28:38.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:38.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:38 smithi022 ceph-mon[30634]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi022 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:38 smithi112 ceph-mon[35032]: from='osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873]' entity='osd.9' 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] boot 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/348453510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]: dispatch 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]: dispatch 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]': finished 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: osdmap e62: 11 total, 10 up, 11 in 2024-09-15T22:28:39.686 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:28:39.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:39.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:39.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] boot 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/348453510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]: dispatch 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]: dispatch 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]': finished 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: osdmap e62: 11 total, 10 up, 11 in 2024-09-15T22:28:39.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: osd.9 [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] boot 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/348453510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]: dispatch 2024-09-15T22:28:39.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]: dispatch 2024-09-15T22:28:39.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b"}]': finished 2024-09-15T22:28:39.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: osdmap e62: 11 total, 10 up, 11 in 2024-09-15T22:28:39.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:28:40.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:40 smithi110 ceph-mon[35282]: from='client.? 172.21.15.110:0/3545510386' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:28:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:40 smithi022 ceph-mon[30634]: from='client.? 172.21.15.110:0/3545510386' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:28:40.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:40 smithi112 ceph-mon[35032]: from='client.? 172.21.15.110:0/3545510386' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:28:41.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:41 smithi110 ceph-mon[35282]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:41 smithi022 ceph-mon[30634]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:41.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:41 smithi112 ceph-mon[35032]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:43.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:43 smithi110 ceph-mon[35282]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:43.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:43 smithi022 ceph-mon[30634]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:43.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:43 smithi112 ceph-mon[35032]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:45.578 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:45 smithi110 ceph-mon[35282]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:45.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:45 smithi022 ceph-mon[30634]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:45.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:45 smithi112 ceph-mon[35032]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:47.764 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:47 smithi110 ceph-mon[35282]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:47.764 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:47 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:28:47.764 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:47 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:47 smithi022 ceph-mon[30634]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:47 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:28:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:47 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:47.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:47 smithi112 ceph-mon[35032]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:47.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:47 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:28:47.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:47 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:48.675 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:48 smithi110 ceph-mon[35282]: Deploying daemon osd.10 on smithi110 2024-09-15T22:28:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:48 smithi022 ceph-mon[30634]: Deploying daemon osd.10 on smithi110 2024-09-15T22:28:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:48 smithi112 ceph-mon[35032]: Deploying daemon osd.10 on smithi110 2024-09-15T22:28:49.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:49 smithi022 ceph-mon[30634]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:49.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:49 smithi112 ceph-mon[35032]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:49.871 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:49 smithi110 ceph-mon[35282]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:51.682 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:51 smithi110 ceph-mon[35282]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:51.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:51 smithi022 ceph-mon[30634]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:51.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:51 smithi112 ceph-mon[35032]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:52.569 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:52 smithi110 ceph-mon[35282]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:52.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:52 smithi022 ceph-mon[30634]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:52.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:52 smithi112 ceph-mon[35032]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:53.610 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:53.610 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:53.610 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:53.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:53.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:53.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:53.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:53.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:53.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:54.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:54 smithi112 ceph-mon[35032]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:54.908 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:54 smithi110 ceph-mon[35282]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:55.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:54 smithi022 ceph-mon[30634]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:55.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.910+0000 7f0fdeffd640 1 -- 172.21.15.110:0/1062811556 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f0fe8062630 con 0x7f0fd40a32c0 2024-09-15T22:28:55.912 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 10 on host 'smithi110' 2024-09-15T22:28:55.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0fd40a32c0 msgr2=0x7f0fd40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:55.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0fd40a32c0 0x7f0fd40a5780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8102c60 tx=0x7f0fe400a2d0 comp rx=0 tx=0).stop 2024-09-15T22:28:55.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 msgr2=0x7f0fe80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe80745e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009230 tx=0x7f0fd8004360 comp rx=0 tx=0).stop 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 shutdown_connections 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fe81037c0 0x7f0fe8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0fd40a32c0 0x7f0fd40a5780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fe8102e00 0x7f0fe80745e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 --2- 172.21.15.110:0/1062811556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fe8101c00 0x7f0fe8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 >> 172.21.15.110:0/1062811556 conn(0x7f0fe80fd390 msgr2=0x7f0fe81061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 shutdown_connections 2024-09-15T22:28:55.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-15T22:28:55.912+0000 7f0fefb6b640 1 -- 172.21.15.110:0/1062811556 wait complete. 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:56.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.500 DEBUG:teuthology.orchestra.run.smithi110:osd.10> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T22:28:56.503 INFO:tasks.cephadm:Deploying osd.11 on smithi112 with /dev/vg_nvme/lv_1... 2024-09-15T22:28:56.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:28:56.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:28:56.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:28:56.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:28:56.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:28:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:28:57.414 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:57 smithi110 ceph-mon[35282]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:57.476 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:57 smithi112 ceph-mon[35032]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:57.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:57 smithi022 ceph-mon[30634]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:58.929 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:28:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:28:58.674+0000 7f3176f57640 -1 osd.10 0 log_to_monitors true 2024-09-15T22:28:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:28:59.179 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_1 2024-09-15T22:28:59.243 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:59 smithi112 ceph-mon[35032]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:59.243 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:59 smithi112 ceph-mon[35032]: from='osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:28:59.243 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:28:59 smithi112 ceph-mon[35032]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:28:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:59 smithi110 ceph-mon[35282]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:59 smithi110 ceph-mon[35282]: from='osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:28:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:28:59 smithi110 ceph-mon[35282]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:28:59.472 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:28:59.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:59 smithi022 ceph-mon[30634]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:28:59.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:59 smithi022 ceph-mon[30634]: from='osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:28:59.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:28:59 smithi022 ceph-mon[30634]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:28:59.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- 172.21.15.112:0/3456371913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 msgr2=0x7f6114102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:59.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- 172.21.15.112:0/3456371913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f6114102520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6110009900 tx=0x7f611002a410 comp rx=0 tx=0).stop 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- 172.21.15.112:0/3456371913 shutdown_connections 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- 172.21.15.112:0/3456371913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6114101740 0x7f6114108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- 172.21.15.112:0/3456371913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 0x7f6114101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- 172.21.15.112:0/3456371913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f6114102520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- 172.21.15.112:0/3456371913 >> 172.21.15.112:0/3456371913 conn(0x7f61140fba80 msgr2=0x7f61140fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- 172.21.15.112:0/3456371913 shutdown_connections 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- 172.21.15.112:0/3456371913 wait complete. 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 Processor -- start 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- start start 2024-09-15T22:28:59.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 0x7f611419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6114101740 0x7f611419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f61141a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f611410c800 con 0x7f6114100d80 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f611410c680 con 0x7f6114101740 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.906+0000 7f611b707640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f611410c980 con 0x7f6114102120 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f61141a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f61141a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60174/0 (socket says 172.21.15.112:60174) 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 -- 172.21.15.112:0/353943209 learned_addr learned my addr 172.21.15.112:0/353943209 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6118ca2640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6114101740 0x7f611419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f61194a3640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 0x7f611419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 -- 172.21.15.112:0/353943209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6114101740 msgr2=0x7f611419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6114101740 0x7f611419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:59.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 -- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 msgr2=0x7f611419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 0x7f611419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 -- 172.21.15.112:0/353943209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61141a1e00 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f61194a3640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 0x7f611419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f6119ca4640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f61141a1790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f610c00eaa0 tx=0x7f610c00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c004d20 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f610c005020 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61141a20f0 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c0116d0 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.907+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61141a2700 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.909+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61141a29c0 con 0x7f6114102120 2024-09-15T22:28:59.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.909+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f610c00caf0 con 0x7f6114102120 2024-09-15T22:28:59.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.910+0000 7f610a7fc640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f61000a32f0 0x7f61000a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:28:59.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.910+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6398+0+0 (secure 0 0 0) 0x7f610c0cf310 con 0x7f6114102120 2024-09-15T22:28:59.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.910+0000 7f61194a3640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f61000a32f0 0x7f61000a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:28:59.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.911+0000 7f61194a3640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f61000a32f0 0x7f61000a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6110000c00 tx=0x7f6110031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:28:59.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:28:59.914+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f610c016030 con 0x7f6114102120 2024-09-15T22:29:00.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:00.090+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f61141a2b90 con 0x7f61000a32f0 2024-09-15T22:29:00.449 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi110 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi110 to 4272M 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:29:00.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:29:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:29:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:29:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:00.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi110 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi110 to 4272M 2024-09-15T22:29:00.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:00.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:29:00.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:29:00.458 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:00.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:29:00.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:29:00.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi110 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi110 to 4272M 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:00.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:00.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:29:00.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:29:00.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:01.199 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:29:00.854+0000 7f31736ee640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T22:29:01.199 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:29:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:29:00.865+0000 7f316ace9640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:29:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:29:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:29:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:29:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:29:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: from='osd.10 ' entity='osd.10' 2024-09-15T22:29:01.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] boot 2024-09-15T22:29:01.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: osdmap e65: 11 total, 11 up, 11 in 2024-09-15T22:29:01.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:29:01.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: from='osd.10 ' entity='osd.10' 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] boot 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: osdmap e65: 11 total, 11 up, 11 in 2024-09-15T22:29:01.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:29:01.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:29:01.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: from='osd.10 ' entity='osd.10' 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: osd.10 [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] boot 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: osdmap e65: 11 total, 11 up, 11 in 2024-09-15T22:29:01.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:29:02.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:02 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:29:02.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:02 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:29:02.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:02 smithi110 ceph-mon[35282]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:29:02.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:02 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:29:02.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:02 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:29:02.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:02 smithi022 ceph-mon[30634]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:29:02.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:02 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:29:02.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:02 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:29:02.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:02 smithi112 ceph-mon[35032]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:29:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 771 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/1075321556' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]: dispatch 2024-09-15T22:29:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]: dispatch 2024-09-15T22:29:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]': finished 2024-09-15T22:29:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: osdmap e67: 12 total, 11 up, 12 in 2024-09-15T22:29:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:03.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:03 smithi112 ceph-mon[35032]: from='client.? 172.21.15.112:0/2267177243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 771 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/1075321556' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]: dispatch 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]: dispatch 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]': finished 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: osdmap e67: 12 total, 11 up, 12 in 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:03.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:03 smithi110 ceph-mon[35282]: from='client.? 172.21.15.112:0/2267177243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 771 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/1075321556' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]: dispatch 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]: dispatch 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82f9f6ab-86fe-40e5-879a-0c6230700163"}]': finished 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: osdmap e67: 12 total, 11 up, 12 in 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:03.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:03 smithi022 ceph-mon[30634]: from='client.? 172.21.15.112:0/2267177243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:29:04.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:04 smithi022 ceph-mon[30634]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:29:04.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:04.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:04 smithi022 ceph-mon[30634]: pgmap v235: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 772 MiB used, 983 GiB / 983 GiB avail; 173 KiB/s, 0 objects/s recovering 2024-09-15T22:29:04.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:04 smithi112 ceph-mon[35032]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:29:04.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:04.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:04 smithi112 ceph-mon[35032]: pgmap v235: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 772 MiB used, 983 GiB / 983 GiB avail; 173 KiB/s, 0 objects/s recovering 2024-09-15T22:29:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:04 smithi110 ceph-mon[35282]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:29:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:04 smithi110 ceph-mon[35282]: pgmap v235: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 772 MiB used, 983 GiB / 983 GiB avail; 173 KiB/s, 0 objects/s recovering 2024-09-15T22:29:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:05 smithi022 ceph-mon[30634]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:29:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:05.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:05 smithi112 ceph-mon[35032]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:29:05.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:05.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:05 smithi110 ceph-mon[35282]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:29:05.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:06.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:06 smithi112 ceph-mon[35032]: pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 772 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:29:06.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:06 smithi110 ceph-mon[35282]: pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 772 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:29:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:06 smithi022 ceph-mon[30634]: pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 772 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:29:08.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:08 smithi112 ceph-mon[35032]: pgmap v238: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-15T22:29:08.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:08 smithi110 ceph-mon[35282]: pgmap v238: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-15T22:29:09.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:08 smithi022 ceph-mon[30634]: pgmap v238: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-15T22:29:09.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:29:09 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:29:09.491+0000 7f4fa6800640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T22:29:10.734 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:10 smithi112 ceph-mon[35032]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-15T22:29:10.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:10 smithi110 ceph-mon[35282]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-15T22:29:11.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:10 smithi022 ceph-mon[30634]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-15T22:29:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:29:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:11 smithi112 ceph-mon[35032]: Deploying daemon osd.11 on smithi112 2024-09-15T22:29:11.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:29:11.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:11.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:11 smithi022 ceph-mon[30634]: Deploying daemon osd.11 on smithi112 2024-09-15T22:29:11.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:29:11.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:11.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:11 smithi110 ceph-mon[35282]: Deploying daemon osd.11 on smithi112 2024-09-15T22:29:12.676 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:12 smithi112 ceph-mon[35032]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:12.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:12 smithi110 ceph-mon[35282]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:12 smithi022 ceph-mon[30634]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:14.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:14 smithi112 ceph-mon[35032]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:14.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:14 smithi110 ceph-mon[35282]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:14 smithi022 ceph-mon[30634]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:16.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:16 smithi110 ceph-mon[35282]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:16 smithi022 ceph-mon[30634]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:17.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:16 smithi112 ceph-mon[35032]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:17 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:17 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:17 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:18.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:17 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:18.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:17 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:18.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:17 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:18.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:17 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:18.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:17 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:18.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:17 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:19.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:18 smithi112 ceph-mon[35032]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:18 smithi110 ceph-mon[35282]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:19.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:18 smithi022 ceph-mon[30634]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:20.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.103+0000 7f610a7fc640 1 -- 172.21.15.112:0/353943209 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f61141a2b90 con 0x7f61000a32f0 2024-09-15T22:29:20.105 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 11 on host 'smithi112' 2024-09-15T22:29:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f61000a32f0 msgr2=0x7f61000a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f61000a32f0 0x7f61000a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6110000c00 tx=0x7f6110031400 comp rx=0 tx=0).stop 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 msgr2=0x7f61141a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f61141a1790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f610c00eaa0 tx=0x7f610c00eea0 comp rx=0 tx=0).stop 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 shutdown_connections 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6114102120 0x7f61141a1790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f61000a32f0 0x7f61000a57b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6114101740 0x7f611419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 --2- 172.21.15.112:0/353943209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6114100d80 0x7f611419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 >> 172.21.15.112:0/353943209 conn(0x7f61140fba80 msgr2=0x7f61140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 shutdown_connections 2024-09-15T22:29:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:20.106+0000 7f611b707640 1 -- 172.21.15.112:0/353943209 wait complete. 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.725 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.752 DEBUG:teuthology.orchestra.run.smithi112:osd.11> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T22:29:20.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:20.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:20.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:20.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.796 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T22:29:20.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:29:20.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:20.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:20.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:20.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:20.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:21.638 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:21 smithi022 ceph-mon[30634]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:21.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 -- 172.21.15.22:0/3592503172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 msgr2=0x7f1a80079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:21.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3592503172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 0x7f1a80079030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009ca0 tx=0x7f1a7802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 -- 172.21.15.22:0/3592503172 shutdown_connections 2024-09-15T22:29:21.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3592503172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 0x7f1a80079030 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3592503172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80077df0 0x7f1a80078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3592503172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a80076ba0 0x7f1a80076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 -- 172.21.15.22:0/3592503172 >> 172.21.15.22:0/3592503172 conn(0x7f1a800ff5b0 msgr2=0x7f1a801019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 -- 172.21.15.22:0/3592503172 shutdown_connections 2024-09-15T22:29:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.751+0000 7f1a86a00640 1 -- 172.21.15.22:0/3592503172 wait complete. 2024-09-15T22:29:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 Processor -- start 2024-09-15T22:29:21.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 -- start start 2024-09-15T22:29:21.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 0x7f1a8019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a80077df0 0x7f1a8019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 0x7f1a801a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80113ea0 con 0x7f1a80078790 2024-09-15T22:29:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80113d20 con 0x7f1a80076ba0 2024-09-15T22:29:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a86a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80114020 con 0x7f1a80077df0 2024-09-15T22:29:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a7fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 0x7f1a8019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a7fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 0x7f1a8019e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39212/0 (socket says 172.21.15.22:39212) 2024-09-15T22:29:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a7fe00640 1 -- 172.21.15.22:0/3743746004 learned_addr learned my addr 172.21.15.22:0/3743746004 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.752+0000 7f1a77e00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a80077df0 0x7f1a8019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a84a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 0x7f1a801a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7fe00640 1 -- 172.21.15.22:0/3743746004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a80077df0 msgr2=0x7f1a8019e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7fe00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a80077df0 0x7f1a8019e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7fe00640 1 -- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 msgr2=0x7f1a801a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7fe00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 0x7f1a801a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7fe00640 1 -- 172.21.15.22:0/3743746004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a801a60c0 con 0x7f1a80076ba0 2024-09-15T22:29:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7fe00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 0x7f1a8019e490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000e9f0 tx=0x7f1a7000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000cd80 con 0x7f1a80076ba0 2024-09-15T22:29:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a801a63b0 con 0x7f1a80076ba0 2024-09-15T22:29:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a70005500 con 0x7f1a80076ba0 2024-09-15T22:29:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.753+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70010690 con 0x7f1a80076ba0 2024-09-15T22:29:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.754+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a801a68a0 con 0x7f1a80076ba0 2024-09-15T22:29:21.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.755+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a80110780 con 0x7f1a80076ba0 2024-09-15T22:29:21.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.756+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1a700046c0 con 0x7f1a80076ba0 2024-09-15T22:29:21.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.758+0000 7f1a7d600640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a640a3270 0x7f1a640a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:21.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.758+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7f1a700cfad0 con 0x7f1a80076ba0 2024-09-15T22:29:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.758+0000 7f1a77e00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a640a3270 0x7f1a640a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.758+0000 7f1a77e00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a640a3270 0x7f1a640a5730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a8019f9b0 tx=0x7f1a68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.760+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a7009cd30 con 0x7f1a80076ba0 2024-09-15T22:29:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:21 smithi112 ceph-mon[35032]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:21.857 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:21 smithi110 ceph-mon[35282]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.946+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1a80062df0 con 0x7f1a80076ba0 2024-09-15T22:29:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.946+0000 7f1a7d600640 1 -- 172.21.15.22:0/3743746004 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f1a7009c630 con 0x7f1a80076ba0 2024-09-15T22:29:21.949 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a640a3270 msgr2=0x7f1a640a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a640a3270 0x7f1a640a5730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a8019f9b0 tx=0x7f1a68005f90 comp rx=0 tx=0).stop 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 msgr2=0x7f1a8019e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 0x7f1a8019e490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000e9f0 tx=0x7f1a7000edf0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 shutdown_connections 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a80077df0 0x7f1a8019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a640a3270 0x7f1a640a5730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80078790 0x7f1a801a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 --2- 172.21.15.22:0/3743746004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a80076ba0 0x7f1a8019e490 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 >> 172.21.15.22:0/3743746004 conn(0x7f1a800ff5b0 msgr2=0x7f1a80101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:21.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 shutdown_connections 2024-09-15T22:29:21.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:21.950+0000 7f1a86a00640 1 -- 172.21.15.22:0/3743746004 wait complete. 2024-09-15T22:29:22.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:22 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3743746004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:22.726 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:22 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3743746004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:22.764 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726439341,"num_in_osds":12,"osd_in_since":1726439342,"num_remapped_pgs":0} 2024-09-15T22:29:22.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:22 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3743746004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:23.205 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:29:22 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:29:22.950+0000 7fdbfcbb7640 -1 osd.11 0 log_to_monitors true 2024-09-15T22:29:23.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:29:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:23 smithi022 ceph-mon[30634]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:23 smithi022 ceph-mon[30634]: from='osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:29:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:23 smithi022 ceph-mon[30634]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:29:23.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:23 smithi112 ceph-mon[35032]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:23.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:23 smithi112 ceph-mon[35032]: from='osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:29:23.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:23 smithi112 ceph-mon[35032]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:29:23.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:23 smithi110 ceph-mon[35282]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:23.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:23 smithi110 ceph-mon[35282]: from='osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:29:23.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:23 smithi110 ceph-mon[35282]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:29:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:24.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:29:24.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: Detected new or changed devices on smithi112 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-15T22:29:24.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:24.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:24.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:24 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 -- 172.21.15.22:0/2179226689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094104f60 msgr2=0x7f60941053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 --2- 172.21.15.22:0/2179226689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094104f60 0x7f60941053e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6080009900 tx=0x7f608002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 -- 172.21.15.22:0/2179226689 shutdown_connections 2024-09-15T22:29:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 --2- 172.21.15.22:0/2179226689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094104f60 0x7f60941053e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 --2- 172.21.15.22:0/2179226689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6094105920 0x7f609410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 --2- 172.21.15.22:0/2179226689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 0x7f6094104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 -- 172.21.15.22:0/2179226689 >> 172.21.15.22:0/2179226689 conn(0x7f60940ff5b0 msgr2=0x7f60941019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 -- 172.21.15.22:0/2179226689 shutdown_connections 2024-09-15T22:29:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.725+0000 7f609c400640 1 -- 172.21.15.22:0/2179226689 wait complete. 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.726+0000 7f609c400640 1 Processor -- start 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.726+0000 7f609c400640 1 -- start start 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609c400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 0x7f609419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609c400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6094104f60 0x7f609419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609c400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 0x7f60941a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609c400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f609410fb00 con 0x7f6094103e00 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609c400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f609410f980 con 0x7f6094104f60 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609c400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f609410fc80 con 0x7f6094105920 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f6099a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 0x7f609419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:24.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 0x7f60941a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f6099a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 0x7f609419a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60068/0 (socket says 172.21.15.22:60068) 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 0x7f60941a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:59842/0 (socket says 172.21.15.22:59842) 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f6099a00640 1 -- 172.21.15.22:0/1526602180 learned_addr learned my addr 172.21.15.22:0/1526602180 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f6099000640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6094104f60 0x7f609419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 -- 172.21.15.22:0/1526602180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6094104f60 msgr2=0x7f609419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6094104f60 0x7f609419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 -- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 msgr2=0x7f609419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 0x7f609419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.727+0000 7f609a400640 1 -- 172.21.15.22:0/1526602180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60941a1d30 con 0x7f6094105920 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.728+0000 7f609a400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 0x7f60941a16c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f608c009fd0 tx=0x7f608c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.728+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c00ce20 con 0x7f6094105920 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.728+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f608c005020 con 0x7f6094105920 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.728+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60941a1fc0 con 0x7f6094105920 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.728+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c010720 con 0x7f6094105920 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.728+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60941a2520 con 0x7f6094105920 2024-09-15T22:29:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.729+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609410b120 con 0x7f6094105920 2024-09-15T22:29:24.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.731+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f608c005540 con 0x7f6094105920 2024-09-15T22:29:24.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.732+0000 7f6092000640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f607c0a32f0 0x7f607c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:24.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.733+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7f608c0cfb90 con 0x7f6094105920 2024-09-15T22:29:24.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.733+0000 7f6099a00640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f607c0a32f0 0x7f607c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:24.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.733+0000 7f6099a00640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f607c0a32f0 0x7f607c0a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60880095f0 tx=0x7f6088005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:24.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.735+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f608c09cdd0 con 0x7f6094105920 2024-09-15T22:29:24.775 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:29:24.775 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:29:24.775 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: Detected new or changed devices on smithi112 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-15T22:29:24.776 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.777 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:24.777 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:24.777 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:24 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.924+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6094062df0 con 0x7f6094105920 2024-09-15T22:29:24.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.924+0000 7f6092000640 1 -- 172.21.15.22:0/1526602180 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f608c09c6d0 con 0x7f6094105920 2024-09-15T22:29:24.926 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:24.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.926+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f607c0a32f0 msgr2=0x7f607c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.926+0000 7f609c400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f607c0a32f0 0x7f607c0a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60880095f0 tx=0x7f6088005f90 comp rx=0 tx=0).stop 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.926+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 msgr2=0x7f60941a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.926+0000 7f609c400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 0x7f60941a16c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f608c009fd0 tx=0x7f608c00ef10 comp rx=0 tx=0).stop 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 shutdown_connections 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094105920 0x7f60941a16c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f607c0a32f0 0x7f607c0a57b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6094104f60 0x7f609419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 --2- 172.21.15.22:0/1526602180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6094103e00 0x7f609419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 >> 172.21.15.22:0/1526602180 conn(0x7f60940ff5b0 msgr2=0x7f60941082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 shutdown_connections 2024-09-15T22:29:24.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:24.927+0000 7f609c400640 1 -- 172.21.15.22:0/1526602180 wait complete. 2024-09-15T22:29:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:29:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:29:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:29:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: Detected new or changed devices on smithi112 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:24.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:24.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:24 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:25.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:29:25.317+0000 7fdbf8317640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T22:29:25.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:29:25.331+0000 7fdbf0949640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:29:25.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-mon[35032]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:29:25.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-mon[35032]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:29:25.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:25.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:25.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1526602180' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:25.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:25 smithi112 ceph-mon[35032]: from='osd.11 ' entity='osd.11' 2024-09-15T22:29:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:25 smithi022 ceph-mon[30634]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:29:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:25 smithi022 ceph-mon[30634]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:29:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:25 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:25 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1526602180' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:25 smithi022 ceph-mon[30634]: from='osd.11 ' entity='osd.11' 2024-09-15T22:29:25.853 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726439341,"num_in_osds":12,"osd_in_since":1726439342,"num_remapped_pgs":0} 2024-09-15T22:29:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:25 smithi110 ceph-mon[35282]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T22:29:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:25 smithi110 ceph-mon[35282]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:29:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:25 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:25 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1526602180' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:25 smithi110 ceph-mon[35282]: from='osd.11 ' entity='osd.11' 2024-09-15T22:29:26.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: purged_snaps scrub starts 2024-09-15T22:29:26.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: purged_snaps scrub ok 2024-09-15T22:29:26.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:26.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:26.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] boot 2024-09-15T22:29:26.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: osdmap e72: 12 total, 12 up, 12 in 2024-09-15T22:29:26.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:26 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: purged_snaps scrub starts 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: purged_snaps scrub ok 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] boot 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: osdmap e72: 12 total, 12 up, 12 in 2024-09-15T22:29:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:26 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:26.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: purged_snaps scrub starts 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: purged_snaps scrub ok 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: osd.11 [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] boot 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: osdmap e72: 12 total, 12 up, 12 in 2024-09-15T22:29:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:26 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:29:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:27.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 -- 172.21.15.22:0/3939949623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0102e00 msgr2=0x7f91a0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 --2- 172.21.15.22:0/3939949623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0102e00 0x7f91a0103280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f918c009900 tx=0x7f918c02a410 comp rx=0 tx=0).stop 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 -- 172.21.15.22:0/3939949623 shutdown_connections 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 --2- 172.21.15.22:0/3939949623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a01037c0 0x7f91a010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 --2- 172.21.15.22:0/3939949623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0102e00 0x7f91a0103280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 --2- 172.21.15.22:0/3939949623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a0101c00 0x7f91a0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 -- 172.21.15.22:0/3939949623 >> 172.21.15.22:0/3939949623 conn(0x7f91a00fd390 msgr2=0x7f91a00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 -- 172.21.15.22:0/3939949623 shutdown_connections 2024-09-15T22:29:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.811+0000 7f91a6200640 1 -- 172.21.15.22:0/3939949623 wait complete. 2024-09-15T22:29:27.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.812+0000 7f91a6200640 1 Processor -- start 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 -- start start 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 0x7f91a019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a0102e00 0x7f91a019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a01037c0 0x7f91a01a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91a010d8d0 con 0x7f91a0101c00 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f91a010d750 con 0x7f91a01037c0 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f91a6200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f91a010da50 con 0x7f91a0102e00 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f919f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 0x7f91a019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:27.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f919f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 0x7f91a019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60086/0 (socket says 172.21.15.22:60086) 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f919f400640 1 -- 172.21.15.22:0/3786145692 learned_addr learned my addr 172.21.15.22:0/3786145692 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f919ea00640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a0102e00 0x7f91a019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.813+0000 7f919fe00640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a01037c0 0x7f91a01a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f919f400640 1 -- 172.21.15.22:0/3786145692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a0102e00 msgr2=0x7f91a019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f919f400640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a0102e00 0x7f91a019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f919f400640 1 -- 172.21.15.22:0/3786145692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a01037c0 msgr2=0x7f91a01a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f919f400640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a01037c0 0x7f91a01a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f919f400640 1 -- 172.21.15.22:0/3786145692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a01a1d50 con 0x7f91a0101c00 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f919f400640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 0x7f91a019a120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f919000e9c0 tx=0x7f919000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919000cd80 con 0x7f91a0101c00 2024-09-15T22:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91900035f0 con 0x7f91a0101c00 2024-09-15T22:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a01a1fe0 con 0x7f91a0101c00 2024-09-15T22:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.814+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190010690 con 0x7f91a0101c00 2024-09-15T22:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.815+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a01a2490 con 0x7f91a0101c00 2024-09-15T22:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.816+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a01a2720 con 0x7f91a0101c00 2024-09-15T22:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.817+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f91900037a0 con 0x7f91a0101c00 2024-09-15T22:29:27.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.819+0000 7f9197e00640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f91840a32f0 0x7f91840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:27.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.819+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f91900cf7b0 con 0x7f91a0101c00 2024-09-15T22:29:27.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.819+0000 7f919ea00640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f91840a32f0 0x7f91840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:27.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.820+0000 7f919ea00640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f91840a32f0 0x7f91840a57b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f918c031440 tx=0x7f918c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:27.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:27.823+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f919009c8d0 con 0x7f91a0101c00 2024-09-15T22:29:28.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.010+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f91a01a2fb0 con 0x7f91a0101c00 2024-09-15T22:29:28.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.011+0000 7f9197e00640 1 -- 172.21.15.22:0/3786145692 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f919009c1d0 con 0x7f91a0101c00 2024-09-15T22:29:28.013 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f91840a32f0 msgr2=0x7f91840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f91840a32f0 0x7f91840a57b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f918c031440 tx=0x7f918c0315b0 comp rx=0 tx=0).stop 2024-09-15T22:29:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 msgr2=0x7f91a019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 0x7f91a019a120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f919000e9c0 tx=0x7f919000ee80 comp rx=0 tx=0).stop 2024-09-15T22:29:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 shutdown_connections 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91a0102e00 0x7f91a019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f91840a32f0 0x7f91840a57b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a01037c0 0x7f91a01a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 --2- 172.21.15.22:0/3786145692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0101c00 0x7f91a019a120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 >> 172.21.15.22:0/3786145692 conn(0x7f91a00fd390 msgr2=0x7f91a0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.013+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 shutdown_connections 2024-09-15T22:29:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:28.014+0000 7f91a6200640 1 -- 172.21.15.22:0/3786145692 wait complete. 2024-09-15T22:29:28.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:28 smithi022 ceph-mon[30634]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:29:28.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:28 smithi022 ceph-mon[30634]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:28.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:28 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3786145692' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:28 smithi112 ceph-mon[35032]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:29:28.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:28 smithi112 ceph-mon[35032]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:28.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:28 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3786145692' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:28.882 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726439366,"num_in_osds":12,"osd_in_since":1726439342,"num_remapped_pgs":0} 2024-09-15T22:29:28.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:29:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:28 smithi110 ceph-mon[35282]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:29:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:28 smithi110 ceph-mon[35282]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:28 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3786145692' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:29:29.257 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:29.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.763+0000 7fbed9000640 1 -- 172.21.15.22:0/132052906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed4109120 msgr2=0x7fbed4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.763+0000 7fbed9000640 1 --2- 172.21.15.22:0/132052906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed4109120 0x7fbed4110ca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009ca0 tx=0x7fbecc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 -- 172.21.15.22:0/132052906 shutdown_connections 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 --2- 172.21.15.22:0/132052906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed4109120 0x7fbed4110ca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 --2- 172.21.15.22:0/132052906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed41049a0 0x7fbed41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 --2- 172.21.15.22:0/132052906 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed4103ff0 0x7fbed41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 -- 172.21.15.22:0/132052906 >> 172.21.15.22:0/132052906 conn(0x7fbed40ffa90 msgr2=0x7fbed4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 -- 172.21.15.22:0/132052906 shutdown_connections 2024-09-15T22:29:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.764+0000 7fbed9000640 1 -- 172.21.15.22:0/132052906 wait complete. 2024-09-15T22:29:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 Processor -- start 2024-09-15T22:29:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 -- start start 2024-09-15T22:29:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed4103ff0 0x7fbed419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 0x7fbed419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed4109120 0x7fbed419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbed41141a0 con 0x7fbed41049a0 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbed4114020 con 0x7fbed4103ff0 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbed9000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbed4114320 con 0x7fbed4109120 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.765+0000 7fbec9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 0x7fbed419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbed2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed4109120 0x7fbed419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 0x7fbed419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60096/0 (socket says 172.21.15.22:60096) 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 -- 172.21.15.22:0/3832125598 learned_addr learned my addr 172.21.15.22:0/3832125598 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbed1e00640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed4103ff0 0x7fbed419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 -- 172.21.15.22:0/3832125598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed4109120 msgr2=0x7fbed419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed4109120 0x7fbed419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 -- 172.21.15.22:0/3832125598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed4103ff0 msgr2=0x7fbed419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed4103ff0 0x7fbed419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 -- 172.21.15.22:0/3832125598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed419f570 con 0x7fbed41049a0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.766+0000 7fbec9400640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 0x7fbed419ab00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00d950 tx=0x7fbebc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.767+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc017030 con 0x7fbed41049a0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.767+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed419f860 con 0x7fbed41049a0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.767+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbebc004020 con 0x7fbed41049a0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.767+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0047a0 con 0x7fbed41049a0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.767+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed41a7140 con 0x7fbed41049a0 2024-09-15T22:29:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.768+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed41043d0 con 0x7fbed41049a0 2024-09-15T22:29:29.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.770+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbebc0041d0 con 0x7fbed41049a0 2024-09-15T22:29:29.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.772+0000 7fbecb400640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeb80a3240 0x7fbeb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:29.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.772+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbebc0cf470 con 0x7fbed41049a0 2024-09-15T22:29:29.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.772+0000 7fbed1e00640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeb80a3240 0x7fbeb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:29.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.773+0000 7fbed1e00640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeb80a3240 0x7fbeb80a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbec4005fd0 tx=0x7fbec400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.775+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbebc09c590 con 0x7fbed41049a0 2024-09-15T22:29:29.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.961+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbed419b920 con 0x7fbed41049a0 2024-09-15T22:29:29.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.962+0000 7fbecb400640 1 -- 172.21.15.22:0/3832125598 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18482 (secure 0 0 0) 0x7fbed419b920 con 0x7fbed41049a0 2024-09-15T22:29:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:29.964 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":73,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:29:27.495959+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeb80a3240 msgr2=0x7fbeb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeb80a3240 0x7fbeb80a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbec4005fd0 tx=0x7fbec400b390 comp rx=0 tx=0).stop 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 msgr2=0x7fbed419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 0x7fbed419ab00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00d950 tx=0x7fbebc00de10 comp rx=0 tx=0).stop 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 shutdown_connections 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbed4109120 0x7fbed419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeb80a3240 0x7fbeb80a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbed41049a0 0x7fbed419ab00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 --2- 172.21.15.22:0/3832125598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed4103ff0 0x7fbed419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 >> 172.21.15.22:0/3832125598 conn(0x7fbed40ffa90 msgr2=0x7fbed41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 shutdown_connections 2024-09-15T22:29:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:29.964+0000 7fbed9000640 1 -- 172.21.15.22:0/3832125598 wait complete. 2024-09-15T22:29:30.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:30 smithi022 ceph-mon[30634]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:30.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:30 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3832125598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:29:30.851 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:25:32.084179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:29:30.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T22:29:30.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:30 smithi112 ceph-mon[35032]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:30.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:30 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3832125598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:29:30.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:30 smithi110 ceph-mon[35282]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:30.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:30 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3832125598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:29:31.224 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:31.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 -- 172.21.15.22:0/2144286897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0098074ee0 msgr2=0x7f009810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:31.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 --2- 172.21.15.22:0/2144286897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0098074ee0 0x7f009810def0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0084009900 tx=0x7f008402a480 comp rx=0 tx=0).stop 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 -- 172.21.15.22:0/2144286897 shutdown_connections 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 --2- 172.21.15.22:0/2144286897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009810e430 0x7f0098110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 --2- 172.21.15.22:0/2144286897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0098074ee0 0x7f009810def0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 --2- 172.21.15.22:0/2144286897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00980745c0 0x7f00980749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 -- 172.21.15.22:0/2144286897 >> 172.21.15.22:0/2144286897 conn(0x7f00980fd8b0 msgr2=0x7f00980ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 -- 172.21.15.22:0/2144286897 shutdown_connections 2024-09-15T22:29:31.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.765+0000 7f009d200640 1 -- 172.21.15.22:0/2144286897 wait complete. 2024-09-15T22:29:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.766+0000 7f009d200640 1 Processor -- start 2024-09-15T22:29:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.766+0000 7f009d200640 1 -- start start 2024-09-15T22:29:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f009d200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 0x7f009819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f009d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0098074ee0 0x7f009819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f009d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009810e430 0x7f009819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:31.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f009d200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0098114180 con 0x7f00980745c0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f009d200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0098114000 con 0x7f0098074ee0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f009d200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0098114300 con 0x7f009810e430 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f0095e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 0x7f009819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f0095e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 0x7f009819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45592/0 (socket says 172.21.15.22:45592) 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f0095400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0098074ee0 0x7f009819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f0095e00640 1 -- 172.21.15.22:0/1879179890 learned_addr learned my addr 172.21.15.22:0/1879179890 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.767+0000 7f0096800640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009810e430 0x7f009819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f0095e00640 1 -- 172.21.15.22:0/1879179890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009810e430 msgr2=0x7f009819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f0095e00640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009810e430 0x7f009819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f0095e00640 1 -- 172.21.15.22:0/1879179890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0098074ee0 msgr2=0x7f009819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f0095e00640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0098074ee0 0x7f009819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f0095e00640 1 -- 172.21.15.22:0/1879179890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009819f5f0 con 0x7f00980745c0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f0095e00640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 0x7f009819a640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f008800e9f0 tx=0x7f008800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:31.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008800cd80 con 0x7f00980745c0 2024-09-15T22:29:31.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0088010910 con 0x7f00980745c0 2024-09-15T22:29:31.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088018990 con 0x7f00980745c0 2024-09-15T22:29:31.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009819f8e0 con 0x7f00980745c0 2024-09-15T22:29:31.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.768+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00981a71c0 con 0x7f00980745c0 2024-09-15T22:29:31.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.769+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00980749a0 con 0x7f00980745c0 2024-09-15T22:29:31.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.771+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0088010ac0 con 0x7f00980745c0 2024-09-15T22:29:31.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.773+0000 7f008ea00640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f007c0a32c0 0x7f007c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:31.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.774+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f00880cf780 con 0x7f00980745c0 2024-09-15T22:29:31.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.774+0000 7f0095400640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f007c0a32c0 0x7f007c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:31.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.774+0000 7f0095400640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f007c0a32c0 0x7f007c0a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0084009230 tx=0x7f00840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.777+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f008809c250 con 0x7f00980745c0 2024-09-15T22:29:31.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.965+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f009802d7c0 con 0x7f00980745c0 2024-09-15T22:29:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.965+0000 7f008ea00640 1 -- 172.21.15.22:0/1879179890 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f00880a0550 con 0x7f00980745c0 2024-09-15T22:29:31.967 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f007c0a32c0 msgr2=0x7f007c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f007c0a32c0 0x7f007c0a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0084009230 tx=0x7f00840058d0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 msgr2=0x7f009819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 0x7f009819a640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f008800e9f0 tx=0x7f008800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 shutdown_connections 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009810e430 0x7f009819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f007c0a32c0 0x7f007c0a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0098074ee0 0x7f009819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 --2- 172.21.15.22:0/1879179890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00980745c0 0x7f009819a640 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 >> 172.21.15.22:0/1879179890 conn(0x7f00980fd8b0 msgr2=0x7f00980fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 shutdown_connections 2024-09-15T22:29:31.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:31.968+0000 7f009d200640 1 -- 172.21.15.22:0/1879179890 wait complete. 2024-09-15T22:29:32.619 INFO:tasks.cephadm:Adding mds.a on smithi022 2024-09-15T22:29:32.619 INFO:tasks.cephadm:Adding mds.d on smithi022 2024-09-15T22:29:32.619 INFO:tasks.cephadm:Adding mds.g on smithi022 2024-09-15T22:29:32.619 INFO:tasks.cephadm:Adding mds.j on smithi022 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.b on smithi110 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.e on smithi110 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.h on smithi110 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.k on smithi110 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.c on smithi112 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.f on smithi112 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.i on smithi112 2024-09-15T22:29:32.620 INFO:tasks.cephadm:Adding mds.l on smithi112 2024-09-15T22:29:32.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l' 2024-09-15T22:29:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:32 smithi112 ceph-mon[35032]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:32 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1879179890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:29:32.878 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:29:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:32 smithi110 ceph-mon[35282]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:32 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1879179890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:29:33.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:32 smithi022 ceph-mon[30634]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:33.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:32 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1879179890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:29:33.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 -- 172.21.15.112:0/2085510900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424101c00 msgr2=0x7f2424102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 --2- 172.21.15.112:0/2085510900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424101c00 0x7f2424102000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2420009900 tx=0x7f242002a410 comp rx=0 tx=0).stop 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 -- 172.21.15.112:0/2085510900 shutdown_connections 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 --2- 172.21.15.112:0/2085510900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24241037c0 0x7f242410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 --2- 172.21.15.112:0/2085510900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424102e00 0x7f2424103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 --2- 172.21.15.112:0/2085510900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424101c00 0x7f2424102000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 -- 172.21.15.112:0/2085510900 >> 172.21.15.112:0/2085510900 conn(0x7f24240fd390 msgr2=0x7f24240ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 -- 172.21.15.112:0/2085510900 shutdown_connections 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.316+0000 7f242ad51640 1 -- 172.21.15.112:0/2085510900 wait complete. 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 Processor -- start 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 -- start start 2024-09-15T22:29:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101c00 0x7f2424075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 0x7f24240745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24241037c0 0x7f2424074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f242410d8e0 con 0x7f2424101c00 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f242410d760 con 0x7f24241037c0 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f242ad51640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f242410da60 con 0x7f2424102e00 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 0x7f24240745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 0x7f24240745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47000/0 (socket says 172.21.15.112:47000) 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 -- 172.21.15.112:0/2055741464 learned_addr learned my addr 172.21.15.112:0/2055741464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f24292ee640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24241037c0 0x7f2424074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f2428aed640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101c00 0x7f2424075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 -- 172.21.15.112:0/2055741464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24241037c0 msgr2=0x7f2424074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24241037c0 0x7f2424074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 -- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101c00 msgr2=0x7f2424075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101c00 0x7f2424075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 -- 172.21.15.112:0/2055741464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24240753e0 con 0x7f2424102e00 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f2428aed640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101c00 0x7f2424075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.317+0000 7f241bfff640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 0x7f24240745e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f241400b4a0 tx=0x7f241400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.318+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414014070 con 0x7f2424102e00 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.318+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2414010af0 con 0x7f2424102e00 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.318+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414017d10 con 0x7f2424102e00 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.318+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24241a20a0 con 0x7f2424102e00 2024-09-15T22:29:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.318+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24241a2680 con 0x7f2424102e00 2024-09-15T22:29:33.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.319+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2424109050 con 0x7f2424102e00 2024-09-15T22:29:33.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.320+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2414017070 con 0x7f2424102e00 2024-09-15T22:29:33.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.321+0000 7f2419ffb640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f240c0a32c0 0x7f240c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:33.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.321+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f24140ceb30 con 0x7f2424102e00 2024-09-15T22:29:33.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.321+0000 7f2428aed640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f240c0a32c0 0x7f240c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:33.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.322+0000 7f2428aed640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f240c0a32c0 0x7f240c0a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2420000c00 tx=0x7f2420031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:33.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.324+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f241409bcf0 con 0x7f2424102e00 2024-09-15T22:29:33.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.498+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}) -- 0x7f2424062730 con 0x7f240c0a32c0 2024-09-15T22:29:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.506+0000 7f2419ffb640 1 -- 172.21.15.112:0/2055741464 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2424062730 con 0x7f240c0a32c0 2024-09-15T22:29:33.509 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mds.all update... 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.508+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f240c0a32c0 msgr2=0x7f240c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.508+0000 7f242ad51640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f240c0a32c0 0x7f240c0a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2420000c00 tx=0x7f2420031400 comp rx=0 tx=0).stop 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 msgr2=0x7f24240745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 0x7f24240745e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f241400b4a0 tx=0x7f241400b960 comp rx=0 tx=0).stop 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 shutdown_connections 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2424102e00 0x7f24240745e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f240c0a32c0 0x7f240c0a5780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24241037c0 0x7f2424074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 --2- 172.21.15.112:0/2055741464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2424101c00 0x7f2424075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 >> 172.21.15.112:0/2055741464 conn(0x7f24240fd390 msgr2=0x7f2424106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 shutdown_connections 2024-09-15T22:29:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T22:29:33.509+0000 7f242ad51640 1 -- 172.21.15.112:0/2055741464 wait complete. 2024-09-15T22:29:34.244 DEBUG:teuthology.orchestra.run.smithi022:mds.a> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T22:29:34.249 DEBUG:teuthology.orchestra.run.smithi022:mds.d> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T22:29:34.295 DEBUG:teuthology.orchestra.run.smithi022:mds.g> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T22:29:34.340 DEBUG:teuthology.orchestra.run.smithi022:mds.j> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T22:29:34.387 DEBUG:teuthology.orchestra.run.smithi110:mds.b> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T22:29:34.390 DEBUG:teuthology.orchestra.run.smithi110:mds.e> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T22:29:34.433 DEBUG:teuthology.orchestra.run.smithi110:mds.h> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T22:29:34.475 DEBUG:teuthology.orchestra.run.smithi110:mds.k> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T22:29:34.518 DEBUG:teuthology.orchestra.run.smithi112:mds.c> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T22:29:34.521 DEBUG:teuthology.orchestra.run.smithi112:mds.f> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T22:29:34.564 DEBUG:teuthology.orchestra.run.smithi112:mds.i> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T22:29:34.607 DEBUG:teuthology.orchestra.run.smithi112:mds.l> sudo journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T22:29:34.650 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T22:29:34.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:29:34.669 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:29:34.669 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2024-09-15T22:29:34.669 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:34.669 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:34.669 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:34.669 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:34.670 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:34.670 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:34.670 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:34.670 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:34.670 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:34.670 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:34 smithi112 ceph-mon[35032]: Deploying daemon mds.l on smithi112 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:34.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:34.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:34.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:34.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:34 smithi022 ceph-mon[30634]: Deploying daemon mds.l on smithi112 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:34.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:34.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:34.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:34.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:34 smithi110 ceph-mon[35282]: Deploying daemon mds.l on smithi112 2024-09-15T22:29:35.022 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 -- 172.21.15.22:0/2760794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c101de0 msgr2=0x7f989c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 --2- 172.21.15.22:0/2760794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c101de0 0x7f989c1021c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f988c009900 tx=0x7f988c02a410 comp rx=0 tx=0).stop 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 -- 172.21.15.22:0/2760794613 shutdown_connections 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 --2- 172.21.15.22:0/2760794613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c106f10 0x7f989c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 --2- 172.21.15.22:0/2760794613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c102790 0x7f989c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 --2- 172.21.15.22:0/2760794613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c101de0 0x7f989c1021c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.509+0000 7f98a2c00640 1 -- 172.21.15.22:0/2760794613 >> 172.21.15.22:0/2760794613 conn(0x7f989c0fd8c0 msgr2=0x7f989c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.510+0000 7f98a2c00640 1 -- 172.21.15.22:0/2760794613 shutdown_connections 2024-09-15T22:29:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.510+0000 7f98a2c00640 1 -- 172.21.15.22:0/2760794613 wait complete. 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.511+0000 7f98a2c00640 1 Processor -- start 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.511+0000 7f98a2c00640 1 -- start start 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a2c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c101de0 0x7f989c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a2c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 0x7f989c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a2c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c106f10 0x7f989c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a2c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f989c111fc0 con 0x7f989c102790 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a2c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f989c111e40 con 0x7f989c106f10 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a2c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f989c112140 con 0x7f989c101de0 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f9893400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 0x7f989c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f9893400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 0x7f989c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45602/0 (socket says 172.21.15.22:45602) 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f9893400640 1 -- 172.21.15.22:0/83537728 learned_addr learned my addr 172.21.15.22:0/83537728 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a0c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c106f10 0x7f989c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f989be00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c101de0 0x7f989c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a0c00640 1 -- 172.21.15.22:0/83537728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c101de0 msgr2=0x7f989c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a0c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c101de0 0x7f989c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a0c00640 1 -- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 msgr2=0x7f989c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a0c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 0x7f989c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f98a0c00640 1 -- 172.21.15.22:0/83537728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c19d3f0 con 0x7f989c106f10 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.512+0000 7f9893400640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 0x7f989c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.513+0000 7f98a0c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c106f10 0x7f989c19cd10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9894009fd0 tx=0x7f989400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.513+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989400ce20 con 0x7f989c106f10 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.513+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c19d6e0 con 0x7f989c106f10 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.513+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9894005020 con 0x7f989c106f10 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.513+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894010720 con 0x7f989c106f10 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.513+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c1a4fc0 con 0x7f989c106f10 2024-09-15T22:29:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.514+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c1021c0 con 0x7f989c106f10 2024-09-15T22:29:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.516+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9894005540 con 0x7f989c106f10 2024-09-15T22:29:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.517+0000 7f9899600640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a3240 0x7f98800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.518+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f98940cfdc0 con 0x7f989c106f10 2024-09-15T22:29:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.518+0000 7f989be00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a3240 0x7f98800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.518+0000 7f989be00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a3240 0x7f98800a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f988c000c00 tx=0x7f988c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:35.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.519+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f989409cee0 con 0x7f989c106f10 2024-09-15T22:29:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.747+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f989c10a150 con 0x7f989c106f10 2024-09-15T22:29:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.747+0000 7f9899600640 1 -- 172.21.15.22:0/83537728 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f989409c7e0 con 0x7f989c106f10 2024-09-15T22:29:35.749 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:35.749 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"btime":"2024-09-15T22:22:15:226409+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T22:29:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2024-09-15T22:29:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a3240 msgr2=0x7f98800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a3240 0x7f98800a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f988c000c00 tx=0x7f988c005b50 comp rx=0 tx=0).stop 2024-09-15T22:29:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c106f10 msgr2=0x7f989c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c106f10 0x7f989c19cd10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9894009fd0 tx=0x7f989400ef10 comp rx=0 tx=0).stop 2024-09-15T22:29:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 shutdown_connections 2024-09-15T22:29:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a3240 0x7f98800a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c106f10 0x7f989c19cd10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c102790 0x7f989c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 --2- 172.21.15.22:0/83537728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c101de0 0x7f989c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:35.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 >> 172.21.15.22:0/83537728 conn(0x7f989c0fd8c0 msgr2=0x7f989c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:35.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 shutdown_connections 2024-09-15T22:29:35.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:35.749+0000 7f98a2c00640 1 -- 172.21.15.22:0/83537728 wait complete. 2024-09-15T22:29:36.059 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:35 smithi112 systemd[1]: Starting Ceph mds.l for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:36.352 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 podman[65353]: 2024-09-15 22:29:35.961129807 +0000 UTC m=+0.016330366 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:36.352 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 podman[65353]: 2024-09-15 22:29:36.071381925 +0000 UTC m=+0.126582482 container create 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T22:29:36.352 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 podman[65353]: 2024-09-15 22:29:36.265363747 +0000 UTC m=+0.320564303 container init 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-15T22:29:36.353 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 podman[65353]: 2024-09-15 22:29:36.2681249 +0000 UTC m=+0.323325458 container start 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:29:36.353 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mds[65372]: -- 172.21.15.112:0/1618600306 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5608f85fb860 con 0x5608f85d8800 2024-09-15T22:29:36.353 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l[65368]: starting mds.l at 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 bash[65353]: 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:29:36 smithi112 systemd[1]: Started Ceph mds.l for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/83537728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6832/4122441633,v1:172.21.15.112:6833/4122441633] up:boot 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: fsmap 1 up:standby 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:29:36.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:36.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:36.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:36.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:36.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:36.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:36.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:36 smithi112 ceph-mon[35032]: Deploying daemon mds.k on smithi110 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/83537728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6832/4122441633,v1:172.21.15.112:6833/4122441633] up:boot 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: fsmap 1 up:standby 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:36.861 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:36.862 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:36.862 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:36.862 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:36 smithi110 ceph-mon[35282]: Deploying daemon mds.k on smithi110 2024-09-15T22:29:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/83537728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6832/4122441633,v1:172.21.15.112:6833/4122441633] up:boot 2024-09-15T22:29:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: fsmap 1 up:standby 2024-09-15T22:29:37.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:37.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:36 smithi022 ceph-mon[30634]: Deploying daemon mds.k on smithi110 2024-09-15T22:29:38.455 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 systemd[1]: Starting Ceph mds.k for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:38.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:29:38.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:38 smithi112 ceph-mon[35032]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:38.915 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:38 smithi110 ceph-mon[35282]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:38.916 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 podman[63957]: 2024-09-15 22:29:38.499163713 +0000 UTC m=+0.015734555 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:38.916 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 podman[63957]: 2024-09-15 22:29:38.611340292 +0000 UTC m=+0.127911132 container create 09b3a543e7f83e7e8265bdff987dd34f3c2f3e48e5ab9972d5861e3986ef8f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T22:29:38.916 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 podman[63957]: 2024-09-15 22:29:38.81399927 +0000 UTC m=+0.330570110 container init 09b3a543e7f83e7e8265bdff987dd34f3c2f3e48e5ab9972d5861e3986ef8f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:29:38.916 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 podman[63957]: 2024-09-15 22:29:38.816822208 +0000 UTC m=+0.333393049 container start 09b3a543e7f83e7e8265bdff987dd34f3c2f3e48e5ab9972d5861e3986ef8f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T22:29:38.916 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 ceph-mds[63976]: -- 172.21.15.110:0/2666230333 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564cc7f13860 con 0x564cc7ef0800 2024-09-15T22:29:38.917 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k[63972]: starting mds.k at 2024-09-15T22:29:38.917 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 bash[63957]: 09b3a543e7f83e7e8265bdff987dd34f3c2f3e48e5ab9972d5861e3986ef8f66 2024-09-15T22:29:38.960 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:39.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:38 smithi022 ceph-mon[30634]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:39.205 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:29:38 smithi110 systemd[1]: Started Ceph mds.k for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 -- 172.21.15.22:0/1942808141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b8108f60 msgr2=0x7f82b8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 --2- 172.21.15.22:0/1942808141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b8108f60 0x7f82b8110ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009900 tx=0x7f82b002a410 comp rx=0 tx=0).stop 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 -- 172.21.15.22:0/1942808141 shutdown_connections 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 --2- 172.21.15.22:0/1942808141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b8108f60 0x7f82b8110ae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 --2- 172.21.15.22:0/1942808141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82b81047e0 0x7f82b8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 --2- 172.21.15.22:0/1942808141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8103e30 0x7f82b8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 -- 172.21.15.22:0/1942808141 >> 172.21.15.22:0/1942808141 conn(0x7f82b80ff8d0 msgr2=0x7f82b8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:39.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 -- 172.21.15.22:0/1942808141 shutdown_connections 2024-09-15T22:29:39.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.511+0000 7f82bd600640 1 -- 172.21.15.22:0/1942808141 wait complete. 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 Processor -- start 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 -- start start 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82b8103e30 0x7f82b819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 0x7f82b819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8108f60 0x7f82b819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8114010 con 0x7f82b81047e0 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8113e90 con 0x7f82b8103e30 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.512+0000 7f82bd600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8114190 con 0x7f82b8108f60 2024-09-15T22:29:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 0x7f82b819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 0x7f82b819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45630/0 (socket says 172.21.15.22:45630) 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 -- 172.21.15.22:0/1690897109 learned_addr learned my addr 172.21.15.22:0/1690897109 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82b7e00640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82b8103e30 0x7f82b819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82bcc00640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8108f60 0x7f82b819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 -- 172.21.15.22:0/1690897109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8108f60 msgr2=0x7f82b819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8108f60 0x7f82b819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 -- 172.21.15.22:0/1690897109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82b8103e30 msgr2=0x7f82b819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82b8103e30 0x7f82b819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82af400640 1 -- 172.21.15.22:0/1690897109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b819f380 con 0x7f82b81047e0 2024-09-15T22:29:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.513+0000 7f82bcc00640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8108f60 0x7f82b819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:29:39.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.514+0000 7f82af400640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 0x7f82b819a910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82a000e9f0 tx=0x7f82a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:39.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.514+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a000cd80 con 0x7f82b81047e0 2024-09-15T22:29:39.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.514+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82a0010910 con 0x7f82b81047e0 2024-09-15T22:29:39.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.514+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0018990 con 0x7f82b81047e0 2024-09-15T22:29:39.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.514+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b819f670 con 0x7f82b81047e0 2024-09-15T22:29:39.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.514+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b81a6f50 con 0x7f82b81047e0 2024-09-15T22:29:39.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.516+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b8104210 con 0x7f82b81047e0 2024-09-15T22:29:39.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.518+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f82a0010ac0 con 0x7f82b81047e0 2024-09-15T22:29:39.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.519+0000 7f82b5600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f829c0a32c0 0x7f829c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:39.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.519+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f82a00cf790 con 0x7f82b81047e0 2024-09-15T22:29:39.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.519+0000 7f82b7e00640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f829c0a32c0 0x7f829c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:39.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.520+0000 7f82b7e00640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f829c0a32c0 0x7f829c0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005fd0 tx=0x7f82a8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:39.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.526+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82a009c8b0 con 0x7f82b81047e0 2024-09-15T22:29:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.753+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82b810bbb0 con 0x7f82b81047e0 2024-09-15T22:29:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.754+0000 7f82b5600640 1 -- 172.21.15.22:0/1690897109 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f82a009c1b0 con 0x7f82b81047e0 2024-09-15T22:29:39.756 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:39.756 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"btime":"2024-09-15T22:29:39:592586+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:29:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2024-09-15T22:29:39.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f829c0a32c0 msgr2=0x7f829c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:39.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f829c0a32c0 0x7f829c0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005fd0 tx=0x7f82a8009500 comp rx=0 tx=0).stop 2024-09-15T22:29:39.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 msgr2=0x7f82b819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:39.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 0x7f82b819a910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82a000e9f0 tx=0x7f82a000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 shutdown_connections 2024-09-15T22:29:39.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b8108f60 0x7f82b819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f829c0a32c0 0x7f829c0a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82b81047e0 0x7f82b819a910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 --2- 172.21.15.22:0/1690897109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82b8103e30 0x7f82b819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:39.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.756+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 >> 172.21.15.22:0/1690897109 conn(0x7f82b80ff8d0 msgr2=0x7f82b8100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:39.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.757+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 shutdown_connections 2024-09-15T22:29:39.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:39.757+0000 7f82bd600640 1 -- 172.21.15.22:0/1690897109 wait complete. 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: Deploying daemon mds.j on smithi022 2024-09-15T22:29:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6832/1172139023,v1:172.21.15.110:6833/1172139023] up:boot 2024-09-15T22:29:40.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: fsmap 2 up:standby 2024-09-15T22:29:40.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:29:40.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:39 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1690897109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: Deploying daemon mds.j on smithi022 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6832/1172139023,v1:172.21.15.110:6833/1172139023] up:boot 2024-09-15T22:29:40.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: fsmap 2 up:standby 2024-09-15T22:29:40.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:29:40.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:39 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1690897109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:40.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: Deploying daemon mds.j on smithi022 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6832/1172139023,v1:172.21.15.110:6833/1172139023] up:boot 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: fsmap 2 up:standby 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:29:40.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:39 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1690897109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:41.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:40 smithi022 ceph-mon[30634]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:41.230 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:40 smithi110 ceph-mon[35282]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:41.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:40 smithi112 ceph-mon[35032]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:42.532 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 systemd[1]: Starting Ceph mds.j for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:42.856 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 podman[70037]: 2024-09-15 22:29:42.489031723 +0000 UTC m=+0.028353525 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:42.857 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 podman[70037]: 2024-09-15 22:29:42.611292476 +0000 UTC m=+0.150614268 container create c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:42.857 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 podman[70037]: 2024-09-15 22:29:42.855723071 +0000 UTC m=+0.395044873 container init c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T22:29:43.207 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:29:43.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:42 smithi022 ceph-mon[30634]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:43.259 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 podman[70037]: 2024-09-15 22:29:42.864296034 +0000 UTC m=+0.403617827 container start c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-15T22:29:43.259 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 ceph-mds[70060]: -- 172.21.15.22:0/1669217293 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa9cacf860 con 0x55fa9caac800 2024-09-15T22:29:43.259 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j[70052]: starting mds.j at 2024-09-15T22:29:43.259 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 bash[70037]: c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 2024-09-15T22:29:43.259 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:29:42 smithi022 systemd[1]: Started Ceph mds.j for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:42 smithi112 ceph-mon[35032]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:42 smithi110 ceph-mon[35282]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:44.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.22:6834/2103622454,v1:172.21.15.22:6835/2103622454] up:boot 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: fsmap 3 up:standby 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:44.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:43 smithi022 ceph-mon[30634]: Deploying daemon mds.d on smithi022 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.22:6834/2103622454,v1:172.21.15.22:6835/2103622454] up:boot 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: fsmap 3 up:standby 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:44.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:44.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:44.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:43 smithi112 ceph-mon[35032]: Deploying daemon mds.d on smithi022 2024-09-15T22:29:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.22:6834/2103622454,v1:172.21.15.22:6835/2103622454] up:boot 2024-09-15T22:29:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: fsmap 3 up:standby 2024-09-15T22:29:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:29:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:44.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:43 smithi110 ceph-mon[35282]: Deploying daemon mds.d on smithi022 2024-09-15T22:29:44.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 -- 172.21.15.22:0/2418992468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 msgr2=0x7ff24c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:44.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 --2- 172.21.15.22:0/2418992468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c076b00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009900 tx=0x7ff23c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:29:44.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 -- 172.21.15.22:0/2418992468 shutdown_connections 2024-09-15T22:29:44.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 --2- 172.21.15.22:0/2418992468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff24c112870 0x7ff24c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 --2- 172.21.15.22:0/2418992468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 0x7ff24c112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 --2- 172.21.15.22:0/2418992468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c076b00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 -- 172.21.15.22:0/2418992468 >> 172.21.15.22:0/2418992468 conn(0x7ff24c0ff910 msgr2=0x7ff24c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 -- 172.21.15.22:0/2418992468 shutdown_connections 2024-09-15T22:29:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.929+0000 7ff252000640 1 -- 172.21.15.22:0/2418992468 wait complete. 2024-09-15T22:29:44.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.930+0000 7ff252000640 1 Processor -- start 2024-09-15T22:29:44.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.930+0000 7ff252000640 1 -- start start 2024-09-15T22:29:44.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff252000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff252000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 0x7ff24c1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff252000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff24c112870 0x7ff24c19e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff252000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c118450 con 0x7ff24c076720 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff252000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c1182d0 con 0x7ff24c077040 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff252000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c1185d0 con 0x7ff24c112870 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff243e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 0x7ff24c1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c1a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39784/0 (socket says 172.21.15.22:39784) 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 -- 172.21.15.22:0/173545561 learned_addr learned my addr 172.21.15.22:0/173545561 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff251600640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff24c112870 0x7ff24c19e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 -- 172.21.15.22:0/173545561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff24c112870 msgr2=0x7ff24c19e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff24c112870 0x7ff24c19e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 -- 172.21.15.22:0/173545561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 msgr2=0x7ff24c1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 0x7ff24c1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff250c00640 1 -- 172.21.15.22:0/173545561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c19efe0 con 0x7ff24c076720 2024-09-15T22:29:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.931+0000 7ff243e00640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 0x7ff24c1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:29:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.932+0000 7ff250c00640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c1a46a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff23c004770 tx=0x7ff23c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.932+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c03f070 con 0x7ff24c076720 2024-09-15T22:29:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.932+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff23c031ca0 con 0x7ff24c076720 2024-09-15T22:29:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.932+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24c19f270 con 0x7ff24c076720 2024-09-15T22:29:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.932+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c035030 con 0x7ff24c076720 2024-09-15T22:29:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.932+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24c1ab450 con 0x7ff24c076720 2024-09-15T22:29:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.934+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24c077e60 con 0x7ff24c076720 2024-09-15T22:29:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.935+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff23c042070 con 0x7ff24c076720 2024-09-15T22:29:44.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.936+0000 7ff24a000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2300a3240 0x7ff2300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:44.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.937+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff23c0efbb0 con 0x7ff24c076720 2024-09-15T22:29:44.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.937+0000 7ff243e00640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2300a3240 0x7ff2300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:44.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.937+0000 7ff243e00640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2300a3240 0x7ff2300a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff24c19ffc0 tx=0x7ff234005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:44.941+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff23c0bc680 con 0x7ff24c076720 2024-09-15T22:29:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.167+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff24c10da00 con 0x7ff24c076720 2024-09-15T22:29:45.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:45 smithi022 ceph-mon[30634]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:45.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.168+0000 7ff24a000640 1 -- 172.21.15.22:0/173545561 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7ff23c0c0980 con 0x7ff24c076720 2024-09-15T22:29:45.169 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:45.169 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"btime":"2024-09-15T22:29:42:981741+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:29:45.169 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 4 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2300a3240 msgr2=0x7ff2300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2300a3240 0x7ff2300a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff24c19ffc0 tx=0x7ff234005f90 comp rx=0 tx=0).stop 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 msgr2=0x7ff24c1a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c1a46a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff23c004770 tx=0x7ff23c003c10 comp rx=0 tx=0).stop 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 shutdown_connections 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff24c112870 0x7ff24c19e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2300a3240 0x7ff2300a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24c077040 0x7ff24c1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 --2- 172.21.15.22:0/173545561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff24c076720 0x7ff24c1a46a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:45.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 >> 172.21.15.22:0/173545561 conn(0x7ff24c0ff910 msgr2=0x7ff24c101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:45.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 shutdown_connections 2024-09-15T22:29:45.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:45.170+0000 7ff252000640 1 -- 172.21.15.22:0/173545561 wait complete. 2024-09-15T22:29:45.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:45 smithi112 ceph-mon[35032]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:45 smithi110 ceph-mon[35282]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:46.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:46 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/173545561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:46.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:46 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/173545561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:46 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/173545561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:47.012 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:46 smithi022 systemd[1]: Starting Ceph mds.d for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:47.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:47 smithi022 ceph-mon[30634]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:47.282 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 podman[70454]: 2024-09-15 22:29:46.915039431 +0000 UTC m=+0.027727503 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:47.283 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 podman[70454]: 2024-09-15 22:29:47.038739165 +0000 UTC m=+0.151427237 container create 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True) 2024-09-15T22:29:47.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:47 smithi112 ceph-mon[35032]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:47 smithi110 ceph-mon[35282]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:47.782 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 podman[70454]: 2024-09-15 22:29:47.299760136 +0000 UTC m=+0.412448209 container init 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T22:29:47.782 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 podman[70454]: 2024-09-15 22:29:47.30603674 +0000 UTC m=+0.418724812 container start 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-15T22:29:47.783 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 ceph-mds[70473]: -- 172.21.15.22:0/1529161208 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5628a124fc20 con 0x5628a122d000 2024-09-15T22:29:47.783 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d[70469]: starting mds.d at 2024-09-15T22:29:47.783 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 bash[70454]: 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 2024-09-15T22:29:47.783 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:29:47 smithi022 systemd[1]: Started Ceph mds.d for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:48.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:29:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:48.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:48.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.22:6836/3608871420,v1:172.21.15.22:6837/3608871420] up:boot 2024-09-15T22:29:48.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: fsmap 4 up:standby 2024-09-15T22:29:48.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.22:6836/3608871420,v1:172.21.15.22:6837/3608871420] up:boot 2024-09-15T22:29:48.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: fsmap 4 up:standby 2024-09-15T22:29:48.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:29:48.863 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.22:6836/3608871420,v1:172.21.15.22:6837/3608871420] up:boot 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: fsmap 4 up:standby 2024-09-15T22:29:48.914 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:29:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 -- 172.21.15.22:0/3562288507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4101de0 msgr2=0x7f47b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 --2- 172.21.15.22:0/3562288507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4101de0 0x7f47b41021c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009900 tx=0x7f47a802a410 comp rx=0 tx=0).stop 2024-09-15T22:29:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 -- 172.21.15.22:0/3562288507 shutdown_connections 2024-09-15T22:29:49.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 --2- 172.21.15.22:0/3562288507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b4106f10 0x7f47b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 --2- 172.21.15.22:0/3562288507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4102790 0x7f47b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 --2- 172.21.15.22:0/3562288507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4101de0 0x7f47b41021c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.427+0000 7f47bc400640 1 -- 172.21.15.22:0/3562288507 >> 172.21.15.22:0/3562288507 conn(0x7f47b40fd8c0 msgr2=0x7f47b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.428+0000 7f47bc400640 1 -- 172.21.15.22:0/3562288507 shutdown_connections 2024-09-15T22:29:49.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.428+0000 7f47bc400640 1 -- 172.21.15.22:0/3562288507 wait complete. 2024-09-15T22:29:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.428+0000 7f47bc400640 1 Processor -- start 2024-09-15T22:29:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 -- start start 2024-09-15T22:29:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 0x7f47b41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b4102790 0x7f47b4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4106f10 0x7f47b419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:49.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4111fc0 con 0x7f47b4106f10 2024-09-15T22:29:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4111e40 con 0x7f47b4101de0 2024-09-15T22:29:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47bc400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4112140 con 0x7f47b4102790 2024-09-15T22:29:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47b9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 0x7f47b41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:49.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47b9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 0x7f47b41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:40734/0 (socket says 172.21.15.22:40734) 2024-09-15T22:29:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47b9a00640 1 -- 172.21.15.22:0/1609150409 learned_addr learned my addr 172.21.15.22:0/1609150409 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47ba400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4106f10 0x7f47b419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.429+0000 7f47b9000640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b4102790 0x7f47b4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.430+0000 7f47b9a00640 1 -- 172.21.15.22:0/1609150409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b4102790 msgr2=0x7f47b4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:49.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.430+0000 7f47b9a00640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b4102790 0x7f47b4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.430+0000 7f47b9a00640 1 -- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4106f10 msgr2=0x7f47b419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.430+0000 7f47b9a00640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4106f10 0x7f47b419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.430+0000 7f47b9a00640 1 -- 172.21.15.22:0/1609150409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b419d470 con 0x7f47b4101de0 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.430+0000 7f47b9a00640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 0x7f47b41984c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f47a8004770 tx=0x7f47a8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.431+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a803f070 con 0x7f47b4101de0 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.431+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47a8031ca0 con 0x7f47b4101de0 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.431+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b419d700 con 0x7f47b4101de0 2024-09-15T22:29:49.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.431+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8035030 con 0x7f47b4101de0 2024-09-15T22:29:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.431+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b41a5040 con 0x7f47b4101de0 2024-09-15T22:29:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.432+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b41021c0 con 0x7f47b4101de0 2024-09-15T22:29:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.433+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f47a8042070 con 0x7f47b4101de0 2024-09-15T22:29:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.435+0000 7f47b2000640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f479c0a32c0 0x7f479c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.435+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f47a80efb10 con 0x7f47b4101de0 2024-09-15T22:29:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.435+0000 7f47b9000640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f479c0a32c0 0x7f479c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.436+0000 7f47b9000640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f479c0a32c0 0x7f479c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f47b40fdd70 tx=0x7f47a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.440+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47a80bc5e0 con 0x7f47b4101de0 2024-09-15T22:29:49.479 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 systemd[1]: Starting Ceph mds.e for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:49.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.660+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47b410a0f0 con 0x7f47b4101de0 2024-09-15T22:29:49.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:49 smithi022 ceph-mon[30634]: Deploying daemon mds.e on smithi110 2024-09-15T22:29:49.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:49 smithi022 ceph-mon[30634]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:49.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.661+0000 7f47b2000640 1 -- 172.21.15.22:0/1609150409 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f47a80c08e0 con 0x7f47b4101de0 2024-09-15T22:29:49.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:49.663 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"btime":"2024-09-15T22:29:48:053390+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:29:49.665 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2024-09-15T22:29:49.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.663+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f479c0a32c0 msgr2=0x7f479c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:49.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.663+0000 7f47bc400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f479c0a32c0 0x7f479c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f47b40fdd70 tx=0x7f47a0005f90 comp rx=0 tx=0).stop 2024-09-15T22:29:49.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.663+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 msgr2=0x7f47b41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:49.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 0x7f47b41984c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f47a8004770 tx=0x7f47a8003c10 comp rx=0 tx=0).stop 2024-09-15T22:29:49.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 shutdown_connections 2024-09-15T22:29:49.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b4102790 0x7f47b4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f479c0a32c0 0x7f479c0a5780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47b4106f10 0x7f47b419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 --2- 172.21.15.22:0/1609150409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47b4101de0 0x7f47b41984c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:49.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 >> 172.21.15.22:0/1609150409 conn(0x7f47b40fd8c0 msgr2=0x7f47b40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:49.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 shutdown_connections 2024-09-15T22:29:49.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:49.664+0000 7f47bc400640 1 -- 172.21.15.22:0/1609150409 wait complete. 2024-09-15T22:29:49.764 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:49 smithi110 ceph-mon[35282]: Deploying daemon mds.e on smithi110 2024-09-15T22:29:49.764 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:49 smithi110 ceph-mon[35282]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:49.764 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 podman[64269]: 2024-09-15 22:29:49.498305761 +0000 UTC m=+0.015650318 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:49.765 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 podman[64269]: 2024-09-15 22:29:49.664643228 +0000 UTC m=+0.181987775 container create e2bd7e7410f4abdb60018b794200434a4453a7f6dca977183bb0e417be60a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:49.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:49 smithi112 ceph-mon[35032]: Deploying daemon mds.e on smithi110 2024-09-15T22:29:49.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:49 smithi112 ceph-mon[35032]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:50.205 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 podman[64269]: 2024-09-15 22:29:49.883623939 +0000 UTC m=+0.400968501 container init e2bd7e7410f4abdb60018b794200434a4453a7f6dca977183bb0e417be60a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:29:50.205 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 podman[64269]: 2024-09-15 22:29:49.886342194 +0000 UTC m=+0.403686741 container start e2bd7e7410f4abdb60018b794200434a4453a7f6dca977183bb0e417be60a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:29:50.206 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 ceph-mds[64289]: -- 172.21.15.110:0/870375977 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c6a52a3860 con 0x55c6a5281400 2024-09-15T22:29:50.206 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e[64285]: starting mds.e at 2024-09-15T22:29:50.206 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 bash[64269]: e2bd7e7410f4abdb60018b794200434a4453a7f6dca977183bb0e417be60a4f6 2024-09-15T22:29:50.206 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:29:49 smithi110 systemd[1]: Started Ceph mds.e for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:50.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1609150409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:50.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:50.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:50.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1609150409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:50.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:50.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1609150409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:50.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:50.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:50.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:50.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:51.677 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:51 smithi112 ceph-mon[35032]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:51.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:51 smithi112 ceph-mon[35032]: Deploying daemon mds.f on smithi112 2024-09-15T22:29:51.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:51 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6834/4194953231,v1:172.21.15.110:6835/4194953231] up:boot 2024-09-15T22:29:51.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:51 smithi112 ceph-mon[35032]: fsmap 5 up:standby 2024-09-15T22:29:51.678 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:29:51.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:51 smithi022 ceph-mon[30634]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:51.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:51 smithi022 ceph-mon[30634]: Deploying daemon mds.f on smithi112 2024-09-15T22:29:51.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:51 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6834/4194953231,v1:172.21.15.110:6835/4194953231] up:boot 2024-09-15T22:29:51.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:51 smithi022 ceph-mon[30634]: fsmap 5 up:standby 2024-09-15T22:29:51.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:29:51.857 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:51 smithi110 ceph-mon[35282]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:51.857 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:51 smithi110 ceph-mon[35282]: Deploying daemon mds.f on smithi112 2024-09-15T22:29:51.858 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:51 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6834/4194953231,v1:172.21.15.110:6835/4194953231] up:boot 2024-09-15T22:29:51.858 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:51 smithi110 ceph-mon[35282]: fsmap 5 up:standby 2024-09-15T22:29:51.858 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:51 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:29:52.068 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:51 smithi112 systemd[1]: Starting Ceph mds.f for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:52.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:29:52.329 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 podman[65657]: 2024-09-15 22:29:51.968971758 +0000 UTC m=+0.015751287 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:52.329 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 podman[65657]: 2024-09-15 22:29:52.074436527 +0000 UTC m=+0.121216092 container create e522e7479ea1c05a55d22ceec719c6f2c2ea31cfd17d749afb0e43fa6cb63f0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:29:52.329 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 podman[65657]: 2024-09-15 22:29:52.302066675 +0000 UTC m=+0.348846192 container init e522e7479ea1c05a55d22ceec719c6f2c2ea31cfd17d749afb0e43fa6cb63f0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T22:29:52.329 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 podman[65657]: 2024-09-15 22:29:52.304958279 +0000 UTC m=+0.351737808 container start e522e7479ea1c05a55d22ceec719c6f2c2ea31cfd17d749afb0e43fa6cb63f0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:52.602 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 ceph-mds[65676]: -- 172.21.15.112:0/507386924 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f19e77860 con 0x563f19e55400 2024-09-15T22:29:52.602 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f[65672]: starting mds.f at 2024-09-15T22:29:52.602 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 bash[65657]: e522e7479ea1c05a55d22ceec719c6f2c2ea31cfd17d749afb0e43fa6cb63f0f 2024-09-15T22:29:52.602 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:29:52 smithi112 systemd[1]: Started Ceph mds.f for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.259+0000 7fd2bf800640 1 -- 172.21.15.22:0/1566238920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8101de0 msgr2=0x7fd2b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.259+0000 7fd2bf800640 1 --2- 172.21.15.22:0/1566238920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8101de0 0x7fd2b81021c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009900 tx=0x7fd2ac02a410 comp rx=0 tx=0).stop 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 -- 172.21.15.22:0/1566238920 shutdown_connections 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 --2- 172.21.15.22:0/1566238920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8102790 0x7fd2b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 --2- 172.21.15.22:0/1566238920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b8106f10 0x7fd2b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 --2- 172.21.15.22:0/1566238920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8101de0 0x7fd2b81021c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 -- 172.21.15.22:0/1566238920 >> 172.21.15.22:0/1566238920 conn(0x7fd2b80fd8e0 msgr2=0x7fd2b80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:53.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 -- 172.21.15.22:0/1566238920 shutdown_connections 2024-09-15T22:29:53.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.260+0000 7fd2bf800640 1 -- 172.21.15.22:0/1566238920 wait complete. 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 Processor -- start 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 -- start start 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b8101de0 0x7fd2b819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8102790 0x7fd2b819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8111f70 con 0x7fd2b8102790 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8111df0 con 0x7fd2b8101de0 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.261+0000 7fd2bf800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81120f0 con 0x7fd2b8106f10 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2b7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8102790 0x7fd2b819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:57504/0 (socket says 172.21.15.22:57504) 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 -- 172.21.15.22:0/2202020188 learned_addr learned my addr 172.21.15.22:0/2202020188 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bce00640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b8101de0 0x7fd2b819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 -- 172.21.15.22:0/2202020188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b8101de0 msgr2=0x7fd2b819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b8101de0 0x7fd2b819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 -- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8102790 msgr2=0x7fd2b819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8102790 0x7fd2b819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 -- 172.21.15.22:0/2202020188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b819f600 con 0x7fd2b8106f10 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.262+0000 7fd2bd800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ef20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000eb10 tx=0x7fd2b000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.263+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0004b20 con 0x7fd2b8106f10 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.263+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b0004cc0 con 0x7fd2b8106f10 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.263+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0010760 con 0x7fd2b8106f10 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.263+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b819f8f0 con 0x7fd2b8106f10 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.263+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a71d0 con 0x7fd2b8106f10 2024-09-15T22:29:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.264+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b81021c0 con 0x7fd2b8106f10 2024-09-15T22:29:53.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.266+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd2b0005020 con 0x7fd2b8106f10 2024-09-15T22:29:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.267+0000 7fd2b5600640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd2a00a32c0 0x7fd2a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.267+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd2b00cf9a0 con 0x7fd2b8106f10 2024-09-15T22:29:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.267+0000 7fd2bce00640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd2a00a32c0 0x7fd2a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.268+0000 7fd2bce00640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd2a00a32c0 0x7fd2a00a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009230 tx=0x7fd2ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.271+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2b009cac0 con 0x7fd2b8106f10 2024-09-15T22:29:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.497+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2b81a74b0 con 0x7fd2b8106f10 2024-09-15T22:29:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.497+0000 7fd2b5600640 1 -- 172.21.15.22:0/2202020188 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7fd2b009c3c0 con 0x7fd2b8106f10 2024-09-15T22:29:53.500 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:53.500 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":7,"btime":"2024-09-15T22:29:52:484572+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-15T22:29:53.500 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 7 2024-09-15T22:29:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd2a00a32c0 msgr2=0x7fd2a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd2a00a32c0 0x7fd2a00a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009230 tx=0x7fd2ac0058d0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 msgr2=0x7fd2b819ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ef20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000eb10 tx=0x7fd2b000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 shutdown_connections 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b8106f10 0x7fd2b819ef20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd2a00a32c0 0x7fd2a00a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b8102790 0x7fd2b819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 --2- 172.21.15.22:0/2202020188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2b8101de0 0x7fd2b819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 >> 172.21.15.22:0/2202020188 conn(0x7fd2b80fd8e0 msgr2=0x7fd2b80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 shutdown_connections 2024-09-15T22:29:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:53.500+0000 7fd2bf800640 1 -- 172.21.15.22:0/2202020188 wait complete. 2024-09-15T22:29:53.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: Deploying daemon mds.c on smithi112 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6834/3072966464,v1:172.21.15.112:6835/3072966464] up:boot 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: fsmap 6 up:standby 2024-09-15T22:29:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:29:53.809 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: Deploying daemon mds.c on smithi112 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6834/3072966464,v1:172.21.15.112:6835/3072966464] up:boot 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: fsmap 6 up:standby 2024-09-15T22:29:53.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:29:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: Deploying daemon mds.c on smithi112 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6834/3072966464,v1:172.21.15.112:6835/3072966464] up:boot 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: fsmap 6 up:standby 2024-09-15T22:29:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:29:54.369 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 systemd[1]: Starting Ceph mds.c for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:54.619 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:54 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2202020188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:54.620 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 podman[65967]: 2024-09-15 22:29:54.414439473 +0000 UTC m=+0.015820180 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:54.620 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 podman[65967]: 2024-09-15 22:29:54.51171269 +0000 UTC m=+0.113093431 container create 67c230ee291f5e417752528825ce52d41794b937635edb686dfa70a423654284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:29:54.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:54 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2202020188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:54.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:54 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2202020188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:55.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 podman[65967]: 2024-09-15 22:29:54.730566351 +0000 UTC m=+0.331947045 container init 67c230ee291f5e417752528825ce52d41794b937635edb686dfa70a423654284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T22:29:55.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 podman[65967]: 2024-09-15 22:29:54.733435969 +0000 UTC m=+0.334816665 container start 67c230ee291f5e417752528825ce52d41794b937635edb686dfa70a423654284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True) 2024-09-15T22:29:55.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 ceph-mds[65986]: -- 172.21.15.112:0/3256624588 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56293767b860 con 0x562937658800 2024-09-15T22:29:55.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c[65982]: starting mds.c at 2024-09-15T22:29:55.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 bash[65967]: 67c230ee291f5e417752528825ce52d41794b937635edb686dfa70a423654284 2024-09-15T22:29:55.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:29:54 smithi112 systemd[1]: Started Ceph mds.c for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:55.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:55.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:55.588 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:55.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:56.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:29:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:56 smithi022 ceph-mon[30634]: Deploying daemon mds.h on smithi110 2024-09-15T22:29:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:56 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6836/35956348,v1:172.21.15.112:6837/35956348] up:boot 2024-09-15T22:29:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:56 smithi022 ceph-mon[30634]: fsmap 7 up:standby 2024-09-15T22:29:56.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:29:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:29:56.701 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:56 smithi110 ceph-mon[35282]: Deploying daemon mds.h on smithi110 2024-09-15T22:29:56.702 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:56 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6836/35956348,v1:172.21.15.112:6837/35956348] up:boot 2024-09-15T22:29:56.702 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:56 smithi110 ceph-mon[35282]: fsmap 7 up:standby 2024-09-15T22:29:56.702 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:29:56.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:56 smithi112 ceph-mon[35032]: Deploying daemon mds.h on smithi110 2024-09-15T22:29:56.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:56 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6836/35956348,v1:172.21.15.112:6837/35956348] up:boot 2024-09-15T22:29:56.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:56 smithi112 ceph-mon[35032]: fsmap 7 up:standby 2024-09-15T22:29:56.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:29:56.955 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:56 smithi110 systemd[1]: Starting Ceph mds.h for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:57.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 -- 172.21.15.22:0/3795902179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c1047e0 msgr2=0x7f138c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 --2- 172.21.15.22:0/3795902179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c1047e0 0x7f138c108830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1374009900 tx=0x7f137402a400 comp rx=0 tx=0).stop 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 -- 172.21.15.22:0/3795902179 shutdown_connections 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 --2- 172.21.15.22:0/3795902179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f138c108f60 0x7f138c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 --2- 172.21.15.22:0/3795902179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c1047e0 0x7f138c108830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 --2- 172.21.15.22:0/3795902179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 -- 172.21.15.22:0/3795902179 >> 172.21.15.22:0/3795902179 conn(0x7f138c0ff8d0 msgr2=0x7f138c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 -- 172.21.15.22:0/3795902179 shutdown_connections 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.174+0000 7f1392000640 1 -- 172.21.15.22:0/3795902179 wait complete. 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 Processor -- start 2024-09-15T22:29:57.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 -- start start 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f138c1047e0 0x7f138c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c108f60 0x7f138c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f138c114010 con 0x7f138c103e30 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f138c113e90 con 0x7f138c108f60 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.175+0000 7f1392000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f138c114190 con 0x7f138c1047e0 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60528/0 (socket says 172.21.15.22:60528) 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 -- 172.21.15.22:0/1492257268 learned_addr learned my addr 172.21.15.22:0/1492257268 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:29:57.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1391600640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c108f60 0x7f138c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1383e00640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f138c1047e0 0x7f138c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 -- 172.21.15.22:0/1492257268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f138c1047e0 msgr2=0x7f138c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f138c1047e0 0x7f138c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 -- 172.21.15.22:0/1492257268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c108f60 msgr2=0x7f138c19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c108f60 0x7f138c19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 -- 172.21.15.22:0/1492257268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c19f440 con 0x7f138c103e30 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.176+0000 7f1390c00640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c19a490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f137c00e9f0 tx=0x7f137c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.177+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c00cd80 con 0x7f138c103e30 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.177+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c19f730 con 0x7f138c103e30 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.177+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f137c010910 con 0x7f138c103e30 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.177+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c0188f0 con 0x7f138c103e30 2024-09-15T22:29:57.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.177+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c1a7010 con 0x7f138c103e30 2024-09-15T22:29:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.178+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c104210 con 0x7f138c103e30 2024-09-15T22:29:57.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.180+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f137c010ac0 con 0x7f138c103e30 2024-09-15T22:29:57.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.181+0000 7f138a000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f13700a32c0 0x7f13700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:29:57.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.181+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f137c0cf870 con 0x7f138c103e30 2024-09-15T22:29:57.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.181+0000 7f1383e00640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f13700a32c0 0x7f13700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:29:57.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.182+0000 7f1383e00640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f13700a32c0 0x7f13700a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1374000c00 tx=0x7f1374005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:29:57.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.185+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f137c09c340 con 0x7f138c103e30 2024-09-15T22:29:57.341 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 podman[64576]: 2024-09-15 22:29:56.987919135 +0000 UTC m=+0.016038317 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:57.341 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 podman[64576]: 2024-09-15 22:29:57.101382127 +0000 UTC m=+0.129501307 container create 1bc68a7f27537e27ca730599adb34fa981dc538ac908c1278d39da7a43080e9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:29:57.341 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 podman[64576]: 2024-09-15 22:29:57.312555539 +0000 UTC m=+0.340674714 container init 1bc68a7f27537e27ca730599adb34fa981dc538ac908c1278d39da7a43080e9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:57.341 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 podman[64576]: 2024-09-15 22:29:57.315286929 +0000 UTC m=+0.343406109 container start 1bc68a7f27537e27ca730599adb34fa981dc538ac908c1278d39da7a43080e9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T22:29:57.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.408+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f138c10c1a0 con 0x7f138c103e30 2024-09-15T22:29:57.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.409+0000 7f138a000640 1 -- 172.21.15.22:0/1492257268 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f137c0a0640 con 0x7f138c103e30 2024-09-15T22:29:57.410 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:29:57.411 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"btime":"2024-09-15T22:29:55:465200+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-15T22:29:57.411 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f13700a32c0 msgr2=0x7f13700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f13700a32c0 0x7f13700a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1374000c00 tx=0x7f1374005b50 comp rx=0 tx=0).stop 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 msgr2=0x7f138c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c19a490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f137c00e9f0 tx=0x7f137c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 shutdown_connections 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f138c1047e0 0x7f138c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f13700a32c0 0x7f13700a5780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138c108f60 0x7f138c19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 --2- 172.21.15.22:0/1492257268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f138c103e30 0x7f138c19a490 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 >> 172.21.15.22:0/1492257268 conn(0x7f138c0ff8d0 msgr2=0x7f138c100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 shutdown_connections 2024-09-15T22:29:57.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:29:57.411+0000 7f1392000640 1 -- 172.21.15.22:0/1492257268 wait complete. 2024-09-15T22:29:57.705 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mds[64595]: -- 172.21.15.110:0/559930250 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa46521860 con 0x55fa464ff000 2024-09-15T22:29:57.705 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h[64591]: starting mds.h at 2024-09-15T22:29:57.706 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 bash[64576]: 1bc68a7f27537e27ca730599adb34fa981dc538ac908c1278d39da7a43080e9e 2024-09-15T22:29:57.706 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:29:57 smithi110 systemd[1]: Started Ceph mds.h for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:29:57.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:57.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1492257268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:57.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:57.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:57.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:57.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:57.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1492257268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:57.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:57.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:57.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1492257268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:29:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:29:58.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:58 smithi022 ceph-mon[30634]: Deploying daemon mds.i on smithi112 2024-09-15T22:29:58.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:58 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6836/1376752055,v1:172.21.15.110:6837/1376752055] up:boot 2024-09-15T22:29:58.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:58 smithi022 ceph-mon[30634]: fsmap 8 up:standby 2024-09-15T22:29:58.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:29:58.788 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:58 smithi112 ceph-mon[35032]: Deploying daemon mds.i on smithi112 2024-09-15T22:29:58.788 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:58 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6836/1376752055,v1:172.21.15.110:6837/1376752055] up:boot 2024-09-15T22:29:58.788 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:58 smithi112 ceph-mon[35032]: fsmap 8 up:standby 2024-09-15T22:29:58.789 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:29:58.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:58 smithi110 ceph-mon[35282]: Deploying daemon mds.i on smithi112 2024-09-15T22:29:58.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:58 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6836/1376752055,v1:172.21.15.110:6837/1376752055] up:boot 2024-09-15T22:29:58.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:58 smithi110 ceph-mon[35282]: fsmap 8 up:standby 2024-09-15T22:29:58.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:29:59.352 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 systemd[1]: Starting Ceph mds.i for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:29:59.759 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:29:59 smithi112 ceph-mon[35032]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:59.759 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 podman[66265]: 2024-09-15 22:29:59.376013112 +0000 UTC m=+0.016184318 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:59.759 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 podman[66265]: 2024-09-15 22:29:59.531533088 +0000 UTC m=+0.171704328 container create d36cb64cf7c968d14c54a065297c2aa769d1313bfa3346fbc1fbe5bfca328154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:29:59.760 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 podman[66265]: 2024-09-15 22:29:59.758741123 +0000 UTC m=+0.398912332 container init d36cb64cf7c968d14c54a065297c2aa769d1313bfa3346fbc1fbe5bfca328154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-15T22:29:59.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:29:59 smithi022 ceph-mon[30634]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:29:59.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:29:59 smithi110 ceph-mon[35282]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:00.102 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 podman[66265]: 2024-09-15 22:29:59.761835085 +0000 UTC m=+0.402006291 container start d36cb64cf7c968d14c54a065297c2aa769d1313bfa3346fbc1fbe5bfca328154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T22:30:00.102 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 ceph-mds[66284]: -- 172.21.15.112:0/1233416546 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56374d9f9860 con 0x56374d9d7400 2024-09-15T22:30:00.102 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i[66280]: starting mds.i at 2024-09-15T22:30:00.102 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 bash[66265]: d36cb64cf7c968d14c54a065297c2aa769d1313bfa3346fbc1fbe5bfca328154 2024-09-15T22:30:00.102 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:29:59 smithi112 systemd[1]: Started Ceph mds.i for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:30:00.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:30:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:01.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:01.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:01.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:01.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: Deploying daemon mds.g on smithi022 2024-09-15T22:30:01.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: overall HEALTH_OK 2024-09-15T22:30:01.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] up:boot 2024-09-15T22:30:01.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: fsmap 9 up:standby 2024-09-15T22:30:01.207 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:00 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:30:01.235 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:01.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: Deploying daemon mds.g on smithi022 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: overall HEALTH_OK 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] up:boot 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: fsmap 9 up:standby 2024-09-15T22:30:01.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:00 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:30:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:01.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:01.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: Deploying daemon mds.g on smithi022 2024-09-15T22:30:01.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: overall HEALTH_OK 2024-09-15T22:30:01.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] up:boot 2024-09-15T22:30:01.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: fsmap 9 up:standby 2024-09-15T22:30:01.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:00 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:30:02.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 -- 172.21.15.22:0/3413708515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2694102360 msgr2=0x7f269410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:02.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 --2- 172.21.15.22:0/3413708515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2694102360 0x7f269410e890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f268c009930 tx=0x7f268c02a420 comp rx=0 tx=0).stop 2024-09-15T22:30:02.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 -- 172.21.15.22:0/3413708515 shutdown_connections 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 --2- 172.21.15.22:0/3413708515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26941019c0 0x7f2694101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 --2- 172.21.15.22:0/3413708515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2694102360 0x7f269410e890 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 --2- 172.21.15.22:0/3413708515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26941079c0 0x7f2694107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 -- 172.21.15.22:0/3413708515 >> 172.21.15.22:0/3413708515 conn(0x7f26940fd740 msgr2=0x7f26940ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 -- 172.21.15.22:0/3413708515 shutdown_connections 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.418+0000 7f269aa00640 1 -- 172.21.15.22:0/3413708515 wait complete. 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 Processor -- start 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 -- start start 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 0x7f269419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2694102360 0x7f269419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26941079c0 0x7f269419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2694111e10 con 0x7f26941019c0 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2694111c90 con 0x7f26941079c0 2024-09-15T22:30:02.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.419+0000 7f269aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2694111f90 con 0x7f2694102360 2024-09-15T22:30:02.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2699600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 0x7f269419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:02.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2699600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 0x7f269419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49402/0 (socket says 172.21.15.22:49402) 2024-09-15T22:30:02.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2699600640 1 -- 172.21.15.22:0/669286569 learned_addr learned my addr 172.21.15.22:0/669286569 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:02.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2698c00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2694102360 0x7f269419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:02.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f269a000640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26941079c0 0x7f269419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2698c00640 1 -- 172.21.15.22:0/669286569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26941079c0 msgr2=0x7f269419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2698c00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26941079c0 0x7f269419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2698c00640 1 -- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 msgr2=0x7f269419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2698c00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 0x7f269419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2698c00640 1 -- 172.21.15.22:0/669286569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269419f470 con 0x7f2694102360 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.420+0000 7f2699600640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 0x7f269419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.421+0000 7f2698c00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2694102360 0x7f269419aa00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f268000e9f0 tx=0x7f268000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.421+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268000ccc0 con 0x7f2694102360 2024-09-15T22:30:02.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.421+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2680010910 con 0x7f2694102360 2024-09-15T22:30:02.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.421+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269419f760 con 0x7f2694102360 2024-09-15T22:30:02.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.421+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680018960 con 0x7f2694102360 2024-09-15T22:30:02.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.421+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26941a7040 con 0x7f2694102360 2024-09-15T22:30:02.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.422+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2694101e20 con 0x7f2694102360 2024-09-15T22:30:02.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.426+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2680010ac0 con 0x7f2694102360 2024-09-15T22:30:02.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.427+0000 7f2692000640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f267c0a3240 0x7f267c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:02.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.427+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f26800cfa10 con 0x7f2694102360 2024-09-15T22:30:02.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.427+0000 7f2699600640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f267c0a3240 0x7f267c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:02.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.428+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f268009c4e0 con 0x7f2694102360 2024-09-15T22:30:02.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.428+0000 7f2699600640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f267c0a3240 0x7f267c0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f268800e740 tx=0x7f2688009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.665+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26941a72a0 con 0x7f2694102360 2024-09-15T22:30:02.667 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:02 smithi022 systemd[1]: Starting Ceph mds.g for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:30:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.666+0000 7f2692000640 1 -- 172.21.15.22:0/669286569 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f26800a07e0 con 0x7f2694102360 2024-09-15T22:30:02.668 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:02.668 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"btime":"2024-09-15T22:30:00:488984+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:30:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 10 2024-09-15T22:30:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.668+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f267c0a3240 msgr2=0x7f267c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.668+0000 7f269aa00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f267c0a3240 0x7f267c0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f268800e740 tx=0x7f2688009800 comp rx=0 tx=0).stop 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.668+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2694102360 msgr2=0x7f269419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.668+0000 7f269aa00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2694102360 0x7f269419aa00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f268000e9f0 tx=0x7f268000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 shutdown_connections 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2694102360 0x7f269419aa00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f267c0a3240 0x7f267c0a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26941079c0 0x7f269419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 --2- 172.21.15.22:0/669286569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26941019c0 0x7f269419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 >> 172.21.15.22:0/669286569 conn(0x7f26940fd740 msgr2=0x7f269410d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 shutdown_connections 2024-09-15T22:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:02.669+0000 7f269aa00640 1 -- 172.21.15.22:0/669286569 wait complete. 2024-09-15T22:30:02.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:02 smithi022 ceph-mon[30634]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:02.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:02 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/669286569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:02 smithi110 ceph-mon[35282]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:02 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/669286569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:02 smithi112 ceph-mon[35032]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:02 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/669286569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:03.745 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 podman[71211]: 2024-09-15 22:30:03.471743238 +0000 UTC m=+0.758446603 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:30:03.745 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 podman[71211]: 2024-09-15 22:30:03.623859976 +0000 UTC m=+0.910563323 container create a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0) 2024-09-15T22:30:04.282 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 podman[71211]: 2024-09-15 22:30:03.86003611 +0000 UTC m=+1.146739459 container init a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:30:04.282 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 podman[71211]: 2024-09-15 22:30:03.866097241 +0000 UTC m=+1.152800597 container start a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:30:04.282 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 ceph-mds[71238]: -- 172.21.15.22:0/921395835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558e08a78680 con 0x558e08a4d000 2024-09-15T22:30:04.282 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 ceph-mds[71238]: -- 172.21.15.22:0/921395835 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558e08a6f860 con 0x558e08a4d000 2024-09-15T22:30:04.283 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g[71234]: starting mds.g at 2024-09-15T22:30:04.283 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 bash[71211]: a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f 2024-09-15T22:30:04.283 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:30:03 smithi022 systemd[1]: Started Ceph mds.g for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:30:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: Deploying daemon mds.a on smithi022 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] up:boot 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: fsmap 10 up:standby 2024-09-15T22:30:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:30:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: Deploying daemon mds.a on smithi022 2024-09-15T22:30:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] up:boot 2024-09-15T22:30:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: fsmap 10 up:standby 2024-09-15T22:30:05.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:30:05.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:30:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: Deploying daemon mds.a on smithi022 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] up:boot 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: fsmap 10 up:standby 2024-09-15T22:30:05.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:30:05.856 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:06.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 -- 172.21.15.22:0/1650662631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150076720 msgr2=0x7fd150076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:06.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 --2- 172.21.15.22:0/1650662631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150076720 0x7fd150076b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd140009900 tx=0x7fd14002a410 comp rx=0 tx=0).stop 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 -- 172.21.15.22:0/1650662631 shutdown_connections 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 --2- 172.21.15.22:0/1650662631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150112a30 0x7fd150114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 --2- 172.21.15.22:0/1650662631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150077040 0x7fd1501124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 --2- 172.21.15.22:0/1650662631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150076720 0x7fd150076b00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 -- 172.21.15.22:0/1650662631 >> 172.21.15.22:0/1650662631 conn(0x7fd1500ffa90 msgr2=0x7fd150101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 -- 172.21.15.22:0/1650662631 shutdown_connections 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.412+0000 7fd155400640 1 -- 172.21.15.22:0/1650662631 wait complete. 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 Processor -- start 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 -- start start 2024-09-15T22:30:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150076720 0x7fd1501a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150077040 0x7fd1501a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150112a30 0x7fd15019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501185c0 con 0x7fd150077040 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd150118440 con 0x7fd150112a30 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.413+0000 7fd155400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd150118740 con 0x7fd150076720 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150112a30 0x7fd15019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd147e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150077040 0x7fd1501a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150076720 0x7fd1501a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150112a30 0x7fd15019e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:50876/0 (socket says 172.21.15.22:50876) 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14f200640 1 -- 172.21.15.22:0/3861124942 learned_addr learned my addr 172.21.15.22:0/3861124942 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14e800640 1 -- 172.21.15.22:0/3861124942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150112a30 msgr2=0x7fd15019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14e800640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150112a30 0x7fd15019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14e800640 1 -- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150077040 msgr2=0x7fd1501a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14e800640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150077040 0x7fd1501a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.414+0000 7fd14e800640 1 -- 172.21.15.22:0/3861124942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15019efc0 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.415+0000 7fd14e800640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150076720 0x7fd1501a46d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd140005940 tx=0x7fd1400040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.415+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14003f030 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.415+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15019f250 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.415+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1400044c0 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.415+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140035070 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.415+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1501ab5a0 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.416+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd150076b00 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.418+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd140042030 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.419+0000 7fd147400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1340a3240 0x7fd1340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.419+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd1400ef680 con 0x7fd150076720 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.420+0000 7fd147e00640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1340a3240 0x7fd1340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.420+0000 7fd147e00640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1340a3240 0x7fd1340a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd150079e10 tx=0x7fd138005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.421+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1400bc150 con 0x7fd150076720 2024-09-15T22:30:06.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.653+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd15019fdc0 con 0x7fd150076720 2024-09-15T22:30:06.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.653+0000 7fd147400640 1 -- 172.21.15.22:0/3861124942 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fd1400c0450 con 0x7fd150076720 2024-09-15T22:30:06.657 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 11 2024-09-15T22:30:06.657 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:06.657 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"btime":"2024-09-15T22:30:04:904974+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24530,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-09-15T22:30:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1340a3240 msgr2=0x7fd1340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1340a3240 0x7fd1340a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd150079e10 tx=0x7fd138005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150076720 msgr2=0x7fd1501a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150076720 0x7fd1501a46d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd140005940 tx=0x7fd1400040c0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 shutdown_connections 2024-09-15T22:30:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1340a3240 0x7fd1340a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd150112a30 0x7fd15019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd150077040 0x7fd1501a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 --2- 172.21.15.22:0/3861124942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd150076720 0x7fd1501a46d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:06.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 >> 172.21.15.22:0/3861124942 conn(0x7fd1500ffa90 msgr2=0x7fd150101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:06.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 shutdown_connections 2024-09-15T22:30:06.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:06.657+0000 7fd155400640 1 -- 172.21.15.22:0/3861124942 wait complete. 2024-09-15T22:30:07.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:07 smithi022 ceph-mon[30634]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:07.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:07 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3861124942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:07.283 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 podman[71626]: 2024-09-15 22:30:07.200176911 +0000 UTC m=+0.271814806 container create 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:30:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:07 smithi112 ceph-mon[35032]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:07 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3861124942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:07 smithi110 ceph-mon[35282]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:07 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3861124942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:08.032 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 podman[71626]: 2024-09-15 22:30:07.75531165 +0000 UTC m=+0.826949538 container init 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:30:08.032 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 podman[71626]: 2024-09-15 22:30:07.761770278 +0000 UTC m=+0.833408176 container start 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T22:30:08.032 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 ceph-mds[71650]: -- 172.21.15.22:0/3113348100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d0837a7c20 con 0x55d083785000 2024-09-15T22:30:08.032 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a[71642]: starting mds.a at 2024-09-15T22:30:08.032 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 bash[71626]: 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a 2024-09-15T22:30:08.033 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:30:07 smithi022 systemd[1]: Started Ceph mds.a for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:30:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: Deploying daemon mds.b on smithi110 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.22:6840/2894630573,v1:172.21.15.22:6841/2894630573] up:boot 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: fsmap 11 up:standby 2024-09-15T22:30:09.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:08 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:30:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: Deploying daemon mds.b on smithi110 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.22:6840/2894630573,v1:172.21.15.22:6841/2894630573] up:boot 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: fsmap 11 up:standby 2024-09-15T22:30:09.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:08 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:30:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: Deploying daemon mds.b on smithi110 2024-09-15T22:30:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.22:6840/2894630573,v1:172.21.15.22:6841/2894630573] up:boot 2024-09-15T22:30:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: fsmap 11 up:standby 2024-09-15T22:30:09.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:08 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:30:09.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:30:09.955 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:09 smithi110 systemd[1]: Starting Ceph mds.b for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:30:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:10.285 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 podman[64882]: 2024-09-15 22:30:09.928251896 +0000 UTC m=+0.015795871 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:30:10.285 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 podman[64882]: 2024-09-15 22:30:10.047054339 +0000 UTC m=+0.134598300 container create 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:30:10.285 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 podman[64882]: 2024-09-15 22:30:10.257767797 +0000 UTC m=+0.345311753 container init 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T22:30:10.285 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 podman[64882]: 2024-09-15 22:30:10.260639147 +0000 UTC m=+0.348183102 container start 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:30:10.285 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 ceph-mds[64901]: -- 172.21.15.110:0/3366465734 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b1ca7d860 con 0x559b1ca5a800 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 -- 172.21.15.22:0/3208302771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9581049a0 msgr2=0x7fb9581089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3208302771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9581049a0 0x7fb9581089f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb944009900 tx=0x7fb94402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 -- 172.21.15.22:0/3208302771 shutdown_connections 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3208302771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 0x7fb958110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3208302771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9581049a0 0x7fb9581089f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3208302771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958103ff0 0x7fb9581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 -- 172.21.15.22:0/3208302771 >> 172.21.15.22:0/3208302771 conn(0x7fb9580ffa90 msgr2=0x7fb958101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 -- 172.21.15.22:0/3208302771 shutdown_connections 2024-09-15T22:30:10.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.682+0000 7fb95ca00640 1 -- 172.21.15.22:0/3208302771 wait complete. 2024-09-15T22:30:10.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.683+0000 7fb95ca00640 1 Processor -- start 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 -- start start 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb958103ff0 0x7fb95819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 0x7fb95819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 0x7fb95819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb958114120 con 0x7fb958103ff0 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb958113fa0 con 0x7fb9581049a0 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb95ca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581142a0 con 0x7fb958109120 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb955400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 0x7fb95819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb955e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb958103ff0 0x7fb95819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb955400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 0x7fb95819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:46578/0 (socket says 172.21.15.22:46578) 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb955400640 1 -- 172.21.15.22:0/3059347475 learned_addr learned my addr 172.21.15.22:0/3059347475 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.684+0000 7fb956800640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 0x7fb95819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:10.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb955400640 1 -- 172.21.15.22:0/3059347475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 msgr2=0x7fb95819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb955400640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 0x7fb95819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb955400640 1 -- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb958103ff0 msgr2=0x7fb95819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb955400640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb958103ff0 0x7fb95819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb955400640 1 -- 172.21.15.22:0/3059347475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95819f650 con 0x7fb9581049a0 2024-09-15T22:30:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb956800640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 0x7fb95819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:10.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb955400640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 0x7fb95819abe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb944006010 tx=0x7fb944004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94403f030 con 0x7fb9581049a0 2024-09-15T22:30:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb944004440 con 0x7fb9581049a0 2024-09-15T22:30:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.685+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95819f8e0 con 0x7fb9581049a0 2024-09-15T22:30:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.686+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944035070 con 0x7fb9581049a0 2024-09-15T22:30:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.686+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9581a7220 con 0x7fb9581049a0 2024-09-15T22:30:10.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.687+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9581043d0 con 0x7fb9581049a0 2024-09-15T22:30:10.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.689+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb944042030 con 0x7fb9581049a0 2024-09-15T22:30:10.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.690+0000 7fb94ea00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb93c0a32c0 0x7fb93c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:10.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.690+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb9440ef6b0 con 0x7fb9581049a0 2024-09-15T22:30:10.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.690+0000 7fb955e00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb93c0a32c0 0x7fb93c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:10.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.691+0000 7fb955e00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb93c0a32c0 0x7fb93c0a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb948009bd0 tx=0x7fb948005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:10.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.696+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9440bc180 con 0x7fb9581049a0 2024-09-15T22:30:10.705 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: starting mds.b at 2024-09-15T22:30:10.705 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 bash[64882]: 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc 2024-09-15T22:30:10.705 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:10 smithi110 systemd[1]: Started Ceph mds.b for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:30:10.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.921+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb95819ba00 con 0x7fb9581049a0 2024-09-15T22:30:10.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.921+0000 7fb94ea00640 1 -- 172.21.15.22:0/3059347475 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7fb95819ba00 con 0x7fb9581049a0 2024-09-15T22:30:10.923 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:10.924 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2024-09-15T22:30:10.924 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"btime":"2024-09-15T22:30:08:029645+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24530,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb93c0a32c0 msgr2=0x7fb93c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb93c0a32c0 0x7fb93c0a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb948009bd0 tx=0x7fb948005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 msgr2=0x7fb95819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 0x7fb95819abe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb944006010 tx=0x7fb944004040 comp rx=0 tx=0).stop 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 shutdown_connections 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb958109120 0x7fb95819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb93c0a32c0 0x7fb93c0a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9581049a0 0x7fb95819abe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 --2- 172.21.15.22:0/3059347475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb958103ff0 0x7fb95819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 >> 172.21.15.22:0/3059347475 conn(0x7fb9580ffa90 msgr2=0x7fb958100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:10.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.925+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 shutdown_connections 2024-09-15T22:30:10.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:10.926+0000 7fb95ca00640 1 -- 172.21.15.22:0/3059347475 wait complete. 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:30:11.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3059347475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:11.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] up:boot 2024-09-15T22:30:11.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: fsmap 12 up:standby 2024-09-15T22:30:11.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:30:11.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3059347475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:11.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] up:boot 2024-09-15T22:30:11.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: fsmap 12 up:standby 2024-09-15T22:30:11.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3059347475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] up:boot 2024-09-15T22:30:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: fsmap 12 up:standby 2024-09-15T22:30:11.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:30:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:12 smithi022 ceph-mon[30634]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:12 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:12 smithi110 ceph-mon[35282]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:12 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:12 smithi112 ceph-mon[35032]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:13.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:12 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:13.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:14.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:14.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:30:14.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.515 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:14 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:30:14.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:14.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:30:14.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:14 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:30:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:14.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:30:14.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:14.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:14 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:30:14.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 -- 172.21.15.22:0/1321534465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101de0 msgr2=0x7f8d781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:14.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 --2- 172.21.15.22:0/1321534465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101de0 0x7f8d781021c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009900 tx=0x7f8d6802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:30:14.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 -- 172.21.15.22:0/1321534465 shutdown_connections 2024-09-15T22:30:14.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 --2- 172.21.15.22:0/1321534465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78106f10 0x7f8d7810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:14.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 --2- 172.21.15.22:0/1321534465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 --2- 172.21.15.22:0/1321534465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101de0 0x7f8d781021c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 -- 172.21.15.22:0/1321534465 >> 172.21.15.22:0/1321534465 conn(0x7f8d780fd8c0 msgr2=0x7f8d780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 -- 172.21.15.22:0/1321534465 shutdown_connections 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.750+0000 7f8d7da00640 1 -- 172.21.15.22:0/1321534465 wait complete. 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.751+0000 7f8d7da00640 1 Processor -- start 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.751+0000 7f8d7da00640 1 -- start start 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d7da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78101de0 0x7f8d7819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d7da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d7819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d7da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78106f10 0x7f8d7819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d7da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78111fc0 con 0x7f8d78101de0 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d7da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78111e40 con 0x7f8d78102790 2024-09-15T22:30:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d7da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78112140 con 0x7f8d78106f10 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d76a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78101de0 0x7f8d7819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d7819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d76a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78101de0 0x7f8d7819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39808/0 (socket says 172.21.15.22:39808) 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d7819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:46598/0 (socket says 172.21.15.22:46598) 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d76a00640 1 -- 172.21.15.22:0/3044526142 learned_addr learned my addr 172.21.15.22:0/3044526142 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d77400640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78106f10 0x7f8d7819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 -- 172.21.15.22:0/3044526142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78106f10 msgr2=0x7f8d7819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78106f10 0x7f8d7819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 -- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78101de0 msgr2=0x7f8d7819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78101de0 0x7f8d7819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.752+0000 7f8d6e000640 1 -- 172.21.15.22:0/3044526142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7819f5f0 con 0x7f8d78102790 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.753+0000 7f8d6e000640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d7819ab80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000e9f0 tx=0x7f8d6000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:14.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.753+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000ccc0 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.753+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d60010910 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.753+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7819f8e0 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.753+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60018960 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.753+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d781a71c0 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.754+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d781021c0 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.757+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8d60010ac0 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.758+0000 7f8d6fe00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d5c0a32c0 0x7f8d5c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.758+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8d600cfcb0 con 0x7f8d78102790 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.759+0000 7f8d76a00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d5c0a32c0 0x7f8d5c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.759+0000 7f8d76a00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d5c0a32c0 0x7f8d5c0a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d680096c0 tx=0x7f8d680046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:14.761+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d6009c780 con 0x7f8d78102790 2024-09-15T22:30:15.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.011+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d7819b9a0 con 0x7f8d78102790 2024-09-15T22:30:15.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.012+0000 7f8d6fe00640 1 -- 172.21.15.22:0/3044526142 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f8d7819b9a0 con 0x7f8d78102790 2024-09-15T22:30:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:15.014 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"btime":"2024-09-15T22:30:10:923644+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24530,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-15T22:30:15.014 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-09-15T22:30:15.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d5c0a32c0 msgr2=0x7f8d5c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:15.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d5c0a32c0 0x7f8d5c0a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d680096c0 tx=0x7f8d680046c0 comp rx=0 tx=0).stop 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 msgr2=0x7f8d7819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d7819ab80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000e9f0 tx=0x7f8d6000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 shutdown_connections 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78106f10 0x7f8d7819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d5c0a32c0 0x7f8d5c0a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d78102790 0x7f8d7819ab80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 --2- 172.21.15.22:0/3044526142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78101de0 0x7f8d7819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.014+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 >> 172.21.15.22:0/3044526142 conn(0x7f8d780fd8c0 msgr2=0x7f8d780feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.015+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 shutdown_connections 2024-09-15T22:30:15.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:15.015+0000 7f8d7da00640 1 -- 172.21.15.22:0/3044526142 wait complete. 2024-09-15T22:30:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:15 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3044526142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:15 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3044526142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:15 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3044526142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:16.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T22:30:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:17.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 -- 172.21.15.22:0/4125639824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c0745c0 msgr2=0x7f736c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:17.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 --2- 172.21.15.22:0/4125639824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c0745c0 0x7f736c0749a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f735c009900 tx=0x7f735c02a480 comp rx=0 tx=0).stop 2024-09-15T22:30:17.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 -- 172.21.15.22:0/4125639824 shutdown_connections 2024-09-15T22:30:17.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 --2- 172.21.15.22:0/4125639824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f736c074ee0 0x7f736c10dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 --2- 172.21.15.22:0/4125639824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c10e260 0x7f736c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 --2- 172.21.15.22:0/4125639824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c0745c0 0x7f736c0749a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 -- 172.21.15.22:0/4125639824 >> 172.21.15.22:0/4125639824 conn(0x7f736c0fd740 msgr2=0x7f736c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:17.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 -- 172.21.15.22:0/4125639824 shutdown_connections 2024-09-15T22:30:17.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.327+0000 7f7370c00640 1 -- 172.21.15.22:0/4125639824 wait complete. 2024-09-15T22:30:17.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.328+0000 7f7370c00640 1 Processor -- start 2024-09-15T22:30:17.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.328+0000 7f7370c00640 1 -- start start 2024-09-15T22:30:17.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7370c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f736c0745c0 0x7f736c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:17.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7370c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 0x7f736c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:17.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7370c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c10e260 0x7f736c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:17.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7370c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f736c114000 con 0x7f736c074ee0 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7370c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f736c113e80 con 0x7f736c10e260 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7370c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f736c114180 con 0x7f736c0745c0 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 0x7f736c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 0x7f736c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39822/0 (socket says 172.21.15.22:39822) 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 -- 172.21.15.22:0/704310517 learned_addr learned my addr 172.21.15.22:0/704310517 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f736b400640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f736c0745c0 0x7f736c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f736be00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c10e260 0x7f736c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 -- 172.21.15.22:0/704310517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f736c0745c0 msgr2=0x7f736c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f736c0745c0 0x7f736c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 -- 172.21.15.22:0/704310517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c10e260 msgr2=0x7f736c19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c10e260 0x7f736c19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.329+0000 7f7363e00640 1 -- 172.21.15.22:0/704310517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c19f490 con 0x7f736c074ee0 2024-09-15T22:30:17.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.330+0000 7f7363e00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 0x7f736c19aa20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f735400e9f0 tx=0x7f735400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:17.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.330+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735400cd80 con 0x7f736c074ee0 2024-09-15T22:30:17.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.330+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7354005500 con 0x7f736c074ee0 2024-09-15T22:30:17.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.330+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c19f780 con 0x7f736c074ee0 2024-09-15T22:30:17.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.330+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354010690 con 0x7f736c074ee0 2024-09-15T22:30:17.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.330+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a7060 con 0x7f736c074ee0 2024-09-15T22:30:17.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.331+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c0749a0 con 0x7f736c074ee0 2024-09-15T22:30:17.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.333+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f73540046c0 con 0x7f736c074ee0 2024-09-15T22:30:17.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.335+0000 7f7368c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f73500a3240 0x7f73500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:17.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.335+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f73540cfbe0 con 0x7f736c074ee0 2024-09-15T22:30:17.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.335+0000 7f736b400640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f73500a3240 0x7f73500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:17.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.336+0000 7f736b400640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f73500a3240 0x7f73500a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f735c000c00 tx=0x7f735c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:17.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.337+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f735409cd00 con 0x7f736c074ee0 2024-09-15T22:30:17.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:17 smithi022 ceph-mon[30634]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.531+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f736c19b840 con 0x7f736c074ee0 2024-09-15T22:30:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.532+0000 7f7368c00640 1 -- 172.21.15.22:0/704310517 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f735409c600 con 0x7f736c074ee0 2024-09-15T22:30:17.533 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:17.534 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-09-15T22:30:17.534 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:30:17.534 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-09-15T22:30:17.534 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-09-15T22:30:17.534 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:30:17.534 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.534+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f73500a3240 msgr2=0x7f73500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f73500a3240 0x7f73500a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f735c000c00 tx=0x7f735c005b50 comp rx=0 tx=0).stop 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 msgr2=0x7f736c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 0x7f736c19aa20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f735400e9f0 tx=0x7f735400edf0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 shutdown_connections 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f73500a3240 0x7f73500a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f736c10e260 0x7f736c19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f736c074ee0 0x7f736c19aa20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 --2- 172.21.15.22:0/704310517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f736c0745c0 0x7f736c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:17.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 >> 172.21.15.22:0/704310517 conn(0x7f736c0fd740 msgr2=0x7f736c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:17.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 shutdown_connections 2024-09-15T22:30:17.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:17.535+0000 7f7370c00640 1 -- 172.21.15.22:0/704310517 wait complete. 2024-09-15T22:30:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:17 smithi110 ceph-mon[35282]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:17 smithi112 ceph-mon[35032]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:18.344 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:30:18.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:30:18.725 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/704310517' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:30:18.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:18 smithi022 ceph-mon[30634]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/704310517' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:30:18.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:18 smithi112 ceph-mon[35032]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:30:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:30:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:30:18.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/704310517' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:30:18.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:18 smithi110 ceph-mon[35282]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 -- 172.21.15.22:0/3364626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c108f60 msgr2=0x7f954c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 --2- 172.21.15.22:0/3364626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c108f60 0x7f954c110ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9544009ca0 tx=0x7f954402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:30:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 -- 172.21.15.22:0/3364626090 shutdown_connections 2024-09-15T22:30:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 --2- 172.21.15.22:0/3364626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c108f60 0x7f954c110ae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:19.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 --2- 172.21.15.22:0/3364626090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f954c1047e0 0x7f954c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:19.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 --2- 172.21.15.22:0/3364626090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:19.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 -- 172.21.15.22:0/3364626090 >> 172.21.15.22:0/3364626090 conn(0x7f954c0ff910 msgr2=0x7f954c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:19.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 -- 172.21.15.22:0/3364626090 shutdown_connections 2024-09-15T22:30:19.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.280+0000 7f9552600640 1 -- 172.21.15.22:0/3364626090 wait complete. 2024-09-15T22:30:19.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 Processor -- start 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 -- start start 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c1047e0 0x7f954c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f954c108f60 0x7f954c19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f954c114010 con 0x7f954c1047e0 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f954c113e90 con 0x7f954c108f60 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.281+0000 7f9552600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f954c114190 con 0x7f954c103e30 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f954be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c1047e0 0x7f954c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:19.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41788/0 (socket says 172.21.15.22:41788) 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 -- 172.21.15.22:0/2941908392 learned_addr learned my addr 172.21.15.22:0/2941908392 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551c00640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f954c108f60 0x7f954c19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 -- 172.21.15.22:0/2941908392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f954c108f60 msgr2=0x7f954c19ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f954c108f60 0x7f954c19ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 -- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c1047e0 msgr2=0x7f954c19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c1047e0 0x7f954c19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f9551200640 1 -- 172.21.15.22:0/2941908392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c19f3a0 con 0x7f954c103e30 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.282+0000 7f954be00640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c1047e0 0x7f954c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.283+0000 7f9551200640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c19a3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f954000ea60 tx=0x7f954000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.283+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954000cde0 con 0x7f954c103e30 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.283+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c19f690 con 0x7f954c103e30 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.283+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95400035f0 con 0x7f954c103e30 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.283+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540010670 con 0x7f954c103e30 2024-09-15T22:30:19.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.283+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c1a6f70 con 0x7f954c103e30 2024-09-15T22:30:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.284+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c105310 con 0x7f954c103e30 2024-09-15T22:30:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.286+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f95400037a0 con 0x7f954c103e30 2024-09-15T22:30:19.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.287+0000 7f9549600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f95340a3240 0x7f95340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:19.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.287+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f95400cfb90 con 0x7f954c103e30 2024-09-15T22:30:19.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.287+0000 7f954be00640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f95340a3240 0x7f95340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:19.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.288+0000 7f954be00640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f95340a3240 0x7f95340a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f954c0ffd30 tx=0x7f9538005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:19.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.289+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f954009ccb0 con 0x7f954c103e30 2024-09-15T22:30:19.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:19.476+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f954c19b750 con 0x7f954c103e30 2024-09-15T22:30:20.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.072+0000 7f9549600640 1 -- 172.21.15.22:0/2941908392 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7f954009c5b0 con 0x7f954c103e30 2024-09-15T22:30:20.074 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-09-15T22:30:20.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f95340a3240 msgr2=0x7f95340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:20.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f95340a3240 0x7f95340a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f954c0ffd30 tx=0x7f9538005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:20.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 msgr2=0x7f954c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:20.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c19a3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f954000ea60 tx=0x7f954000ef20 comp rx=0 tx=0).stop 2024-09-15T22:30:20.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 shutdown_connections 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f95340a3240 0x7f95340a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f954c108f60 0x7f954c19ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f954c1047e0 0x7f954c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 --2- 172.21.15.22:0/2941908392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f954c103e30 0x7f954c19a3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.078+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 >> 172.21.15.22:0/2941908392 conn(0x7f954c0ff910 msgr2=0x7f954c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.079+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 shutdown_connections 2024-09-15T22:30:20.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:20.079+0000 7f9552600640 1 -- 172.21.15.22:0/2941908392 wait complete. 2024-09-15T22:30:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:20 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2941908392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:30:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:20 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:30:20.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:20 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2941908392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:30:20.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:20 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:30:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:20 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2941908392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:30:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:20 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:30:20.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:30:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:21.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:21 smithi022 ceph-mon[30634]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:21.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:21 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:30:21.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:21 smithi022 ceph-mon[30634]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:30:21.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:21 smithi022 ceph-mon[30634]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:30:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:21 smithi112 ceph-mon[35032]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:21 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:30:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:21 smithi112 ceph-mon[35032]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:30:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:21 smithi112 ceph-mon[35032]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:30:21.356 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:21 smithi110 ceph-mon[35282]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:21.357 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:21 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:30:21.357 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:21 smithi110 ceph-mon[35282]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:30:21.357 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:21 smithi110 ceph-mon[35282]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.765+0000 7fb603800640 1 -- 172.21.15.22:0/3962274902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc101de0 msgr2=0x7fb5fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.765+0000 7fb603800640 1 --2- 172.21.15.22:0/3962274902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc101de0 0x7fb5fc1021c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009900 tx=0x7fb5f002a410 comp rx=0 tx=0).stop 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 -- 172.21.15.22:0/3962274902 shutdown_connections 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 --2- 172.21.15.22:0/3962274902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5fc102790 0x7fb5fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 --2- 172.21.15.22:0/3962274902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc106f10 0x7fb5fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 --2- 172.21.15.22:0/3962274902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc101de0 0x7fb5fc1021c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 -- 172.21.15.22:0/3962274902 >> 172.21.15.22:0/3962274902 conn(0x7fb5fc0fd8c0 msgr2=0x7fb5fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 -- 172.21.15.22:0/3962274902 shutdown_connections 2024-09-15T22:30:21.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.766+0000 7fb603800640 1 -- 172.21.15.22:0/3962274902 wait complete. 2024-09-15T22:30:21.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.767+0000 7fb603800640 1 Processor -- start 2024-09-15T22:30:21.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.767+0000 7fb603800640 1 -- start start 2024-09-15T22:30:21.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb603800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5fc101de0 0x7fb5fc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:21.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb603800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc102790 0x7fb5fc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:21.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb603800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 0x7fb5fc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:21.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb603800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc111fc0 con 0x7fb5fc106f10 2024-09-15T22:30:21.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb603800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc111e40 con 0x7fb5fc102790 2024-09-15T22:30:21.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb603800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc112140 con 0x7fb5fc101de0 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb5fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc102790 0x7fb5fc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 0x7fb5fc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 0x7fb5fc19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56728/0 (socket says 172.21.15.22:56728) 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb5fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc102790 0x7fb5fc198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:48632/0 (socket says 172.21.15.22:48632) 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 -- 172.21.15.22:0/1171825831 learned_addr learned my addr 172.21.15.22:0/1171825831 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb600e00640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5fc101de0 0x7fb5fc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:21.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 -- 172.21.15.22:0/1171825831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5fc101de0 msgr2=0x7fb5fc198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5fc101de0 0x7fb5fc198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 -- 172.21.15.22:0/1171825831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc102790 msgr2=0x7fb5fc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc102790 0x7fb5fc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.768+0000 7fb601800640 1 -- 172.21.15.22:0/1171825831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc19d3b0 con 0x7fb5fc106f10 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.769+0000 7fb601800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 0x7fb5fc19ccd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400eb10 tx=0x7fb5f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.769+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4004b20 con 0x7fb5fc106f10 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.769+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f4004cc0 con 0x7fb5fc106f10 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.769+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4010760 con 0x7fb5fc106f10 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.769+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc19d6a0 con 0x7fb5fc106f10 2024-09-15T22:30:21.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.769+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc074420 con 0x7fb5fc106f10 2024-09-15T22:30:21.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.770+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5fc1021c0 con 0x7fb5fc106f10 2024-09-15T22:30:21.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.772+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb5f4005000 con 0x7fb5fc106f10 2024-09-15T22:30:21.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.774+0000 7fb5f9600640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5e40a32c0 0x7fb5e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:21.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.774+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7fb5f40cfd20 con 0x7fb5fc106f10 2024-09-15T22:30:21.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.774+0000 7fb600e00640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5e40a32c0 0x7fb5e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:21.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.775+0000 7fb600e00640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5e40a32c0 0x7fb5e40a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000c00 tx=0x7fb5f0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:21.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.776+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5f40541b0 con 0x7fb5fc106f10 2024-09-15T22:30:21.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:21.964+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5fc199760 con 0x7fb5fc106f10 2024-09-15T22:30:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.503+0000 7fb5f9600640 1 -- 172.21.15.22:0/1171825831 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7fb5fc199760 con 0x7fb5fc106f10 2024-09-15T22:30:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-09-15T22:30:22.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.506+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5e40a32c0 msgr2=0x7fb5e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.506+0000 7fb603800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5e40a32c0 0x7fb5e40a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000c00 tx=0x7fb5f0005b50 comp rx=0 tx=0).stop 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.506+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 msgr2=0x7fb5fc19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.506+0000 7fb603800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 0x7fb5fc19ccd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400eb10 tx=0x7fb5f400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 shutdown_connections 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5e40a32c0 0x7fb5e40a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5fc106f10 0x7fb5fc19ccd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5fc102790 0x7fb5fc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 --2- 172.21.15.22:0/1171825831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5fc101de0 0x7fb5fc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 >> 172.21.15.22:0/1171825831 conn(0x7fb5fc0fd8c0 msgr2=0x7fb5fc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 shutdown_connections 2024-09-15T22:30:22.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:22.507+0000 7fb603800640 1 -- 172.21.15.22:0/1171825831 wait complete. 2024-09-15T22:30:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:22 smithi022 ceph-mon[30634]: pgmap v281: 33 pgs: 5 creating+peering, 21 unknown, 7 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:22 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1171825831' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:30:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:22 smithi022 ceph-mon[30634]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:30:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:22 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1171825831' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:30:22.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:22 smithi022 ceph-mon[30634]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:30:22.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:22 smithi112 ceph-mon[35032]: pgmap v281: 33 pgs: 5 creating+peering, 21 unknown, 7 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:22.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:22 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1171825831' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:30:22.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:22 smithi112 ceph-mon[35032]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:30:22.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:22 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1171825831' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:30:22.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:22 smithi112 ceph-mon[35032]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:30:22.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:22 smithi110 ceph-mon[35282]: pgmap v281: 33 pgs: 5 creating+peering, 21 unknown, 7 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:22.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:22 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1171825831' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:30:22.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:22 smithi110 ceph-mon[35282]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:30:22.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:22 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1171825831' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:30:22.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:22 smithi110 ceph-mon[35282]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:30:23.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:30:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.310+0000 7faa80400640 1 -- 172.21.15.22:0/2959145850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781027a0 msgr2=0x7faa781067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.310+0000 7faa80400640 1 --2- 172.21.15.22:0/2959145850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781027a0 0x7faa781067f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa64009900 tx=0x7faa6402a410 comp rx=0 tx=0).stop 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 -- 172.21.15.22:0/2959145850 shutdown_connections 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 --2- 172.21.15.22:0/2959145850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781027a0 0x7faa781067f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 --2- 172.21.15.22:0/2959145850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa78106f20 0x7faa7810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 --2- 172.21.15.22:0/2959145850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa78101df0 0x7faa781021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 -- 172.21.15.22:0/2959145850 >> 172.21.15.22:0/2959145850 conn(0x7faa780fd8b0 msgr2=0x7faa780ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 -- 172.21.15.22:0/2959145850 shutdown_connections 2024-09-15T22:30:24.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.311+0000 7faa80400640 1 -- 172.21.15.22:0/2959145850 wait complete. 2024-09-15T22:30:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 Processor -- start 2024-09-15T22:30:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 -- start start 2024-09-15T22:30:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa78101df0 0x7faa780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa781027a0 0x7faa78074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 0x7faa78074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa78111fd0 con 0x7faa781027a0 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa78111e50 con 0x7faa78101df0 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.312+0000 7faa80400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa78112150 con 0x7faa78106f20 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 0x7faa78074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 0x7faa78074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37900/0 (socket says 172.21.15.22:37900) 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 -- 172.21.15.22:0/2982691965 learned_addr learned my addr 172.21.15.22:0/2982691965 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa781027a0 0x7faa78074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7da00640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa78101df0 0x7faa780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 -- 172.21.15.22:0/2982691965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa78101df0 msgr2=0x7faa780744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa78101df0 0x7faa780744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 -- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa781027a0 msgr2=0x7faa78074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa781027a0 0x7faa78074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 -- 172.21.15.22:0/2982691965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa781a68b0 con 0x7faa78106f20 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7d000640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa781027a0 0x7faa78074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa7e400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 0x7faa78074f70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa7000eb10 tx=0x7faa7000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.313+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70004b20 con 0x7faa78106f20 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.314+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa781a6ba0 con 0x7faa78106f20 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.314+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa70004cc0 con 0x7faa78106f20 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.314+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70010760 con 0x7faa78106f20 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.314+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa781a70b0 con 0x7faa78106f20 2024-09-15T22:30:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.315+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa781021d0 con 0x7faa78106f20 2024-09-15T22:30:24.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.317+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faa70010900 con 0x7faa78106f20 2024-09-15T22:30:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.318+0000 7faa76000640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa600a32c0 0x7faa600a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.318+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7faa700cfff0 con 0x7faa78106f20 2024-09-15T22:30:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.318+0000 7faa7da00640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa600a32c0 0x7faa600a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.319+0000 7faa7da00640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa600a32c0 0x7faa600a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005fd0 tx=0x7faa6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.320+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa7009ce20 con 0x7faa78106f20 2024-09-15T22:30:24.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:24.570+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faa78109bd0 con 0x7faa78106f20 2024-09-15T22:30:24.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:24 smithi022 ceph-mon[30634]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:30:24.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:24 smithi022 ceph-mon[30634]: pgmap v284: 97 pgs: 17 creating+peering, 63 unknown, 17 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:24 smithi112 ceph-mon[35032]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:30:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:24 smithi112 ceph-mon[35032]: pgmap v284: 97 pgs: 17 creating+peering, 63 unknown, 17 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:24 smithi110 ceph-mon[35282]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:30:24.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:24 smithi110 ceph-mon[35282]: pgmap v284: 97 pgs: 17 creating+peering, 63 unknown, 17 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:25.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.524+0000 7faa76000640 1 -- 172.21.15.22:0/2982691965 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7faa7009c720 con 0x7faa78106f20 2024-09-15T22:30:25.526 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.528+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa600a32c0 msgr2=0x7faa600a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.528+0000 7faa80400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa600a32c0 0x7faa600a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005fd0 tx=0x7faa6c00b390 comp rx=0 tx=0).stop 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.528+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 msgr2=0x7faa78074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.528+0000 7faa80400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 0x7faa78074f70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa7000eb10 tx=0x7faa7000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.529+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 shutdown_connections 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.529+0000 7faa80400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78106f20 0x7faa78074f70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.529+0000 7faa80400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa600a32c0 0x7faa600a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.529+0000 7faa80400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa781027a0 0x7faa78074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:25.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.529+0000 7faa80400640 1 --2- 172.21.15.22:0/2982691965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa78101df0 0x7faa780744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:25.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.529+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 >> 172.21.15.22:0/2982691965 conn(0x7faa780fd8b0 msgr2=0x7faa780ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.531+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 shutdown_connections 2024-09-15T22:30:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:25.531+0000 7faa80400640 1 -- 172.21.15.22:0/2982691965 wait complete. 2024-09-15T22:30:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:25 smithi022 ceph-mon[30634]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:30:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:25 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2982691965' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:30:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:25 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:30:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:25 smithi022 ceph-mon[30634]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:30:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:25 smithi112 ceph-mon[35032]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:30:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:25 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2982691965' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:30:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:25 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:30:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:25 smithi112 ceph-mon[35032]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:30:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:25 smithi110 ceph-mon[35282]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:30:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:25 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2982691965' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:30:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:25 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:30:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:25 smithi110 ceph-mon[35282]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:30:26.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:30:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:26 smithi022 ceph-mon[30634]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:30:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:26 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:30:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:26 smithi022 ceph-mon[30634]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:30:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:26 smithi022 ceph-mon[30634]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:30:26.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:26 smithi022 ceph-mon[30634]: pgmap v287: 97 pgs: 15 creating+peering, 31 unknown, 51 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:26.711 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:26 smithi112 ceph-mon[35032]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:30:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:26 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:30:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:26 smithi112 ceph-mon[35032]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:30:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:26 smithi112 ceph-mon[35032]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:30:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:26 smithi112 ceph-mon[35032]: pgmap v287: 97 pgs: 15 creating+peering, 31 unknown, 51 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:26 smithi110 ceph-mon[35282]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:30:26.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:26 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:30:26.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:26 smithi110 ceph-mon[35282]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:30:26.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:26 smithi110 ceph-mon[35282]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:30:26.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:26 smithi110 ceph-mon[35282]: pgmap v287: 97 pgs: 15 creating+peering, 31 unknown, 51 active+clean; 577 KiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.458+0000 7faf09600640 1 -- 172.21.15.22:0/4007589015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 msgr2=0x7faf04108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.458+0000 7faf09600640 1 --2- 172.21.15.22:0/4007589015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 0x7faf04108a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faef0009900 tx=0x7faef002a410 comp rx=0 tx=0).stop 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 -- 172.21.15.22:0/4007589015 shutdown_connections 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 --2- 172.21.15.22:0/4007589015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04109140 0x7faf04110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 --2- 172.21.15.22:0/4007589015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 0x7faf04108a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 --2- 172.21.15.22:0/4007589015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf04104010 0x7faf041043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 -- 172.21.15.22:0/4007589015 >> 172.21.15.22:0/4007589015 conn(0x7faf040ffa50 msgr2=0x7faf04101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 -- 172.21.15.22:0/4007589015 shutdown_connections 2024-09-15T22:30:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.459+0000 7faf09600640 1 -- 172.21.15.22:0/4007589015 wait complete. 2024-09-15T22:30:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 Processor -- start 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 -- start start 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 0x7faf0419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 0x7faf0419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf04109140 0x7faf0419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf04114160 con 0x7faf041049c0 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faf04113fe0 con 0x7faf04109140 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.460+0000 7faf09600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf041142e0 con 0x7faf04104010 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 0x7faf0419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 0x7faf0419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 0x7faf0419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37922/0 (socket says 172.21.15.22:37922) 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 -- 172.21.15.22:0/3945114264 learned_addr learned my addr 172.21.15.22:0/3945114264 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf03400640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf04109140 0x7faf0419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 -- 172.21.15.22:0/3945114264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf04109140 msgr2=0x7faf0419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf04109140 0x7faf0419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 -- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 msgr2=0x7faf0419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 0x7faf0419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 -- 172.21.15.22:0/3945114264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0419f5f0 con 0x7faf04104010 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.461+0000 7faf02a00640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 0x7faf0419a640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faef400e9f0 tx=0x7faef400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.462+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400cd80 con 0x7faf04104010 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.462+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0419f8e0 con 0x7faf04104010 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.462+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef4010910 con 0x7faf04104010 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.462+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef40188f0 con 0x7faf04104010 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.462+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf041a71c0 con 0x7faf04104010 2024-09-15T22:30:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.463+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf041043f0 con 0x7faf04104010 2024-09-15T22:30:27.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.465+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faef4010ac0 con 0x7faf04104010 2024-09-15T22:30:27.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.466+0000 7faefb400640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faee80a3240 0x7faee80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:27.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.466+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7faef40cff10 con 0x7faf04104010 2024-09-15T22:30:27.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.466+0000 7faf02000640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faee80a3240 0x7faee80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:27.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.467+0000 7faf02000640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faee80a3240 0x7faee80a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faef0009230 tx=0x7faef00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:27.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.468+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faef409c690 con 0x7faf04104010 2024-09-15T22:30:27.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.656+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf0419b9a0 con 0x7faf04104010 2024-09-15T22:30:27.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.658+0000 7faefb400640 1 -- 172.21.15.22:0/3945114264 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22293 (secure 0 0 0) 0x7faef40a0990 con 0x7faf04104010 2024-09-15T22:30:27.660 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:27.660 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":79,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:30:24.572498+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:30:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faee80a3240 msgr2=0x7faee80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faee80a3240 0x7faee80a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faef0009230 tx=0x7faef00058d0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 msgr2=0x7faf0419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 0x7faf0419a640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faef400e9f0 tx=0x7faef400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 shutdown_connections 2024-09-15T22:30:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faee80a3240 0x7faee80a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf04109140 0x7faf0419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf041049c0 0x7faf0419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 --2- 172.21.15.22:0/3945114264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf04104010 0x7faf0419a640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:27.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.660+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 >> 172.21.15.22:0/3945114264 conn(0x7faf040ffa50 msgr2=0x7faf04100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:27.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.661+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 shutdown_connections 2024-09-15T22:30:27.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:27.661+0000 7faf09600640 1 -- 172.21.15.22:0/3945114264 wait complete. 2024-09-15T22:30:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:27 smithi022 ceph-mon[30634]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:30:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:27 smithi022 ceph-mon[30634]: Cluster is now healthy 2024-09-15T22:30:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:27 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] up:active 2024-09-15T22:30:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:27 smithi022 ceph-mon[30634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:27 smithi022 ceph-mon[30634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:27 smithi112 ceph-mon[35032]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:30:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:27 smithi112 ceph-mon[35032]: Cluster is now healthy 2024-09-15T22:30:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:27 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] up:active 2024-09-15T22:30:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:27 smithi112 ceph-mon[35032]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:27 smithi112 ceph-mon[35032]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:27 smithi110 ceph-mon[35282]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:30:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:27 smithi110 ceph-mon[35282]: Cluster is now healthy 2024-09-15T22:30:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:27 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] up:active 2024-09-15T22:30:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:27 smithi110 ceph-mon[35282]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:27 smithi110 ceph-mon[35282]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:28.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:30:28.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:28 smithi022 ceph-mon[30634]: pgmap v288: 97 pgs: 12 creating+peering, 85 active+clean; 578 KiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-09-15T22:30:28.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:28 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3945114264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:28 smithi112 ceph-mon[35032]: pgmap v288: 97 pgs: 12 creating+peering, 85 active+clean; 578 KiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-09-15T22:30:28.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:28 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3945114264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:28 smithi110 ceph-mon[35282]: pgmap v288: 97 pgs: 12 creating+peering, 85 active+clean; 578 KiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-09-15T22:30:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:28 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3945114264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:28.955 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 -- 172.21.15.22:0/625529907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d34103e30 msgr2=0x7f9d34104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 --2- 172.21.15.22:0/625529907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d34103e30 0x7f9d34104210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009900 tx=0x7f9d2402a410 comp rx=0 tx=0).stop 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 -- 172.21.15.22:0/625529907 shutdown_connections 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 --2- 172.21.15.22:0/625529907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d341047e0 0x7f9d34108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 --2- 172.21.15.22:0/625529907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d34108f60 0x7f9d34110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 --2- 172.21.15.22:0/625529907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d34103e30 0x7f9d34104210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 -- 172.21.15.22:0/625529907 >> 172.21.15.22:0/625529907 conn(0x7f9d340ff8d0 msgr2=0x7f9d34101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 -- 172.21.15.22:0/625529907 shutdown_connections 2024-09-15T22:30:29.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.601+0000 7f9d38a00640 1 -- 172.21.15.22:0/625529907 wait complete. 2024-09-15T22:30:29.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 Processor -- start 2024-09-15T22:30:29.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 -- start start 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 0x7f9d3419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d341047e0 0x7f9d3419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d34108f60 0x7f9d3419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d34113fd0 con 0x7f9d34108f60 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9d34113e50 con 0x7f9d341047e0 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.603+0000 7f9d38a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9d34114150 con 0x7f9d34103e30 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 0x7f9d3419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 0x7f9d3419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37938/0 (socket says 172.21.15.22:37938) 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 -- 172.21.15.22:0/2455298715 learned_addr learned my addr 172.21.15.22:0/2455298715 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d33200640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d34108f60 0x7f9d3419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d31e00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d341047e0 0x7f9d3419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:29.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 -- 172.21.15.22:0/2455298715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d341047e0 msgr2=0x7f9d3419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:29.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d341047e0 0x7f9d3419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 -- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d34108f60 msgr2=0x7f9d3419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d34108f60 0x7f9d3419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.604+0000 7f9d32800640 1 -- 172.21.15.22:0/2455298715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3419f440 con 0x7f9d34103e30 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.605+0000 7f9d32800640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 0x7f9d3419a490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d24004770 tx=0x7f9d24003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.605+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2403f070 con 0x7f9d34103e30 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.605+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d24031ca0 con 0x7f9d34103e30 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.605+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3419f6d0 con 0x7f9d34103e30 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.605+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24035030 con 0x7f9d34103e30 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.605+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d341a7010 con 0x7f9d34103e30 2024-09-15T22:30:29.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.607+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d34105310 con 0x7f9d34103e30 2024-09-15T22:30:29.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.608+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9d24042070 con 0x7f9d34103e30 2024-09-15T22:30:29.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.609+0000 7f9d2b400640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9d180a3240 0x7f9d180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:29.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.610+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f9d240efb70 con 0x7f9d34103e30 2024-09-15T22:30:29.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.610+0000 7f9d31e00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9d180a3240 0x7f9d180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:29.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.610+0000 7f9d31e00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9d180a3240 0x7f9d180a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d340ffd60 tx=0x7f9d2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:29.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.614+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d240bc2f0 con 0x7f9d34103e30 2024-09-15T22:30:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.800+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d3410c140 con 0x7f9d34103e30 2024-09-15T22:30:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.802+0000 7f9d2b400640 1 -- 172.21.15.22:0/2455298715 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22293 (secure 0 0 0) 0x7f9d240c05f0 con 0x7f9d34103e30 2024-09-15T22:30:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:29.804 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":79,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:30:24.572498+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:30:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9d180a3240 msgr2=0x7f9d180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9d180a3240 0x7f9d180a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d340ffd60 tx=0x7f9d2000b390 comp rx=0 tx=0).stop 2024-09-15T22:30:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 msgr2=0x7f9d3419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 0x7f9d3419a490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d24004770 tx=0x7f9d24003c10 comp rx=0 tx=0).stop 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 shutdown_connections 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9d180a3240 0x7f9d180a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d34108f60 0x7f9d3419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d341047e0 0x7f9d3419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 --2- 172.21.15.22:0/2455298715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d34103e30 0x7f9d3419a490 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.804+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 >> 172.21.15.22:0/2455298715 conn(0x7f9d340ff8d0 msgr2=0x7f9d34100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.805+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 shutdown_connections 2024-09-15T22:30:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:29.805+0000 7f9d38a00640 1 -- 172.21.15.22:0/2455298715 wait complete. 2024-09-15T22:30:30.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:30:30.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:30 smithi112 ceph-mon[35032]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-15T22:30:30.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:30 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2455298715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:30.936 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:30 smithi110 ceph-mon[35282]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-15T22:30:30.936 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:30 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2455298715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:31.031 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:30 smithi022 ceph-mon[30634]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-15T22:30:31.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:30 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2455298715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:31.205 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:30 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: 2024-09-15T22:30:30.933+0000 7f4c0e6e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:30:31.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 -- 172.21.15.22:0/1046398822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 msgr2=0x7fb02810e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:31.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 --2- 172.21.15.22:0/1046398822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02810e440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb018009930 tx=0x7fb01802a420 comp rx=0 tx=0).stop 2024-09-15T22:30:31.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 -- 172.21.15.22:0/1046398822 shutdown_connections 2024-09-15T22:30:31.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 --2- 172.21.15.22:0/1046398822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108020 0x7fb028108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:31.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 --2- 172.21.15.22:0/1046398822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108980 0x7fb028114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 --2- 172.21.15.22:0/1046398822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02810e440 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 -- 172.21.15.22:0/1046398822 >> 172.21.15.22:0/1046398822 conn(0x7fb028077980 msgr2=0x7fb028079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 -- 172.21.15.22:0/1046398822 shutdown_connections 2024-09-15T22:30:31.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.615+0000 7fb027200640 1 -- 172.21.15.22:0/1046398822 wait complete. 2024-09-15T22:30:31.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.616+0000 7fb027200640 1 Processor -- start 2024-09-15T22:30:31.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 -- start start 2024-09-15T22:30:31.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 0x7fb0281a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:31.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108980 0x7fb0281a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:31.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:31.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0281183b0 con 0x7fb02810e060 2024-09-15T22:30:31.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb028118230 con 0x7fb028108020 2024-09-15T22:30:31.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb027200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb028118530 con 0x7fb028108980 2024-09-15T22:30:31.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb026800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:31.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb025e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 0x7fb0281a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:31.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb025e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 0x7fb0281a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:42076/0 (socket says 172.21.15.22:42076) 2024-09-15T22:30:31.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb026800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02819e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57090/0 (socket says 172.21.15.22:57090) 2024-09-15T22:30:31.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb025e00640 1 -- 172.21.15.22:0/2211879156 learned_addr learned my addr 172.21.15.22:0/2211879156 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:31.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.617+0000 7fb01fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108980 0x7fb0281a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:31.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb026800640 1 -- 172.21.15.22:0/2211879156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108980 msgr2=0x7fb0281a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:31.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb026800640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108980 0x7fb0281a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:31.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb026800640 1 -- 172.21.15.22:0/2211879156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 msgr2=0x7fb0281a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:31.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb026800640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 0x7fb0281a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:31.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb026800640 1 -- 172.21.15.22:0/2211879156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02819ef10 con 0x7fb02810e060 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb01fe00640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108980 0x7fb0281a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb025e00640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 0x7fb0281a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.618+0000 7fb026800640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02819e6a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb020005fd0 tx=0x7fb02000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.619+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02000cd80 con 0x7fb02810e060 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.619+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb020005020 con 0x7fb02810e060 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.619+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02819f200 con 0x7fb02810e060 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.619+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020010720 con 0x7fb02810e060 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.619+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0281ab380 con 0x7fb02810e060 2024-09-15T22:30:31.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.620+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb028109710 con 0x7fb02810e060 2024-09-15T22:30:31.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.622+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb0200051d0 con 0x7fb02810e060 2024-09-15T22:30:31.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.623+0000 7fb01ea00640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb00c0a3240 0x7fb00c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:31.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.623+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fb0200cfe70 con 0x7fb02810e060 2024-09-15T22:30:31.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.623+0000 7fb025e00640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb00c0a3240 0x7fb00c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:31.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.624+0000 7fb025e00640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb00c0a3240 0x7fb00c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb018000c00 tx=0x7fb018031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.627+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb02009ccd0 con 0x7fb02810e060 2024-09-15T22:30:31.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:31.848+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb02810ff60 con 0x7fb02810e060 2024-09-15T22:30:32.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.607+0000 7fb01ea00640 1 -- 172.21.15.22:0/2211879156 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fb02009c5d0 con 0x7fb02810e060 2024-09-15T22:30:32.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb00c0a3240 msgr2=0x7fb00c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:32.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb00c0a3240 0x7fb00c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb018000c00 tx=0x7fb018031510 comp rx=0 tx=0).stop 2024-09-15T22:30:32.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 msgr2=0x7fb02819e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:32.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02819e6a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb020005fd0 tx=0x7fb02000ee60 comp rx=0 tx=0).stop 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 shutdown_connections 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb028108980 0x7fb0281a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb00c0a3240 0x7fb00c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb02810e060 0x7fb02819e6a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 --2- 172.21.15.22:0/2211879156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb028108020 0x7fb0281a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 >> 172.21.15.22:0/2211879156 conn(0x7fb028077980 msgr2=0x7fb0280791f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.610+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 shutdown_connections 2024-09-15T22:30:32.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:32.611+0000 7fb027200640 1 -- 172.21.15.22:0/2211879156 wait complete. 2024-09-15T22:30:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:32 smithi110 ceph-mon[35282]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:30:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:32 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2211879156' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:30:32.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:32 smithi022 ceph-mon[30634]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:30:32.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:32 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2211879156' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:30:33.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:32 smithi112 ceph-mon[35032]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:30:33.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:32 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2211879156' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:30:33.467 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-15T22:30:33.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-15T22:30:33.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:33 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2211879156' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:30:33.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:33 smithi022 ceph-mon[30634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:33 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2211879156' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:30:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:33 smithi110 ceph-mon[35282]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:34.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:33 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2211879156' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:30:34.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:33 smithi112 ceph-mon[35032]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:34.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 -- 172.21.15.22:0/3045823328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa901049c0 msgr2=0x7faa90108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:34.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 --2- 172.21.15.22:0/3045823328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa901049c0 0x7faa90108a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa78009900 tx=0x7faa7802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:30:34.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 -- 172.21.15.22:0/3045823328 shutdown_connections 2024-09-15T22:30:34.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 --2- 172.21.15.22:0/3045823328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa90109140 0x7faa90110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:34.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 --2- 172.21.15.22:0/3045823328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa901049c0 0x7faa90108a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:34.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 --2- 172.21.15.22:0/3045823328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa90104010 0x7faa901043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:34.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 -- 172.21.15.22:0/3045823328 >> 172.21.15.22:0/3045823328 conn(0x7faa900ffa50 msgr2=0x7faa90101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:34.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 -- 172.21.15.22:0/3045823328 shutdown_connections 2024-09-15T22:30:34.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.451+0000 7faa95a00640 1 -- 172.21.15.22:0/3045823328 wait complete. 2024-09-15T22:30:34.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.452+0000 7faa95a00640 1 Processor -- start 2024-09-15T22:30:34.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.452+0000 7faa95a00640 1 -- start start 2024-09-15T22:30:34.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.452+0000 7faa95a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 0x7faa9019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:34.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa95a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa901049c0 0x7faa9019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:34.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa95a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa90109140 0x7faa9019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:34.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa95a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa90114160 con 0x7faa90104010 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa95a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa90113fe0 con 0x7faa901049c0 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa95a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa901142e0 con 0x7faa90109140 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 0x7faa9019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 0x7faa9019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57110/0 (socket says 172.21.15.22:57110) 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 -- 172.21.15.22:0/1173675293 learned_addr learned my addr 172.21.15.22:0/1173675293 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8f400640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa90109140 0x7faa9019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa86000640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa901049c0 0x7faa9019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 -- 172.21.15.22:0/1173675293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa90109140 msgr2=0x7faa9019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa90109140 0x7faa9019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 -- 172.21.15.22:0/1173675293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa901049c0 msgr2=0x7faa9019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa901049c0 0x7faa9019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:34.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.453+0000 7faa8ea00640 1 -- 172.21.15.22:0/1173675293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9019f610 con 0x7faa90104010 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.454+0000 7faa8ea00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 0x7faa9019a660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e9f0 tx=0x7faa8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.454+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000cd80 con 0x7faa90104010 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.454+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa80005500 con 0x7faa90104010 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.454+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9019f900 con 0x7faa90104010 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.454+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80010690 con 0x7faa90104010 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.454+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa901a71e0 con 0x7faa90104010 2024-09-15T22:30:34.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.455+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa901043f0 con 0x7faa90104010 2024-09-15T22:30:34.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.457+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faa800046c0 con 0x7faa90104010 2024-09-15T22:30:34.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.458+0000 7faa87e00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa740a3240 0x7faa740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:34.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.458+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7faa800cfc40 con 0x7faa90104010 2024-09-15T22:30:34.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.459+0000 7faa86000640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa740a3240 0x7faa740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:34.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.459+0000 7faa86000640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa740a3240 0x7faa740a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa78009230 tx=0x7faa780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:34.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.463+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa8009ca10 con 0x7faa90104010 2024-09-15T22:30:34.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:34.691+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7faa9010c380 con 0x7faa90104010 2024-09-15T22:30:34.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:34 smithi112 ceph-mon[35032]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-15T22:30:34.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:34 smithi110 ceph-mon[35282]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-15T22:30:35.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:34 smithi022 ceph-mon[30634]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-15T22:30:35.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.621+0000 7faa87e00640 1 -- 172.21.15.22:0/1173675293 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7faa8009c310 con 0x7faa90104010 2024-09-15T22:30:35.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.624+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa740a3240 msgr2=0x7faa740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:35.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.624+0000 7faa95a00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa740a3240 0x7faa740a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa78009230 tx=0x7faa780058d0 comp rx=0 tx=0).stop 2024-09-15T22:30:35.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.624+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 msgr2=0x7faa9019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:35.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.624+0000 7faa95a00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 0x7faa9019a660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e9f0 tx=0x7faa8000edf0 comp rx=0 tx=0).stop 2024-09-15T22:30:35.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 shutdown_connections 2024-09-15T22:30:35.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa90109140 0x7faa9019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:35.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faa740a3240 0x7faa740a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:35.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa901049c0 0x7faa9019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:35.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 --2- 172.21.15.22:0/1173675293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa90104010 0x7faa9019a660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:35.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 >> 172.21.15.22:0/1173675293 conn(0x7faa900ffa50 msgr2=0x7faa90100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:35.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 shutdown_connections 2024-09-15T22:30:35.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:35.625+0000 7faa95a00640 1 -- 172.21.15.22:0/1173675293 wait complete. 2024-09-15T22:30:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:35 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1173675293' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:30:35.974 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:35 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1173675293' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:30:36.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:35 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1173675293' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-15T22:30:36.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T22:30:36.744 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1173675293' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-15T22:30:36.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:36 smithi022 ceph-mon[30634]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-15T22:30:36.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-15T22:30:36.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:30:36.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1173675293' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-15T22:30:36.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:30:36.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:36.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-15T22:30:36.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:36 smithi110 ceph-mon[35282]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1173675293' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-15T22:30:37.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:36 smithi112 ceph-mon[35032]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-15T22:30:37.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 -- 172.21.15.22:0/2370834551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20102360 msgr2=0x7f1d2010e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:37.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 --2- 172.21.15.22:0/2370834551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20102360 0x7f1d2010e890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009930 tx=0x7f1d1802a420 comp rx=0 tx=0).stop 2024-09-15T22:30:37.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 -- 172.21.15.22:0/2370834551 shutdown_connections 2024-09-15T22:30:37.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 --2- 172.21.15.22:0/2370834551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20102360 0x7f1d2010e890 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 --2- 172.21.15.22:0/2370834551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d201019c0 0x7f1d20101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 --2- 172.21.15.22:0/2370834551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d201079c0 0x7f1d20107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 -- 172.21.15.22:0/2370834551 >> 172.21.15.22:0/2370834551 conn(0x7f1d200fd740 msgr2=0x7f1d200ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:37.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 -- 172.21.15.22:0/2370834551 shutdown_connections 2024-09-15T22:30:37.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.391+0000 7f1d25c00640 1 -- 172.21.15.22:0/2370834551 wait complete. 2024-09-15T22:30:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.392+0000 7f1d25c00640 1 Processor -- start 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.392+0000 7f1d25c00640 1 -- start start 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 0x7f1d2019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d20102360 0x7f1d2019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d201079c0 0x7f1d2019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1d20111e10 con 0x7f1d201019c0 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d20111c90 con 0x7f1d20102360 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1d20111f90 con 0x7f1d201079c0 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 0x7f1d2019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 0x7f1d2019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57118/0 (socket says 172.21.15.22:57118) 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 -- 172.21.15.22:0/3103955914 learned_addr learned my addr 172.21.15.22:0/3103955914 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d17400640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d20102360 0x7f1d2019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d25200640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d201079c0 0x7f1d2019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 -- 172.21.15.22:0/3103955914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d201079c0 msgr2=0x7f1d2019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d201079c0 0x7f1d2019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 -- 172.21.15.22:0/3103955914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d20102360 msgr2=0x7f1d2019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d20102360 0x7f1d2019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.393+0000 7f1d1fe00640 1 -- 172.21.15.22:0/3103955914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2019f450 con 0x7f1d201019c0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.394+0000 7f1d1fe00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 0x7f1d2019a4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000eb90 tx=0x7f1d1000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.394+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004d20 con 0x7f1d201019c0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.394+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d1000ee90 con 0x7f1d201019c0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.394+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2019f740 con 0x7f1d201019c0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.394+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10010830 con 0x7f1d201019c0 2024-09-15T22:30:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.394+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d201a7020 con 0x7f1d201019c0 2024-09-15T22:30:37.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.395+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d20101e20 con 0x7f1d201019c0 2024-09-15T22:30:37.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.397+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d10005020 con 0x7f1d201019c0 2024-09-15T22:30:37.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.399+0000 7f1d1d600640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1d040a3240 0x7f1d040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:37.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.399+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f1d100cfe20 con 0x7f1d201019c0 2024-09-15T22:30:37.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.399+0000 7f1d17400640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1d040a3240 0x7f1d040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:37.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.400+0000 7f1d17400640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1d040a3240 0x7f1d040a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d2010ed20 tx=0x7f1d08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:37.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.404+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d1009cbf0 con 0x7f1d201019c0 2024-09-15T22:30:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.626+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f1d201a7380 con 0x7f1d201019c0 2024-09-15T22:30:37.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.638+0000 7f1d1d600640 1 -- 172.21.15.22:0/3103955914 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f1d1009c4f0 con 0x7f1d201019c0 2024-09-15T22:30:37.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1d040a3240 msgr2=0x7f1d040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:37.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1d040a3240 0x7f1d040a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d2010ed20 tx=0x7f1d08005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:37.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 msgr2=0x7f1d2019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:37.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 0x7f1d2019a4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000eb90 tx=0x7f1d1000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 shutdown_connections 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d201079c0 0x7f1d2019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1d040a3240 0x7f1d040a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d20102360 0x7f1d2019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 --2- 172.21.15.22:0/3103955914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d201019c0 0x7f1d2019a4a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 >> 172.21.15.22:0/3103955914 conn(0x7f1d200fd740 msgr2=0x7f1d200fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 shutdown_connections 2024-09-15T22:30:37.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:37.641+0000 7f1d25c00640 1 -- 172.21.15.22:0/3103955914 wait complete. 2024-09-15T22:30:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] up:active 2024-09-15T22:30:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:30:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:30:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: Cluster is now healthy 2024-09-15T22:30:37.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-15T22:30:37.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-09-15T22:30:37.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-15T22:30:37.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:37 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3103955914' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:30:38.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] up:active 2024-09-15T22:30:38.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:30:38.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:30:38.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: Cluster is now healthy 2024-09-15T22:30:38.015 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-15T22:30:38.015 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-09-15T22:30:38.015 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-15T22:30:38.015 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:37 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3103955914' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:30:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] up:active 2024-09-15T22:30:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:30:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:30:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: Cluster is now healthy 2024-09-15T22:30:38.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-15T22:30:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-09-15T22:30:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-15T22:30:38.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:37 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3103955914' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:30:38.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T22:30:38.809 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:38.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:38 smithi022 ceph-mon[30634]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:30:38.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:38 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3103955914' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:30:38.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:38 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] up:active 2024-09-15T22:30:38.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:38 smithi022 ceph-mon[30634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-09-15T22:30:38.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:38 smithi022 ceph-mon[30634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:30:38.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:38 smithi110 ceph-mon[35282]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:30:38.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:38 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3103955914' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:30:38.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:38 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] up:active 2024-09-15T22:30:38.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:38 smithi110 ceph-mon[35282]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-09-15T22:30:38.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:38 smithi110 ceph-mon[35282]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:30:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:38 smithi112 ceph-mon[35032]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:30:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:38 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3103955914' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:30:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:38 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] up:active 2024-09-15T22:30:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:38 smithi112 ceph-mon[35032]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-09-15T22:30:39.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:38 smithi112 ceph-mon[35032]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 -- 172.21.15.22:0/140094462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4103e30 msgr2=0x7f6af4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 --2- 172.21.15.22:0/140094462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4103e30 0x7f6af4104210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009860 tx=0x7f6ae802a340 comp rx=0 tx=0).stop 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 -- 172.21.15.22:0/140094462 shutdown_connections 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 --2- 172.21.15.22:0/140094462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4108f60 0x7f6af4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 --2- 172.21.15.22:0/140094462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 0x7f6af4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 --2- 172.21.15.22:0/140094462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4103e30 0x7f6af4104210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 -- 172.21.15.22:0/140094462 >> 172.21.15.22:0/140094462 conn(0x7f6af40ff8d0 msgr2=0x7f6af4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 -- 172.21.15.22:0/140094462 shutdown_connections 2024-09-15T22:30:39.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.408+0000 7f6afa800640 1 -- 172.21.15.22:0/140094462 wait complete. 2024-09-15T22:30:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 Processor -- start 2024-09-15T22:30:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 -- start start 2024-09-15T22:30:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 0x7f6af419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 0x7f6af419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4108f60 0x7f6af419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:39.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6af4113fc0 con 0x7f6af4103e30 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6af4113e40 con 0x7f6af41047e0 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.409+0000 7f6afa800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6af4114140 con 0x7f6af4108f60 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 0x7f6af419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 0x7f6af419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57140/0 (socket says 172.21.15.22:57140) 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 -- 172.21.15.22:0/2881159674 learned_addr learned my addr 172.21.15.22:0/2881159674 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af8a00640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 0x7f6af419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9e00640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4108f60 0x7f6af419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 -- 172.21.15.22:0/2881159674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4108f60 msgr2=0x7f6af419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4108f60 0x7f6af419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 -- 172.21.15.22:0/2881159674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 msgr2=0x7f6af419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 0x7f6af419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 -- 172.21.15.22:0/2881159674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af419f460 con 0x7f6af4103e30 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af8a00640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 0x7f6af419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:39.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.410+0000 7f6af9400640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 0x7f6af419a4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8035040 tx=0x7f6ae8033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.411+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8037040 con 0x7f6af4103e30 2024-09-15T22:30:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.411+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae8040070 con 0x7f6af4103e30 2024-09-15T22:30:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.411+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af419f6f0 con 0x7f6af4103e30 2024-09-15T22:30:39.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.411+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80039b0 con 0x7f6af4103e30 2024-09-15T22:30:39.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.411+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af41a7030 con 0x7f6af4103e30 2024-09-15T22:30:39.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.412+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af4105310 con 0x7f6af4103e30 2024-09-15T22:30:39.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.414+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6ae80305e0 con 0x7f6af4103e30 2024-09-15T22:30:39.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.415+0000 7f6af2000640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6adc0a3240 0x7f6adc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:39.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.415+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f6ae80ef820 con 0x7f6af4103e30 2024-09-15T22:30:39.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.416+0000 7f6af8a00640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6adc0a3240 0x7f6adc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:39.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.416+0000 7f6af8a00640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6adc0a3240 0x7f6adc0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6af40ffd60 tx=0x7f6ae0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:39.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.419+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ae80bc5f0 con 0x7f6af4103e30 2024-09-15T22:30:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:39.646+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f6af410c140 con 0x7f6af4103e30 2024-09-15T22:30:40.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.649+0000 7f6af2000640 1 -- 172.21.15.22:0/2881159674 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f6ae80bbef0 con 0x7f6af4103e30 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6adc0a3240 msgr2=0x7f6adc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6adc0a3240 0x7f6adc0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6af40ffd60 tx=0x7f6ae0005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 msgr2=0x7f6af419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 0x7f6af419a4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8035040 tx=0x7f6ae8033b60 comp rx=0 tx=0).stop 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 shutdown_connections 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6af4108f60 0x7f6af419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6adc0a3240 0x7f6adc0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6af41047e0 0x7f6af419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 --2- 172.21.15.22:0/2881159674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6af4103e30 0x7f6af419a4b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:40.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 >> 172.21.15.22:0/2881159674 conn(0x7f6af40ff8d0 msgr2=0x7f6af4100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:40.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 shutdown_connections 2024-09-15T22:30:40.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:40.652+0000 7f6afa800640 1 -- 172.21.15.22:0/2881159674 wait complete. 2024-09-15T22:30:40.935 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:40 smithi110 ceph-mon[35282]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-15T22:30:40.936 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:40 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2881159674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:30:41.022 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:40 smithi022 ceph-mon[30634]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-15T22:30:41.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:40 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2881159674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:30:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:40 smithi112 ceph-mon[35032]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-15T22:30:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:40 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2881159674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:30:41.205 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: 2024-09-15T22:30:40.933+0000 7f4c0e6e5640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-15T22:30:41.205 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:30:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: 2024-09-15T22:30:40.933+0000 7f4c0e6e5640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-15T22:30:41.526 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-15T22:30:41.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T22:30:41.911 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:41 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2881159674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:30:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:41 smithi110 ceph-mon[35282]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:30:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:41 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2881159674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:30:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:41 smithi022 ceph-mon[30634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:30:42.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:41 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2881159674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:30:42.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:41 smithi112 ceph-mon[35032]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 -- 172.21.15.22:0/4247484521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 msgr2=0x7f9ecc114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4247484521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 0x7f9ecc114e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009ca0 tx=0x7f9ec402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 -- 172.21.15.22:0/4247484521 shutdown_connections 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4247484521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc077040 0x7f9ecc1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4247484521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 0x7f9ecc114e20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4247484521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ecc076720 0x7f9ecc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.416+0000 7f9ed3800640 1 -- 172.21.15.22:0/4247484521 >> 172.21.15.22:0/4247484521 conn(0x7f9ecc0ffa90 msgr2=0x7f9ecc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.417+0000 7f9ed3800640 1 -- 172.21.15.22:0/4247484521 shutdown_connections 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.417+0000 7f9ed3800640 1 -- 172.21.15.22:0/4247484521 wait complete. 2024-09-15T22:30:42.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.417+0000 7f9ed3800640 1 Processor -- start 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 -- start start 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 0x7f9ecc1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ecc077040 0x7f9ecc1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 0x7f9ecc19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1185e0 con 0x7f9ecc112a30 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc118460 con 0x7f9ecc077040 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed3800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc118760 con 0x7f9ecc076720 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed1800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 0x7f9ecc19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 0x7f9ecc1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 0x7f9ecc1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:56656/0 (socket says 172.21.15.22:56656) 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ed0e00640 1 -- 172.21.15.22:0/4120884164 learned_addr learned my addr 172.21.15.22:0/4120884164 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.418+0000 7f9ecbe00640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ecc077040 0x7f9ecc1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed0e00640 1 -- 172.21.15.22:0/4120884164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ecc077040 msgr2=0x7f9ecc1a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed0e00640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ecc077040 0x7f9ecc1a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed0e00640 1 -- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 msgr2=0x7f9ecc19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed0e00640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 0x7f9ecc19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed0e00640 1 -- 172.21.15.22:0/4120884164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc19f040 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed0e00640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 0x7f9ecc1a4750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000e9f0 tx=0x7f9ec000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000cd80 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc19f330 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec0010910 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.419+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec00188f0 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.420+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc1ab620 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.421+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ecc076b00 con 0x7f9ecc076720 2024-09-15T22:30:42.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.423+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9ec0010ac0 con 0x7f9ecc076720 2024-09-15T22:30:42.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.424+0000 7f9ec9600640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a3240 0x7f9eb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:42.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.424+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f9ec00cff40 con 0x7f9ecc076720 2024-09-15T22:30:42.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.424+0000 7f9ecbe00640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a3240 0x7f9eb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:42.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.425+0000 7f9ecbe00640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a3240 0x7f9eb40a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0796d0 tx=0x7f9eb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:42.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.426+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ec009c6c0 con 0x7f9ecc076720 2024-09-15T22:30:42.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.677+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9ecc062630 con 0x7f9eb40a3240 2024-09-15T22:30:42.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.704+0000 7f9ec9600640 1 -- 172.21.15.22:0/4120884164 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ecc062630 con 0x7f9eb40a3240 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a3240 msgr2=0x7f9eb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a3240 0x7f9eb40a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0796d0 tx=0x7f9eb8005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 msgr2=0x7f9ecc1a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 0x7f9ecc1a4750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000e9f0 tx=0x7f9ec000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 shutdown_connections 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a3240 0x7f9eb40a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc112a30 0x7f9ecc19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ecc077040 0x7f9ecc1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 --2- 172.21.15.22:0/4120884164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ecc076720 0x7f9ecc1a4750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 >> 172.21.15.22:0/4120884164 conn(0x7f9ecc0ffa90 msgr2=0x7f9ecc113630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 shutdown_connections 2024-09-15T22:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:42.707+0000 7f9ed3800640 1 -- 172.21.15.22:0/4120884164 wait complete. 2024-09-15T22:30:42.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:42 smithi110 ceph-mon[35282]: pgmap v295: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-15T22:30:43.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:42 smithi022 ceph-mon[30634]: pgmap v295: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-15T22:30:43.032 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:30:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:30:42.683+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:30:43.033 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:30:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:30:42.683+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:30:43.033 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:30:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:30:42.683+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:30:43.033 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:30:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:30:42.683+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:30:43.033 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:30:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:30:42.683+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:30:43.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:42 smithi112 ceph-mon[35032]: pgmap v295: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-15T22:30:43.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T22:30:43.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:43 smithi022 ceph-mon[30634]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:43.902 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:43 smithi110 ceph-mon[35282]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:44.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:43 smithi112 ceph-mon[35032]: from='client.24634 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 -- 172.21.15.22:0/3731634218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8077040 msgr2=0x7f66d8112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 --2- 172.21.15.22:0/3731634218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8077040 0x7f66d8112330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009900 tx=0x7f66c802a410 comp rx=0 tx=0).stop 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 -- 172.21.15.22:0/3731634218 shutdown_connections 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 --2- 172.21.15.22:0/3731634218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66d8112870 0x7f66d8114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 --2- 172.21.15.22:0/3731634218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8077040 0x7f66d8112330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 --2- 172.21.15.22:0/3731634218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8076720 0x7f66d8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 -- 172.21.15.22:0/3731634218 >> 172.21.15.22:0/3731634218 conn(0x7f66d80ff8d0 msgr2=0x7f66d8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 -- 172.21.15.22:0/3731634218 shutdown_connections 2024-09-15T22:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.527+0000 7f66df200640 1 -- 172.21.15.22:0/3731634218 wait complete. 2024-09-15T22:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.528+0000 7f66df200640 1 Processor -- start 2024-09-15T22:30:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.528+0000 7f66df200640 1 -- start start 2024-09-15T22:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66df200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8076720 0x7f66d81a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66df200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66d8077040 0x7f66d81a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66df200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8112870 0x7f66d819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66df200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f66d8118430 con 0x7f66d8076720 2024-09-15T22:30:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66df200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66d81182b0 con 0x7f66d8112870 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66df200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66d81185b0 con 0x7f66d8077040 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66dde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8076720 0x7f66d81a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66dde00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8076720 0x7f66d81a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45430/0 (socket says 172.21.15.22:45430) 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66dde00640 1 -- 172.21.15.22:0/3400496499 learned_addr learned my addr 172.21.15.22:0/3400496499 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66de800640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8112870 0x7f66d819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66dd400640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66d8077040 0x7f66d81a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66de800640 1 -- 172.21.15.22:0/3400496499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66d8077040 msgr2=0x7f66d81a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66de800640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66d8077040 0x7f66d81a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66de800640 1 -- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8076720 msgr2=0x7f66d81a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66de800640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8076720 0x7f66d81a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.529+0000 7f66de800640 1 -- 172.21.15.22:0/3400496499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d819efb0 con 0x7f66d8112870 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.530+0000 7f66de800640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8112870 0x7f66d819e740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66d807aa10 tx=0x7f66d400dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.530+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d400bd40 con 0x7f66d8112870 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.530+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d819f2a0 con 0x7f66d8112870 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.530+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66d4003e50 con 0x7f66d8112870 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.530+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d40106c0 con 0x7f66d8112870 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.530+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d81ab420 con 0x7f66d8112870 2024-09-15T22:30:44.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.531+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d8077e60 con 0x7f66d8112870 2024-09-15T22:30:44.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.533+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f66d4004b40 con 0x7f66d8112870 2024-09-15T22:30:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.534+0000 7f66d2a00640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c00a32d0 0x7f66c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.535+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f66d40cfc50 con 0x7f66d8112870 2024-09-15T22:30:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.535+0000 7f66dde00640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c00a32d0 0x7f66c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.535+0000 7f66dde00640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c00a32d0 0x7f66c00a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66cc005fd0 tx=0x7f66cc00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.537+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66d409c8c0 con 0x7f66d8112870 2024-09-15T22:30:44.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.750+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f66d8062630 con 0x7f66c00a32d0 2024-09-15T22:30:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.777+0000 7f66d2a00640 1 -- 172.21.15.22:0/3400496499 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f66d8062630 con 0x7f66c00a32d0 2024-09-15T22:30:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c00a32d0 msgr2=0x7f66c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c00a32d0 0x7f66c00a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66cc005fd0 tx=0x7f66cc00b480 comp rx=0 tx=0).stop 2024-09-15T22:30:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8112870 msgr2=0x7f66d819e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8112870 0x7f66d819e740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66d807aa10 tx=0x7f66d400dea0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 shutdown_connections 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66d8077040 0x7f66d81a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c00a32d0 0x7f66c00a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d8112870 0x7f66d819e740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 --2- 172.21.15.22:0/3400496499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66d8076720 0x7f66d81a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.779+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 >> 172.21.15.22:0/3400496499 conn(0x7f66d80ff8d0 msgr2=0x7f66d8101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.780+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 shutdown_connections 2024-09-15T22:30:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:44.780+0000 7f66df200640 1 -- 172.21.15.22:0/3400496499 wait complete. 2024-09-15T22:30:44.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:44 smithi110 ceph-mon[35282]: pgmap v296: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-15T22:30:44.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:44 smithi110 ceph-mon[35282]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:30:45.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:44 smithi022 ceph-mon[30634]: pgmap v296: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-15T22:30:45.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:44 smithi022 ceph-mon[30634]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:30:45.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:44 smithi112 ceph-mon[35032]: pgmap v296: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-15T22:30:45.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:44 smithi112 ceph-mon[35032]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:30:45.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T22:30:45.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:45 smithi110 ceph-mon[35282]: from='client.24638 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:46.018 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:46.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:45 smithi022 ceph-mon[30634]: from='client.24638 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:46.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:45 smithi112 ceph-mon[35032]: from='client.24638 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 -- 172.21.15.22:0/1315160156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 msgr2=0x7fcf24112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 --2- 172.21.15.22:0/1315160156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf24112650 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009900 tx=0x7fcf0c02a480 comp rx=0 tx=0).stop 2024-09-15T22:30:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 -- 172.21.15.22:0/1315160156 shutdown_connections 2024-09-15T22:30:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 --2- 172.21.15.22:0/1315160156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 0x7fcf24114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 --2- 172.21.15.22:0/1315160156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf24112650 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 --2- 172.21.15.22:0/1315160156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 0x7fcf24074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 -- 172.21.15.22:0/1315160156 >> 172.21.15.22:0/1315160156 conn(0x7fcf240fd8c0 msgr2=0x7fcf240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 -- 172.21.15.22:0/1315160156 shutdown_connections 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.583+0000 7fcf28c00640 1 -- 172.21.15.22:0/1315160156 wait complete. 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 Processor -- start 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 -- start start 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 0x7fcf241a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf241a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 0x7fcf2419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24118540 con 0x7fcf24074eb0 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcf241183c0 con 0x7fcf24074590 2024-09-15T22:30:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.584+0000 7fcf28c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf241186c0 con 0x7fcf24112b90 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf241a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf241a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45444/0 (socket says 172.21.15.22:45444) 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf22800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 0x7fcf2419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 -- 172.21.15.22:0/2315782653 learned_addr learned my addr 172.21.15.22:0/2315782653 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf21e00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 0x7fcf241a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 -- 172.21.15.22:0/2315782653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 msgr2=0x7fcf2419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 0x7fcf2419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 -- 172.21.15.22:0/2315782653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 msgr2=0x7fcf241a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 0x7fcf241a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 -- 172.21.15.22:0/2315782653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2419f010 con 0x7fcf24074eb0 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf22800640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 0x7fcf2419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf21e00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 0x7fcf241a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:46.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.585+0000 7fcf19400640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf241a4c60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c006010 tx=0x7fcf0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.586+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c03f030 con 0x7fcf24074eb0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.586+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf0c003ce0 con 0x7fcf24074eb0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.586+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2419f2a0 con 0x7fcf24074eb0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.586+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c035070 con 0x7fcf24074eb0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.586+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf241ab5f0 con 0x7fcf24074eb0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.587+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf24074970 con 0x7fcf24074eb0 2024-09-15T22:30:46.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.589+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcf0c042030 con 0x7fcf24074eb0 2024-09-15T22:30:46.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.591+0000 7fcf1b400640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcf080a32d0 0x7fcf080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:46.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.591+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fcf0c0eff20 con 0x7fcf24074eb0 2024-09-15T22:30:46.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.591+0000 7fcf21e00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcf080a32d0 0x7fcf080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:46.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.592+0000 7fcf21e00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcf080a32d0 0x7fcf080a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf2419fa20 tx=0x7fcf14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:46.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.595+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf0c0bc600 con 0x7fcf24074eb0 2024-09-15T22:30:46.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:46 smithi022 ceph-mon[30634]: pgmap v297: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-15T22:30:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.807+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fcf24105000 con 0x7fcf080a32d0 2024-09-15T22:30:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.812+0000 7fcf1b400640 1 -- 172.21.15.22:0/2315782653 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fcf24105000 con 0x7fcf080a32d0 2024-09-15T22:30:46.814 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_0/49315f70-9ceb-455a-b951-f662e7d42483 2024-09-15T22:30:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcf080a32d0 msgr2=0x7fcf080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcf080a32d0 0x7fcf080a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf2419fa20 tx=0x7fcf14005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 msgr2=0x7fcf241a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf241a4c60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c006010 tx=0x7fcf0c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 shutdown_connections 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24112b90 0x7fcf2419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcf080a32d0 0x7fcf080a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf24074eb0 0x7fcf241a4c60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 --2- 172.21.15.22:0/2315782653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf24074590 0x7fcf241a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 >> 172.21.15.22:0/2315782653 conn(0x7fcf240fd8c0 msgr2=0x7fcf240ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 shutdown_connections 2024-09-15T22:30:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:46.815+0000 7fcf28c00640 1 -- 172.21.15.22:0/2315782653 wait complete. 2024-09-15T22:30:46.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:46 smithi110 ceph-mon[35282]: pgmap v297: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-15T22:30:47.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:46 smithi112 ceph-mon[35032]: pgmap v297: 97 pgs: 97 active+clean; 582 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-15T22:30:47.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T22:30:47.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:47 smithi110 ceph-mon[35282]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:47.993 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:48.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:47 smithi022 ceph-mon[30634]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:48.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:47 smithi112 ceph-mon[35032]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.582+0000 7efccce00640 1 -- 172.21.15.22:0/3377448816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 msgr2=0x7efcc81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.582+0000 7efccce00640 1 --2- 172.21.15.22:0/3377448816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc81043d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009900 tx=0x7efcb802a410 comp rx=0 tx=0).stop 2024-09-15T22:30:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 -- 172.21.15.22:0/3377448816 shutdown_connections 2024-09-15T22:30:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 --2- 172.21.15.22:0/3377448816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcc8109120 0x7efcc8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 --2- 172.21.15.22:0/3377448816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcc81049a0 0x7efcc81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 --2- 172.21.15.22:0/3377448816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc81043d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 -- 172.21.15.22:0/3377448816 >> 172.21.15.22:0/3377448816 conn(0x7efcc80ffa90 msgr2=0x7efcc8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 -- 172.21.15.22:0/3377448816 shutdown_connections 2024-09-15T22:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.583+0000 7efccce00640 1 -- 172.21.15.22:0/3377448816 wait complete. 2024-09-15T22:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 Processor -- start 2024-09-15T22:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 -- start start 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc8076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcc81049a0 0x7efcc8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcc8109120 0x7efcc8077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efcc81141a0 con 0x7efcc8103ff0 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8114020 con 0x7efcc81049a0 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efccce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8114320 con 0x7efcc8109120 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efcc5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc8076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efcc5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc8076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45460/0 (socket says 172.21.15.22:45460) 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efcc5e00640 1 -- 172.21.15.22:0/3744459078 learned_addr learned my addr 172.21.15.22:0/3744459078 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efcbd400640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcc81049a0 0x7efcc8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.584+0000 7efcc6800640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcc8109120 0x7efcc8077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcc5e00640 1 -- 172.21.15.22:0/3744459078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcc8109120 msgr2=0x7efcc8077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcc5e00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcc8109120 0x7efcc8077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcc5e00640 1 -- 172.21.15.22:0/3744459078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcc81049a0 msgr2=0x7efcc8076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcc5e00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcc81049a0 0x7efcc8076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcc5e00640 1 -- 172.21.15.22:0/3744459078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81aacc0 con 0x7efcc8103ff0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcc5e00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc8076700 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcb802aa00 tx=0x7efcb8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.585+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb803f070 con 0x7efcc8103ff0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.586+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcb8031c90 con 0x7efcc8103ff0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.586+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81aaf50 con 0x7efcc8103ff0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.586+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8035030 con 0x7efcc8103ff0 2024-09-15T22:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.586+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc81ab400 con 0x7efcc8103ff0 2024-09-15T22:30:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.587+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc81054d0 con 0x7efcc8103ff0 2024-09-15T22:30:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.589+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efcb8042070 con 0x7efcc8103ff0 2024-09-15T22:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.590+0000 7efcbf400640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efcac0a3350 0x7efcac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.590+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7efcb80f0460 con 0x7efcc8103ff0 2024-09-15T22:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.590+0000 7efcbd400640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efcac0a3350 0x7efcac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.591+0000 7efcbd400640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efcac0a3350 0x7efcac0a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efcc8077ec0 tx=0x7efcb000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:48.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.592+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcb80bcb80 con 0x7efcc8103ff0 2024-09-15T22:30:48.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:48 smithi022 ceph-mon[30634]: pgmap v298: 97 pgs: 97 active+clean; 607 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-15T22:30:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.804+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efcc8062630 con 0x7efcac0a3350 2024-09-15T22:30:48.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.829+0000 7efcbf400640 1 -- 172.21.15.22:0/3744459078 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efcc8062630 con 0x7efcac0a3350 2024-09-15T22:30:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efcac0a3350 msgr2=0x7efcac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efcac0a3350 0x7efcac0a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efcc8077ec0 tx=0x7efcb000b410 comp rx=0 tx=0).stop 2024-09-15T22:30:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 msgr2=0x7efcc8076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc8076700 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcb802aa00 tx=0x7efcb8003c10 comp rx=0 tx=0).stop 2024-09-15T22:30:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 shutdown_connections 2024-09-15T22:30:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcc8109120 0x7efcc8077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efcac0a3350 0x7efcac0a5810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcc81049a0 0x7efcc8076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 --2- 172.21.15.22:0/3744459078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcc8103ff0 0x7efcc8076700 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:48.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 >> 172.21.15.22:0/3744459078 conn(0x7efcc80ffa90 msgr2=0x7efcc8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:48.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 shutdown_connections 2024-09-15T22:30:48.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:48.831+0000 7efccce00640 1 -- 172.21.15.22:0/3744459078 wait complete. 2024-09-15T22:30:48.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:48 smithi110 ceph-mon[35282]: pgmap v298: 97 pgs: 97 active+clean; 607 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-15T22:30:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:48 smithi112 ceph-mon[35032]: pgmap v298: 97 pgs: 97 active+clean; 607 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-15T22:30:49.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T22:30:49.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:49 smithi110 ceph-mon[35282]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:50.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:49 smithi022 ceph-mon[30634]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:50.049 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:49 smithi112 ceph-mon[35032]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 -- 172.21.15.22:0/417008040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7910101df0 msgr2=0x7f79101021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 --2- 172.21.15.22:0/417008040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7910101df0 0x7f79101021d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7900009900 tx=0x7f790002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 -- 172.21.15.22:0/417008040 shutdown_connections 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 --2- 172.21.15.22:0/417008040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7910106f20 0x7f791010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 --2- 172.21.15.22:0/417008040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79101027a0 0x7f79101067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 --2- 172.21.15.22:0/417008040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7910101df0 0x7f79101021d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 -- 172.21.15.22:0/417008040 >> 172.21.15.22:0/417008040 conn(0x7f79100fd8b0 msgr2=0x7f79100ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 -- 172.21.15.22:0/417008040 shutdown_connections 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.593+0000 7f7916800640 1 -- 172.21.15.22:0/417008040 wait complete. 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.594+0000 7f7916800640 1 Processor -- start 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.594+0000 7f7916800640 1 -- start start 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.594+0000 7f7916800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7910101df0 0x7f79101983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7916800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 0x7f7910198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7916800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7910106f20 0x7f791019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7916800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7910111fd0 con 0x7f79101027a0 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7916800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7910111e50 con 0x7f7910101df0 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7916800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7910112150 con 0x7f7910106f20 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 0x7f7910198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 0x7f7910198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42778/0 (socket says 172.21.15.22:42778) 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f790f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7910101df0 0x7f79101983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 -- 172.21.15.22:0/4103645100 learned_addr learned my addr 172.21.15.22:0/4103645100 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f790fe00640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7910106f20 0x7f791019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 -- 172.21.15.22:0/4103645100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7910106f20 msgr2=0x7f791019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7910106f20 0x7f791019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 -- 172.21.15.22:0/4103645100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7910101df0 msgr2=0x7f79101983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7910101df0 0x7f79101983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f7907e00640 1 -- 172.21.15.22:0/4103645100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791019d3a0 con 0x7f79101027a0 2024-09-15T22:30:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.595+0000 7f790f400640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7910101df0 0x7f79101983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.596+0000 7f7907e00640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 0x7f7910198930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f800e9f0 tx=0x7f78f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.596+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f800cd80 con 0x7f79101027a0 2024-09-15T22:30:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.596+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78f8010910 con 0x7f79101027a0 2024-09-15T22:30:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.596+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8018990 con 0x7f79101027a0 2024-09-15T22:30:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.596+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791019d690 con 0x7f79101027a0 2024-09-15T22:30:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.596+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101a4f70 con 0x7f79101027a0 2024-09-15T22:30:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.597+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79101021d0 con 0x7f79101027a0 2024-09-15T22:30:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.599+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f78f8010ac0 con 0x7f79101027a0 2024-09-15T22:30:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.600+0000 7f790cc00640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f78f40a3350 0x7f78f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.600+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f78f80cfc60 con 0x7f79101027a0 2024-09-15T22:30:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.600+0000 7f790f400640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f78f40a3350 0x7f78f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.601+0000 7f790f400640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f78f40a3350 0x7f78f40a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7900000c00 tx=0x7f7900031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.604+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78f809c280 con 0x7f79101027a0 2024-09-15T22:30:50.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:50 smithi022 ceph-mon[30634]: pgmap v299: 97 pgs: 97 active+clean; 607 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-15T22:30:50.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.820+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7910062630 con 0x7f78f40a3350 2024-09-15T22:30:50.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.825+0000 7f790cc00640 1 -- 172.21.15.22:0/4103645100 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7910062630 con 0x7f78f40a3350 2024-09-15T22:30:50.827 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_1/8bb874de-be6f-4ccc-b8bb-907598e7f380 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f78f40a3350 msgr2=0x7f78f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f78f40a3350 0x7f78f40a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7900000c00 tx=0x7f7900031510 comp rx=0 tx=0).stop 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 msgr2=0x7f7910198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 0x7f7910198930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f800e9f0 tx=0x7f78f800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 shutdown_connections 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7910106f20 0x7f791019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f78f40a3350 0x7f78f40a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79101027a0 0x7f7910198930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 --2- 172.21.15.22:0/4103645100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7910101df0 0x7f79101983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.827+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 >> 172.21.15.22:0/4103645100 conn(0x7f79100fd8b0 msgr2=0x7f79100feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.828+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 shutdown_connections 2024-09-15T22:30:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:50.828+0000 7f7916800640 1 -- 172.21.15.22:0/4103645100 wait complete. 2024-09-15T22:30:50.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:50 smithi110 ceph-mon[35282]: pgmap v299: 97 pgs: 97 active+clean; 607 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-15T22:30:51.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:50 smithi112 ceph-mon[35032]: pgmap v299: 97 pgs: 97 active+clean; 607 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-15T22:30:51.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:30:51.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:51 smithi110 ceph-mon[35282]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:52.002 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:51 smithi112 ceph-mon[35032]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:52.003 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:52.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:51 smithi022 ceph-mon[30634]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.535+0000 7fa2f6e00640 1 -- 172.21.15.22:0/1131452552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 msgr2=0x7fa2f0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.535+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/1131452552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 0x7fa2f0108a10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009900 tx=0x7fa2d802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 -- 172.21.15.22:0/1131452552 shutdown_connections 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/1131452552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0109140 0x7fa2f0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/1131452552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 0x7fa2f0108a10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/1131452552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2f0104010 0x7fa2f01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 -- 172.21.15.22:0/1131452552 >> 172.21.15.22:0/1131452552 conn(0x7fa2f00ffa50 msgr2=0x7fa2f0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 -- 172.21.15.22:0/1131452552 shutdown_connections 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.536+0000 7fa2f6e00640 1 -- 172.21.15.22:0/1131452552 wait complete. 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 Processor -- start 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 -- start start 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 0x7fa2f019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 0x7fa2f019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2f0109140 0x7fa2f019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f0114160 con 0x7fa2f01049c0 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f0113fe0 con 0x7fa2f0109140 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.537+0000 7fa2f6e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f01142e0 con 0x7fa2f0104010 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2e7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 0x7fa2f019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 0x7fa2f019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 0x7fa2f019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50130/0 (socket says 172.21.15.22:50130) 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 -- 172.21.15.22:0/3845486189 learned_addr learned my addr 172.21.15.22:0/3845486189 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2f4e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2f0109140 0x7fa2f019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 -- 172.21.15.22:0/3845486189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2f0109140 msgr2=0x7fa2f019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2f0109140 0x7fa2f019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 -- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 msgr2=0x7fa2f019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 0x7fa2f019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 -- 172.21.15.22:0/3845486189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f019f610 con 0x7fa2f0104010 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.538+0000 7fa2efe00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 0x7fa2f019a660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000ebc0 tx=0x7fa2e000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.539+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0010630 con 0x7fa2f0104010 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.539+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f019f900 con 0x7fa2f0104010 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.539+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f01a71e0 con 0x7fa2f0104010 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.539+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2e0010cb0 con 0x7fa2f0104010 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.539+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0018bf0 con 0x7fa2f0104010 2024-09-15T22:30:52.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.540+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f01043f0 con 0x7fa2f0104010 2024-09-15T22:30:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.542+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa2e00107d0 con 0x7fa2f0104010 2024-09-15T22:30:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.543+0000 7fa2ed600640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2d40a3350 0x7fa2d40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:52.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.543+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fa2e00d06f0 con 0x7fa2f0104010 2024-09-15T22:30:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.543+0000 7fa2e7400640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2d40a3350 0x7fa2d40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.544+0000 7fa2e7400640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2d40a3350 0x7fa2d40a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009230 tx=0x7fa2d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.545+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2e009d360 con 0x7fa2f0104010 2024-09-15T22:30:52.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.771+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2f002d7c0 con 0x7fa2f0104010 2024-09-15T22:30:52.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.772+0000 7fa2ed600640 1 -- 172.21.15.22:0/3845486189 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11920 (secure 0 0 0) 0x7fa2e009cc60 con 0x7fa2f0104010 2024-09-15T22:30:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:52.774 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-09-15T22:30:40:642902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:30:39.648360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24529,24530,24548]},"id":1}]} 2024-09-15T22:30:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:30:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2d40a3350 msgr2=0x7fa2d40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2d40a3350 0x7fa2d40a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009230 tx=0x7fa2d80058d0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 msgr2=0x7fa2f019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 0x7fa2f019a660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000ebc0 tx=0x7fa2e000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 shutdown_connections 2024-09-15T22:30:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2d40a3350 0x7fa2d40a5810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2f0109140 0x7fa2f019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2f01049c0 0x7fa2f019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 --2- 172.21.15.22:0/3845486189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2f0104010 0x7fa2f019a660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 >> 172.21.15.22:0/3845486189 conn(0x7fa2f00ffa50 msgr2=0x7fa2f0100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 shutdown_connections 2024-09-15T22:30:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:52.775+0000 7fa2f6e00640 1 -- 172.21.15.22:0/3845486189 wait complete. 2024-09-15T22:30:52.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:52 smithi110 ceph-mon[35282]: pgmap v300: 97 pgs: 97 active+clean; 629 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-15T22:30:53.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:52 smithi022 ceph-mon[30634]: pgmap v300: 97 pgs: 97 active+clean; 629 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-15T22:30:53.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:52 smithi112 ceph-mon[35032]: pgmap v300: 97 pgs: 97 active+clean; 629 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-15T22:30:53.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:30:53.888 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:53 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3845486189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:53 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3845486189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:53.991 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:53 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3845486189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 -- 172.21.15.22:0/3809474939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 msgr2=0x7f64e01043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 --2- 172.21.15.22:0/3809474939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 0x7f64e01043e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009900 tx=0x7f64d002a400 comp rx=0 tx=0).stop 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 -- 172.21.15.22:0/3809474939 shutdown_connections 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 --2- 172.21.15.22:0/3809474939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e0109130 0x7f64e0110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 --2- 172.21.15.22:0/3809474939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e0108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 --2- 172.21.15.22:0/3809474939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 0x7f64e01043e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.587+0000 7f64e6e00640 1 -- 172.21.15.22:0/3809474939 >> 172.21.15.22:0/3809474939 conn(0x7f64e00ffa20 msgr2=0x7f64e0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.588+0000 7f64e6e00640 1 -- 172.21.15.22:0/3809474939 shutdown_connections 2024-09-15T22:30:54.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.588+0000 7f64e6e00640 1 -- 172.21.15.22:0/3809474939 wait complete. 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 Processor -- start 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 -- start start 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 0x7f64e019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e0109130 0x7f64e019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f64e01141b0 con 0x7f64e01049b0 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0114030 con 0x7f64e0104000 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e6e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0114330 con 0x7f64e0109130 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64d7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64d7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e019ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42812/0 (socket says 172.21.15.22:42812) 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64d7400640 1 -- 172.21.15.22:0/2980196846 learned_addr learned my addr 172.21.15.22:0/2980196846 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64dfe00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 0x7f64e019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.589+0000 7f64e4e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e0109130 0x7f64e019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:54.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64d7400640 1 -- 172.21.15.22:0/2980196846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e0109130 msgr2=0x7f64e019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64d7400640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e0109130 0x7f64e019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64d7400640 1 -- 172.21.15.22:0/2980196846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 msgr2=0x7f64e019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64d7400640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 0x7f64e019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64d7400640 1 -- 172.21.15.22:0/2980196846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e019f680 con 0x7f64e01049b0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64d7400640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e019ac10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f64c800ea60 tx=0x7f64c800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c800cde0 con 0x7f64e01049b0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64c80035f0 con 0x7f64e01049b0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c8010670 con 0x7f64e01049b0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.590+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e019f970 con 0x7f64e01049b0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.591+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e01a7250 con 0x7f64e01049b0 2024-09-15T22:30:54.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.592+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e01043e0 con 0x7f64e01049b0 2024-09-15T22:30:54.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.594+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f64c80037a0 con 0x7f64e01049b0 2024-09-15T22:30:54.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.595+0000 7f64dd600640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f64c40a3350 0x7f64c40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:54.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.595+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f64c80cfc60 con 0x7f64e01049b0 2024-09-15T22:30:54.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.596+0000 7f64dfe00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f64c40a3350 0x7f64c40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:54.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.596+0000 7f64dfe00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f64c40a3350 0x7f64c40a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f64d0000c00 tx=0x7f64d0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:54.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.599+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64c809c8d0 con 0x7f64e01049b0 2024-09-15T22:30:54.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:54 smithi022 ceph-mon[30634]: pgmap v301: 97 pgs: 97 active+clean; 630 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-15T22:30:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.788+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64e002d7c0 con 0x7f64e01049b0 2024-09-15T22:30:54.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.789+0000 7f64dd600640 1 -- 172.21.15.22:0/2980196846 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22293 (secure 0 0 0) 0x7f64c809c1d0 con 0x7f64e01049b0 2024-09-15T22:30:54.791 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:54.791 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":79,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:30:24.572498+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:30:54.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.791+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f64c40a3350 msgr2=0x7f64c40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:54.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.791+0000 7f64e6e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f64c40a3350 0x7f64c40a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f64d0000c00 tx=0x7f64d0005b50 comp rx=0 tx=0).stop 2024-09-15T22:30:54.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.791+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 msgr2=0x7f64e019ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:54.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e019ac10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f64c800ea60 tx=0x7f64c800ef20 comp rx=0 tx=0).stop 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 shutdown_connections 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64e0109130 0x7f64e019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f64c40a3350 0x7f64c40a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64e01049b0 0x7f64e019ac10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 --2- 172.21.15.22:0/2980196846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64e0104000 0x7f64e019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 >> 172.21.15.22:0/2980196846 conn(0x7f64e00ffa20 msgr2=0x7f64e0100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 shutdown_connections 2024-09-15T22:30:54.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:54.792+0000 7f64e6e00640 1 -- 172.21.15.22:0/2980196846 wait complete. 2024-09-15T22:30:54.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:54 smithi110 ceph-mon[35282]: pgmap v301: 97 pgs: 97 active+clean; 630 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-15T22:30:55.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:54 smithi112 ceph-mon[35032]: pgmap v301: 97 pgs: 97 active+clean; 630 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-15T22:30:55.683 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:30:55.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:30:55.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:55 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2980196846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:56.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:55 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2980196846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:56.064 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:55 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2980196846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:30:56.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 -- 172.21.15.22:0/2924831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec10e3c0 msgr2=0x7f32ec110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 --2- 172.21.15.22:0/2924831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec10e3c0 0x7f32ec110810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009ca0 tx=0x7f32e402a950 comp rx=0 tx=0).stop 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 -- 172.21.15.22:0/2924831549 shutdown_connections 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 --2- 172.21.15.22:0/2924831549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074f40 0x7f32ec10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 --2- 172.21.15.22:0/2924831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec10e3c0 0x7f32ec110810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 --2- 172.21.15.22:0/2924831549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec074620 0x7f32ec074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 -- 172.21.15.22:0/2924831549 >> 172.21.15.22:0/2924831549 conn(0x7f32ec0fd8c0 msgr2=0x7f32ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 -- 172.21.15.22:0/2924831549 shutdown_connections 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.578+0000 7f32f2800640 1 -- 172.21.15.22:0/2924831549 wait complete. 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 Processor -- start 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 -- start start 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 0x7f32ec19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec074f40 0x7f32ec19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec10e3c0 0x7f32ec19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec114170 con 0x7f32ec074f40 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec113ff0 con 0x7f32ec10e3c0 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.579+0000 7f32f2800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1142f0 con 0x7f32ec074620 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 0x7f32ec19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32e3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec074f40 0x7f32ec19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 0x7f32ec19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50160/0 (socket says 172.21.15.22:50160) 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 -- 172.21.15.22:0/1415419056 learned_addr learned my addr 172.21.15.22:0/1415419056 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32ebe00640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec10e3c0 0x7f32ec19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 -- 172.21.15.22:0/1415419056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec10e3c0 msgr2=0x7f32ec19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec10e3c0 0x7f32ec19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 -- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec074f40 msgr2=0x7f32ec19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:56.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec074f40 0x7f32ec19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 -- 172.21.15.22:0/1415419056 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec19f620 con 0x7f32ec074620 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32eb400640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 0x7f32ec19a670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00d950 tx=0x7f32dc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.580+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc017030 con 0x7f32ec074620 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.581+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec19f910 con 0x7f32ec074620 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.581+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32dc004020 con 0x7f32ec074620 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.581+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0047a0 con 0x7f32ec074620 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.581+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1a71f0 con 0x7f32ec074620 2024-09-15T22:30:56.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.582+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec074a00 con 0x7f32ec074620 2024-09-15T22:30:56.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.584+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f32dc0041d0 con 0x7f32ec074620 2024-09-15T22:30:56.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.585+0000 7f32e8c00640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32d00a32d0 0x7f32d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:56.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.585+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f32dc0cf340 con 0x7f32ec074620 2024-09-15T22:30:56.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.585+0000 7f32e3e00640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32d00a32d0 0x7f32d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:56.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.586+0000 7f32e3e00640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32d00a32d0 0x7f32d00a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32ec10f750 tx=0x7f32d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:56.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.587+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32dc09bfb0 con 0x7f32ec074620 2024-09-15T22:30:56.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.769+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32ec062630 con 0x7f32d00a32d0 2024-09-15T22:30:56.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:56 smithi022 ceph-mon[30634]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-15T22:30:56.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.777+0000 7f32e8c00640 1 -- 172.21.15.22:0/1415419056 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258699 (secure 0 0 0) 0x7f32ec062630 con 0x7f32d00a32d0 2024-09-15T22:30:56.782 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:56.783 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32d00a32d0 msgr2=0x7f32d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32d00a32d0 0x7f32d00a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32ec10f750 tx=0x7f32d4005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 msgr2=0x7f32ec19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 0x7f32ec19a670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00d950 tx=0x7f32dc00de10 comp rx=0 tx=0).stop 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 shutdown_connections 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32d00a32d0 0x7f32d00a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec10e3c0 0x7f32ec19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ec074f40 0x7f32ec19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 --2- 172.21.15.22:0/1415419056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32ec074620 0x7f32ec19a670 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:56.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 >> 172.21.15.22:0/1415419056 conn(0x7f32ec0fd8c0 msgr2=0x7f32ec0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:56.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 shutdown_connections 2024-09-15T22:30:56.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:56.782+0000 7f32f2800640 1 -- 172.21.15.22:0/1415419056 wait complete. 2024-09-15T22:30:57.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:56 smithi112 ceph-mon[35032]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-15T22:30:57.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:56 smithi110 ceph-mon[35282]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2024-09-15T22:30:57.685 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-15T22:30:55.553062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644717,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":242,"num_read_kb":224,"num_write":338,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":423780,"kb_used_data":12132,"kb_used_omap":18,"kb_used_meta":411437,"kb_avail":1124518044,"statfs":{"total":1151940427776,"available":1151506477056,"internally_reserved":0,"allocated":12423168,"data_stored":6922179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":421311802},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":85,"num_write":32,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003093"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535076+0000","last_change":"2024-09-15T22:30:23.540766+0000","last_active":"2024-09-15T22:30:25.535076+0000","last_peered":"2024-09-15T22:30:25.535076+0000","last_clean":"2024-09-15T22:30:25.535076+0000","last_became_active":"2024-09-15T22:30:23.540425+0000","last_became_peered":"2024-09-15T22:30:23.540425+0000","last_unstale":"2024-09-15T22:30:25.535076+0000","last_undegraded":"2024-09-15T22:30:25.535076+0000","last_fullsized":"2024-09-15T22:30:25.535076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:50.650220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529214+0000","last_change":"2024-09-15T22:30:23.533484+0000","last_active":"2024-09-15T22:30:25.529214+0000","last_peered":"2024-09-15T22:30:25.529214+0000","last_clean":"2024-09-15T22:30:25.529214+0000","last_became_active":"2024-09-15T22:30:23.532995+0000","last_became_peered":"2024-09-15T22:30:23.532995+0000","last_unstale":"2024-09-15T22:30:25.529214+0000","last_undegraded":"2024-09-15T22:30:25.529214+0000","last_fullsized":"2024-09-15T22:30:25.529214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:42.108789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529265+0000","last_change":"2024-09-15T22:30:23.529206+0000","last_active":"2024-09-15T22:30:25.529265+0000","last_peered":"2024-09-15T22:30:25.529265+0000","last_clean":"2024-09-15T22:30:25.529265+0000","last_became_active":"2024-09-15T22:30:23.528894+0000","last_became_peered":"2024-09-15T22:30:23.528894+0000","last_unstale":"2024-09-15T22:30:25.529265+0000","last_undegraded":"2024-09-15T22:30:25.529265+0000","last_fullsized":"2024-09-15T22:30:25.529265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:53.130553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531866+0000","last_change":"2024-09-15T22:30:23.529406+0000","last_active":"2024-09-15T22:30:25.531866+0000","last_peered":"2024-09-15T22:30:25.531866+0000","last_clean":"2024-09-15T22:30:25.531866+0000","last_became_active":"2024-09-15T22:30:23.529074+0000","last_became_peered":"2024-09-15T22:30:23.529074+0000","last_unstale":"2024-09-15T22:30:25.531866+0000","last_undegraded":"2024-09-15T22:30:25.531866+0000","last_fullsized":"2024-09-15T22:30:25.531866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:55.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518281+0000","last_change":"2024-09-15T22:30:23.525342+0000","last_active":"2024-09-15T22:30:25.518281+0000","last_peered":"2024-09-15T22:30:25.518281+0000","last_clean":"2024-09-15T22:30:25.518281+0000","last_became_active":"2024-09-15T22:30:23.524983+0000","last_became_peered":"2024-09-15T22:30:23.524983+0000","last_unstale":"2024-09-15T22:30:25.518281+0000","last_undegraded":"2024-09-15T22:30:25.518281+0000","last_fullsized":"2024-09-15T22:30:25.518281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:57.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528931+0000","last_change":"2024-09-15T22:30:23.522364+0000","last_active":"2024-09-15T22:30:25.528931+0000","last_peered":"2024-09-15T22:30:25.528931+0000","last_clean":"2024-09-15T22:30:25.528931+0000","last_became_active":"2024-09-15T22:30:23.522018+0000","last_became_peered":"2024-09-15T22:30:23.522018+0000","last_unstale":"2024-09-15T22:30:25.528931+0000","last_undegraded":"2024-09-15T22:30:25.528931+0000","last_fullsized":"2024-09-15T22:30:25.528931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:24.373042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529276+0000","last_change":"2024-09-15T22:30:23.531767+0000","last_active":"2024-09-15T22:30:25.529276+0000","last_peered":"2024-09-15T22:30:25.529276+0000","last_clean":"2024-09-15T22:30:25.529276+0000","last_became_active":"2024-09-15T22:30:23.530522+0000","last_became_peered":"2024-09-15T22:30:23.530522+0000","last_unstale":"2024-09-15T22:30:25.529276+0000","last_undegraded":"2024-09-15T22:30:25.529276+0000","last_fullsized":"2024-09-15T22:30:25.529276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:16.225467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534779+0000","last_change":"2024-09-15T22:30:23.528714+0000","last_active":"2024-09-15T22:30:25.534779+0000","last_peered":"2024-09-15T22:30:25.534779+0000","last_clean":"2024-09-15T22:30:25.534779+0000","last_became_active":"2024-09-15T22:30:23.528412+0000","last_became_peered":"2024-09-15T22:30:23.528412+0000","last_unstale":"2024-09-15T22:30:25.534779+0000","last_undegraded":"2024-09-15T22:30:25.534779+0000","last_fullsized":"2024-09-15T22:30:25.534779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:25.020500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516335+0000","last_change":"2024-09-15T22:30:23.523940+0000","last_active":"2024-09-15T22:30:25.516335+0000","last_peered":"2024-09-15T22:30:25.516335+0000","last_clean":"2024-09-15T22:30:25.516335+0000","last_became_active":"2024-09-15T22:30:23.522682+0000","last_became_peered":"2024-09-15T22:30:23.522682+0000","last_unstale":"2024-09-15T22:30:25.516335+0000","last_undegraded":"2024-09-15T22:30:25.516335+0000","last_fullsized":"2024-09-15T22:30:25.516335+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:48.164040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528938+0000","last_change":"2024-09-15T22:30:23.524927+0000","last_active":"2024-09-15T22:30:25.528938+0000","last_peered":"2024-09-15T22:30:25.528938+0000","last_clean":"2024-09-15T22:30:25.528938+0000","last_became_active":"2024-09-15T22:30:23.524578+0000","last_became_peered":"2024-09-15T22:30:23.524578+0000","last_unstale":"2024-09-15T22:30:25.528938+0000","last_undegraded":"2024-09-15T22:30:25.528938+0000","last_fullsized":"2024-09-15T22:30:25.528938+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:15.093534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529650+0000","last_change":"2024-09-15T22:30:23.527258+0000","last_active":"2024-09-15T22:30:25.529650+0000","last_peered":"2024-09-15T22:30:25.529650+0000","last_clean":"2024-09-15T22:30:25.529650+0000","last_became_active":"2024-09-15T22:30:23.526842+0000","last_became_peered":"2024-09-15T22:30:23.526842+0000","last_unstale":"2024-09-15T22:30:25.529650+0000","last_undegraded":"2024-09-15T22:30:25.529650+0000","last_fullsized":"2024-09-15T22:30:25.529650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:45.861445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.532033+0000","last_change":"2024-09-15T22:30:23.524525+0000","last_active":"2024-09-15T22:30:25.532033+0000","last_peered":"2024-09-15T22:30:25.532033+0000","last_clean":"2024-09-15T22:30:25.532033+0000","last_became_active":"2024-09-15T22:30:23.523915+0000","last_became_peered":"2024-09-15T22:30:23.523915+0000","last_unstale":"2024-09-15T22:30:25.532033+0000","last_undegraded":"2024-09-15T22:30:25.532033+0000","last_fullsized":"2024-09-15T22:30:25.532033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:24.954632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516041+0000","last_change":"2024-09-15T22:30:23.522262+0000","last_active":"2024-09-15T22:30:25.516041+0000","last_peered":"2024-09-15T22:30:25.516041+0000","last_clean":"2024-09-15T22:30:25.516041+0000","last_became_active":"2024-09-15T22:30:23.521919+0000","last_became_peered":"2024-09-15T22:30:23.521919+0000","last_unstale":"2024-09-15T22:30:25.516041+0000","last_undegraded":"2024-09-15T22:30:25.516041+0000","last_fullsized":"2024-09-15T22:30:25.516041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:48.362426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529662+0000","last_change":"2024-09-15T22:30:23.526652+0000","last_active":"2024-09-15T22:30:25.529662+0000","last_peered":"2024-09-15T22:30:25.529662+0000","last_clean":"2024-09-15T22:30:25.529662+0000","last_became_active":"2024-09-15T22:30:23.526204+0000","last_became_peered":"2024-09-15T22:30:23.526204+0000","last_unstale":"2024-09-15T22:30:25.529662+0000","last_undegraded":"2024-09-15T22:30:25.529662+0000","last_fullsized":"2024-09-15T22:30:25.529662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:40.914567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529060+0000","last_change":"2024-09-15T22:30:23.528996+0000","last_active":"2024-09-15T22:30:25.529060+0000","last_peered":"2024-09-15T22:30:25.529060+0000","last_clean":"2024-09-15T22:30:25.529060+0000","last_became_active":"2024-09-15T22:30:23.528666+0000","last_became_peered":"2024-09-15T22:30:23.528666+0000","last_unstale":"2024-09-15T22:30:25.529060+0000","last_undegraded":"2024-09-15T22:30:25.529060+0000","last_fullsized":"2024-09-15T22:30:25.529060+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:10.895994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515801+0000","last_change":"2024-09-15T22:30:23.525288+0000","last_active":"2024-09-15T22:30:25.515801+0000","last_peered":"2024-09-15T22:30:25.515801+0000","last_clean":"2024-09-15T22:30:25.515801+0000","last_became_active":"2024-09-15T22:30:23.524956+0000","last_became_peered":"2024-09-15T22:30:23.524956+0000","last_unstale":"2024-09-15T22:30:25.515801+0000","last_undegraded":"2024-09-15T22:30:25.515801+0000","last_fullsized":"2024-09-15T22:30:25.515801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:06.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535111+0000","last_change":"2024-09-15T22:30:23.540709+0000","last_active":"2024-09-15T22:30:25.535111+0000","last_peered":"2024-09-15T22:30:25.535111+0000","last_clean":"2024-09-15T22:30:25.535111+0000","last_became_active":"2024-09-15T22:30:23.540332+0000","last_became_peered":"2024-09-15T22:30:23.540332+0000","last_unstale":"2024-09-15T22:30:25.535111+0000","last_undegraded":"2024-09-15T22:30:25.535111+0000","last_fullsized":"2024-09-15T22:30:25.535111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:46.817361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.530529+0000","last_change":"2024-09-15T22:30:23.521007+0000","last_active":"2024-09-15T22:30:25.530529+0000","last_peered":"2024-09-15T22:30:25.530529+0000","last_clean":"2024-09-15T22:30:25.530529+0000","last_became_active":"2024-09-15T22:30:23.520678+0000","last_became_peered":"2024-09-15T22:30:23.520678+0000","last_unstale":"2024-09-15T22:30:25.530529+0000","last_undegraded":"2024-09-15T22:30:25.530529+0000","last_fullsized":"2024-09-15T22:30:25.530529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:44.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528673+0000","last_change":"2024-09-15T22:30:23.528280+0000","last_active":"2024-09-15T22:30:25.528673+0000","last_peered":"2024-09-15T22:30:25.528673+0000","last_clean":"2024-09-15T22:30:25.528673+0000","last_became_active":"2024-09-15T22:30:23.527888+0000","last_became_peered":"2024-09-15T22:30:23.527888+0000","last_unstale":"2024-09-15T22:30:25.528673+0000","last_undegraded":"2024-09-15T22:30:25.528673+0000","last_fullsized":"2024-09-15T22:30:25.528673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:45.748437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534166+0000","last_change":"2024-09-15T22:30:23.525344+0000","last_active":"2024-09-15T22:30:25.534166+0000","last_peered":"2024-09-15T22:30:25.534166+0000","last_clean":"2024-09-15T22:30:25.534166+0000","last_became_active":"2024-09-15T22:30:23.525029+0000","last_became_peered":"2024-09-15T22:30:23.525029+0000","last_unstale":"2024-09-15T22:30:25.534166+0000","last_undegraded":"2024-09-15T22:30:25.534166+0000","last_fullsized":"2024-09-15T22:30:25.534166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:25.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516265+0000","last_change":"2024-09-15T22:30:23.530315+0000","last_active":"2024-09-15T22:30:25.516265+0000","last_peered":"2024-09-15T22:30:25.516265+0000","last_clean":"2024-09-15T22:30:25.516265+0000","last_became_active":"2024-09-15T22:30:23.529388+0000","last_became_peered":"2024-09-15T22:30:23.529388+0000","last_unstale":"2024-09-15T22:30:25.516265+0000","last_undegraded":"2024-09-15T22:30:25.516265+0000","last_fullsized":"2024-09-15T22:30:25.516265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:55.126701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516264+0000","last_change":"2024-09-15T22:30:23.530305+0000","last_active":"2024-09-15T22:30:25.516264+0000","last_peered":"2024-09-15T22:30:25.516264+0000","last_clean":"2024-09-15T22:30:25.516264+0000","last_became_active":"2024-09-15T22:30:23.529909+0000","last_became_peered":"2024-09-15T22:30:23.529909+0000","last_unstale":"2024-09-15T22:30:25.516264+0000","last_undegraded":"2024-09-15T22:30:25.516264+0000","last_fullsized":"2024-09-15T22:30:25.516264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:07.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534996+0000","last_change":"2024-09-15T22:30:23.524511+0000","last_active":"2024-09-15T22:30:25.534996+0000","last_peered":"2024-09-15T22:30:25.534996+0000","last_clean":"2024-09-15T22:30:25.534996+0000","last_became_active":"2024-09-15T22:30:23.524219+0000","last_became_peered":"2024-09-15T22:30:23.524219+0000","last_unstale":"2024-09-15T22:30:25.534996+0000","last_undegraded":"2024-09-15T22:30:25.534996+0000","last_fullsized":"2024-09-15T22:30:25.534996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:47.092184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.532204+0000","last_change":"2024-09-15T22:30:23.531690+0000","last_active":"2024-09-15T22:30:25.532204+0000","last_peered":"2024-09-15T22:30:25.532204+0000","last_clean":"2024-09-15T22:30:25.532204+0000","last_became_active":"2024-09-15T22:30:23.531372+0000","last_became_peered":"2024-09-15T22:30:23.531372+0000","last_unstale":"2024-09-15T22:30:25.532204+0000","last_undegraded":"2024-09-15T22:30:25.532204+0000","last_fullsized":"2024-09-15T22:30:25.532204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:11.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.536445+0000","last_change":"2024-09-15T22:30:23.538064+0000","last_active":"2024-09-15T22:30:25.536445+0000","last_peered":"2024-09-15T22:30:25.536445+0000","last_clean":"2024-09-15T22:30:25.536445+0000","last_became_active":"2024-09-15T22:30:23.537568+0000","last_became_peered":"2024-09-15T22:30:23.537568+0000","last_unstale":"2024-09-15T22:30:25.536445+0000","last_undegraded":"2024-09-15T22:30:25.536445+0000","last_fullsized":"2024-09-15T22:30:25.536445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:22.368267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528546+0000","last_change":"2024-09-15T22:30:23.528383+0000","last_active":"2024-09-15T22:30:25.528546+0000","last_peered":"2024-09-15T22:30:25.528546+0000","last_clean":"2024-09-15T22:30:25.528546+0000","last_became_active":"2024-09-15T22:30:23.527984+0000","last_became_peered":"2024-09-15T22:30:23.527984+0000","last_unstale":"2024-09-15T22:30:25.528546+0000","last_undegraded":"2024-09-15T22:30:25.528546+0000","last_fullsized":"2024-09-15T22:30:25.528546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:28.301070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534570+0000","last_change":"2024-09-15T22:30:23.526560+0000","last_active":"2024-09-15T22:30:25.534570+0000","last_peered":"2024-09-15T22:30:25.534570+0000","last_clean":"2024-09-15T22:30:25.534570+0000","last_became_active":"2024-09-15T22:30:23.526226+0000","last_became_peered":"2024-09-15T22:30:23.526226+0000","last_unstale":"2024-09-15T22:30:25.534570+0000","last_undegraded":"2024-09-15T22:30:25.534570+0000","last_fullsized":"2024-09-15T22:30:25.534570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:44.019439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515755+0000","last_change":"2024-09-15T22:30:23.532730+0000","last_active":"2024-09-15T22:30:25.515755+0000","last_peered":"2024-09-15T22:30:25.515755+0000","last_clean":"2024-09-15T22:30:25.515755+0000","last_became_active":"2024-09-15T22:30:23.532425+0000","last_became_peered":"2024-09-15T22:30:23.532425+0000","last_unstale":"2024-09-15T22:30:25.515755+0000","last_undegraded":"2024-09-15T22:30:25.515755+0000","last_fullsized":"2024-09-15T22:30:25.515755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:16.341971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529767+0000","last_change":"2024-09-15T22:30:23.535074+0000","last_active":"2024-09-15T22:30:25.529767+0000","last_peered":"2024-09-15T22:30:25.529767+0000","last_clean":"2024-09-15T22:30:25.529767+0000","last_became_active":"2024-09-15T22:30:23.534810+0000","last_became_peered":"2024-09-15T22:30:23.534810+0000","last_unstale":"2024-09-15T22:30:25.529767+0000","last_undegraded":"2024-09-15T22:30:25.529767+0000","last_fullsized":"2024-09-15T22:30:25.529767+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:28.085650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529039+0000","last_change":"2024-09-15T22:30:23.533870+0000","last_active":"2024-09-15T22:30:25.529039+0000","last_peered":"2024-09-15T22:30:25.529039+0000","last_clean":"2024-09-15T22:30:25.529039+0000","last_became_active":"2024-09-15T22:30:23.533377+0000","last_became_peered":"2024-09-15T22:30:23.533377+0000","last_unstale":"2024-09-15T22:30:25.529039+0000","last_undegraded":"2024-09-15T22:30:25.529039+0000","last_fullsized":"2024-09-15T22:30:25.529039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:50.466754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529496+0000","last_change":"2024-09-15T22:30:23.521423+0000","last_active":"2024-09-15T22:30:25.529496+0000","last_peered":"2024-09-15T22:30:25.529496+0000","last_clean":"2024-09-15T22:30:25.529496+0000","last_became_active":"2024-09-15T22:30:23.521092+0000","last_became_peered":"2024-09-15T22:30:23.521092+0000","last_unstale":"2024-09-15T22:30:25.529496+0000","last_undegraded":"2024-09-15T22:30:25.529496+0000","last_fullsized":"2024-09-15T22:30:25.529496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:50.499382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534086+0000","last_change":"2024-09-15T22:30:23.526096+0000","last_active":"2024-09-15T22:30:25.534086+0000","last_peered":"2024-09-15T22:30:25.534086+0000","last_clean":"2024-09-15T22:30:25.534086+0000","last_became_active":"2024-09-15T22:30:23.525746+0000","last_became_peered":"2024-09-15T22:30:23.525746+0000","last_unstale":"2024-09-15T22:30:25.534086+0000","last_undegraded":"2024-09-15T22:30:25.534086+0000","last_fullsized":"2024-09-15T22:30:25.534086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:57.303470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518419+0000","last_change":"2024-09-15T22:30:23.518856+0000","last_active":"2024-09-15T22:30:25.518419+0000","last_peered":"2024-09-15T22:30:25.518419+0000","last_clean":"2024-09-15T22:30:25.518419+0000","last_became_active":"2024-09-15T22:30:23.518385+0000","last_became_peered":"2024-09-15T22:30:23.518385+0000","last_unstale":"2024-09-15T22:30:25.518419+0000","last_undegraded":"2024-09-15T22:30:25.518419+0000","last_fullsized":"2024-09-15T22:30:25.518419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:19.783989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":45,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:53.675990+0000","last_change":"2024-09-15T22:30:21.083625+0000","last_active":"2024-09-15T22:30:53.675990+0000","last_peered":"2024-09-15T22:30:53.675990+0000","last_clean":"2024-09-15T22:30:53.675990+0000","last_became_active":"2024-09-15T22:30:21.083252+0000","last_became_peered":"2024-09-15T22:30:21.083252+0000","last_unstale":"2024-09-15T22:30:53.675990+0000","last_undegraded":"2024-09-15T22:30:53.675990+0000","last_fullsized":"2024-09-15T22:30:53.675990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:34.596784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531290+0000","last_change":"2024-09-15T22:30:23.539472+0000","last_active":"2024-09-15T22:30:25.531290+0000","last_peered":"2024-09-15T22:30:25.531290+0000","last_clean":"2024-09-15T22:30:25.531290+0000","last_became_active":"2024-09-15T22:30:23.539138+0000","last_became_peered":"2024-09-15T22:30:23.539138+0000","last_unstale":"2024-09-15T22:30:25.531290+0000","last_undegraded":"2024-09-15T22:30:25.531290+0000","last_fullsized":"2024-09-15T22:30:25.531290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:18.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645590+0000","last_change":"2024-09-15T22:30:21.084153+0000","last_active":"2024-09-15T22:30:36.645590+0000","last_peered":"2024-09-15T22:30:36.645590+0000","last_clean":"2024-09-15T22:30:36.645590+0000","last_became_active":"2024-09-15T22:30:21.083772+0000","last_became_peered":"2024-09-15T22:30:21.083772+0000","last_unstale":"2024-09-15T22:30:36.645590+0000","last_undegraded":"2024-09-15T22:30:36.645590+0000","last_fullsized":"2024-09-15T22:30:36.645590+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:42.435846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.644970+0000","last_change":"2024-09-15T22:30:21.081395+0000","last_active":"2024-09-15T22:30:36.644970+0000","last_peered":"2024-09-15T22:30:36.644970+0000","last_clean":"2024-09-15T22:30:36.644970+0000","last_became_active":"2024-09-15T22:30:21.080785+0000","last_became_peered":"2024-09-15T22:30:21.080785+0000","last_unstale":"2024-09-15T22:30:36.644970+0000","last_undegraded":"2024-09-15T22:30:36.644970+0000","last_fullsized":"2024-09-15T22:30:36.644970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:58.908942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534822+0000","last_change":"2024-09-15T22:30:23.525123+0000","last_active":"2024-09-15T22:30:25.534822+0000","last_peered":"2024-09-15T22:30:25.534822+0000","last_clean":"2024-09-15T22:30:25.534822+0000","last_became_active":"2024-09-15T22:30:23.524772+0000","last_became_peered":"2024-09-15T22:30:23.524772+0000","last_unstale":"2024-09-15T22:30:25.534822+0000","last_undegraded":"2024-09-15T22:30:25.534822+0000","last_fullsized":"2024-09-15T22:30:25.534822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:32.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531679+0000","last_change":"2024-09-15T22:30:21.084218+0000","last_active":"2024-09-15T22:30:25.531679+0000","last_peered":"2024-09-15T22:30:25.531679+0000","last_clean":"2024-09-15T22:30:25.531679+0000","last_became_active":"2024-09-15T22:30:21.083853+0000","last_became_peered":"2024-09-15T22:30:21.083853+0000","last_unstale":"2024-09-15T22:30:25.531679+0000","last_undegraded":"2024-09-15T22:30:25.531679+0000","last_fullsized":"2024-09-15T22:30:25.531679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:56.947260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529137+0000","last_change":"2024-09-15T22:30:23.526667+0000","last_active":"2024-09-15T22:30:25.529137+0000","last_peered":"2024-09-15T22:30:25.529137+0000","last_clean":"2024-09-15T22:30:25.529137+0000","last_became_active":"2024-09-15T22:30:23.524872+0000","last_became_peered":"2024-09-15T22:30:23.524872+0000","last_unstale":"2024-09-15T22:30:25.529137+0000","last_undegraded":"2024-09-15T22:30:25.529137+0000","last_fullsized":"2024-09-15T22:30:25.529137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:11.222255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:49.668565+0000","last_change":"2024-09-15T22:30:21.081582+0000","last_active":"2024-09-15T22:30:49.668565+0000","last_peered":"2024-09-15T22:30:49.668565+0000","last_clean":"2024-09-15T22:30:49.668565+0000","last_became_active":"2024-09-15T22:30:21.081217+0000","last_became_peered":"2024-09-15T22:30:21.081217+0000","last_unstale":"2024-09-15T22:30:49.668565+0000","last_undegraded":"2024-09-15T22:30:49.668565+0000","last_fullsized":"2024-09-15T22:30:49.668565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:21.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516277+0000","last_change":"2024-09-15T22:30:23.523065+0000","last_active":"2024-09-15T22:30:25.516277+0000","last_peered":"2024-09-15T22:30:25.516277+0000","last_clean":"2024-09-15T22:30:25.516277+0000","last_became_active":"2024-09-15T22:30:23.522743+0000","last_became_peered":"2024-09-15T22:30:23.522743+0000","last_unstale":"2024-09-15T22:30:25.516277+0000","last_undegraded":"2024-09-15T22:30:25.516277+0000","last_fullsized":"2024-09-15T22:30:25.516277+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:11.459699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.639758+0000","last_change":"2024-09-15T22:30:21.082508+0000","last_active":"2024-09-15T22:30:35.639758+0000","last_peered":"2024-09-15T22:30:35.639758+0000","last_clean":"2024-09-15T22:30:35.639758+0000","last_became_active":"2024-09-15T22:30:21.082199+0000","last_became_peered":"2024-09-15T22:30:21.082199+0000","last_unstale":"2024-09-15T22:30:35.639758+0000","last_undegraded":"2024-09-15T22:30:35.639758+0000","last_fullsized":"2024-09-15T22:30:35.639758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529815+0000","last_change":"2024-09-15T22:30:23.537744+0000","last_active":"2024-09-15T22:30:25.529815+0000","last_peered":"2024-09-15T22:30:25.529815+0000","last_clean":"2024-09-15T22:30:25.529815+0000","last_became_active":"2024-09-15T22:30:23.537426+0000","last_became_peered":"2024-09-15T22:30:23.537426+0000","last_unstale":"2024-09-15T22:30:25.529815+0000","last_undegraded":"2024-09-15T22:30:25.529815+0000","last_fullsized":"2024-09-15T22:30:25.529815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.389998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.641922+0000","last_change":"2024-09-15T22:30:21.091503+0000","last_active":"2024-09-15T22:30:35.641922+0000","last_peered":"2024-09-15T22:30:35.641922+0000","last_clean":"2024-09-15T22:30:35.641922+0000","last_became_active":"2024-09-15T22:30:21.090880+0000","last_became_peered":"2024-09-15T22:30:21.090880+0000","last_unstale":"2024-09-15T22:30:35.641922+0000","last_undegraded":"2024-09-15T22:30:35.641922+0000","last_fullsized":"2024-09-15T22:30:35.641922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.908033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515946+0000","last_change":"2024-09-15T22:30:23.531619+0000","last_active":"2024-09-15T22:30:25.515946+0000","last_peered":"2024-09-15T22:30:25.515946+0000","last_clean":"2024-09-15T22:30:25.515946+0000","last_became_active":"2024-09-15T22:30:23.531287+0000","last_became_peered":"2024-09-15T22:30:23.531287+0000","last_unstale":"2024-09-15T22:30:25.515946+0000","last_undegraded":"2024-09-15T22:30:25.515946+0000","last_fullsized":"2024-09-15T22:30:25.515946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:18.026268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'25","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:50.671398+0000","last_change":"2024-09-15T22:30:21.078244+0000","last_active":"2024-09-15T22:30:50.671398+0000","last_peered":"2024-09-15T22:30:50.671398+0000","last_clean":"2024-09-15T22:30:50.671398+0000","last_became_active":"2024-09-15T22:30:21.077866+0000","last_became_peered":"2024-09-15T22:30:21.077866+0000","last_unstale":"2024-09-15T22:30:50.671398+0000","last_undegraded":"2024-09-15T22:30:50.671398+0000","last_fullsized":"2024-09-15T22:30:50.671398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.304360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":65,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518441+0000","last_change":"2024-09-15T22:30:23.530641+0000","last_active":"2024-09-15T22:30:25.518441+0000","last_peered":"2024-09-15T22:30:25.518441+0000","last_clean":"2024-09-15T22:30:25.518441+0000","last_became_active":"2024-09-15T22:30:23.530349+0000","last_became_peered":"2024-09-15T22:30:23.530349+0000","last_unstale":"2024-09-15T22:30:25.518441+0000","last_undegraded":"2024-09-15T22:30:25.518441+0000","last_fullsized":"2024-09-15T22:30:25.518441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:44.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645787+0000","last_change":"2024-09-15T22:30:21.080522+0000","last_active":"2024-09-15T22:30:36.645787+0000","last_peered":"2024-09-15T22:30:36.645787+0000","last_clean":"2024-09-15T22:30:36.645787+0000","last_became_active":"2024-09-15T22:30:21.079288+0000","last_became_peered":"2024-09-15T22:30:21.079288+0000","last_unstale":"2024-09-15T22:30:36.645787+0000","last_undegraded":"2024-09-15T22:30:36.645787+0000","last_fullsized":"2024-09-15T22:30:36.645787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:31.106479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515627+0000","last_change":"2024-09-15T22:30:23.535095+0000","last_active":"2024-09-15T22:30:25.515627+0000","last_peered":"2024-09-15T22:30:25.515627+0000","last_clean":"2024-09-15T22:30:25.515627+0000","last_became_active":"2024-09-15T22:30:23.534768+0000","last_became_peered":"2024-09-15T22:30:23.534768+0000","last_unstale":"2024-09-15T22:30:25.515627+0000","last_undegraded":"2024-09-15T22:30:25.515627+0000","last_fullsized":"2024-09-15T22:30:25.515627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:16.410104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.641665+0000","last_change":"2024-09-15T22:30:21.084422+0000","last_active":"2024-09-15T22:30:35.641665+0000","last_peered":"2024-09-15T22:30:35.641665+0000","last_clean":"2024-09-15T22:30:35.641665+0000","last_became_active":"2024-09-15T22:30:21.084006+0000","last_became_peered":"2024-09-15T22:30:21.084006+0000","last_unstale":"2024-09-15T22:30:35.641665+0000","last_undegraded":"2024-09-15T22:30:35.641665+0000","last_fullsized":"2024-09-15T22:30:35.641665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:28.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.530356+0000","last_change":"2024-09-15T22:30:23.520511+0000","last_active":"2024-09-15T22:30:25.530356+0000","last_peered":"2024-09-15T22:30:25.530356+0000","last_clean":"2024-09-15T22:30:25.530356+0000","last_became_active":"2024-09-15T22:30:23.520176+0000","last_became_peered":"2024-09-15T22:30:23.520176+0000","last_unstale":"2024-09-15T22:30:25.530356+0000","last_undegraded":"2024-09-15T22:30:25.530356+0000","last_fullsized":"2024-09-15T22:30:25.530356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.195058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:49.669843+0000","last_change":"2024-09-15T22:30:21.082312+0000","last_active":"2024-09-15T22:30:49.669843+0000","last_peered":"2024-09-15T22:30:49.669843+0000","last_clean":"2024-09-15T22:30:49.669843+0000","last_became_active":"2024-09-15T22:30:21.081919+0000","last_became_peered":"2024-09-15T22:30:21.081919+0000","last_unstale":"2024-09-15T22:30:49.669843+0000","last_undegraded":"2024-09-15T22:30:49.669843+0000","last_fullsized":"2024-09-15T22:30:49.669843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:19.893695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528372+0000","last_change":"2024-09-15T22:30:23.528002+0000","last_active":"2024-09-15T22:30:25.528372+0000","last_peered":"2024-09-15T22:30:25.528372+0000","last_clean":"2024-09-15T22:30:25.528372+0000","last_became_active":"2024-09-15T22:30:23.527648+0000","last_became_peered":"2024-09-15T22:30:23.527648+0000","last_unstale":"2024-09-15T22:30:25.528372+0000","last_undegraded":"2024-09-15T22:30:25.528372+0000","last_fullsized":"2024-09-15T22:30:25.528372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:17.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.647003+0000","last_change":"2024-09-15T22:30:21.089063+0000","last_active":"2024-09-15T22:30:36.647003+0000","last_peered":"2024-09-15T22:30:36.647003+0000","last_clean":"2024-09-15T22:30:36.647003+0000","last_became_active":"2024-09-15T22:30:21.088697+0000","last_became_peered":"2024-09-15T22:30:21.088697+0000","last_unstale":"2024-09-15T22:30:36.647003+0000","last_undegraded":"2024-09-15T22:30:36.647003+0000","last_fullsized":"2024-09-15T22:30:36.647003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:23.325725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.532088+0000","last_change":"2024-09-15T22:30:23.528039+0000","last_active":"2024-09-15T22:30:25.532088+0000","last_peered":"2024-09-15T22:30:25.532088+0000","last_clean":"2024-09-15T22:30:25.532088+0000","last_became_active":"2024-09-15T22:30:23.527724+0000","last_became_peered":"2024-09-15T22:30:23.527724+0000","last_unstale":"2024-09-15T22:30:25.532088+0000","last_undegraded":"2024-09-15T22:30:25.532088+0000","last_fullsized":"2024-09-15T22:30:25.532088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.935247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:37.649438+0000","last_change":"2024-09-15T22:30:21.082669+0000","last_active":"2024-09-15T22:30:37.649438+0000","last_peered":"2024-09-15T22:30:37.649438+0000","last_clean":"2024-09-15T22:30:37.649438+0000","last_became_active":"2024-09-15T22:30:21.082320+0000","last_became_peered":"2024-09-15T22:30:21.082320+0000","last_unstale":"2024-09-15T22:30:37.649438+0000","last_undegraded":"2024-09-15T22:30:37.649438+0000","last_fullsized":"2024-09-15T22:30:37.649438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:57.546498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534418+0000","last_change":"2024-09-15T22:30:23.526039+0000","last_active":"2024-09-15T22:30:25.534418+0000","last_peered":"2024-09-15T22:30:25.534418+0000","last_clean":"2024-09-15T22:30:25.534418+0000","last_became_active":"2024-09-15T22:30:23.525643+0000","last_became_peered":"2024-09-15T22:30:23.525643+0000","last_unstale":"2024-09-15T22:30:25.534418+0000","last_undegraded":"2024-09-15T22:30:25.534418+0000","last_fullsized":"2024-09-15T22:30:25.534418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:21:18.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534106+0000","last_change":"2024-09-15T22:30:21.082098+0000","last_active":"2024-09-15T22:30:25.534106+0000","last_peered":"2024-09-15T22:30:25.534106+0000","last_clean":"2024-09-15T22:30:25.534106+0000","last_became_active":"2024-09-15T22:30:21.081079+0000","last_became_peered":"2024-09-15T22:30:21.081079+0000","last_unstale":"2024-09-15T22:30:25.534106+0000","last_undegraded":"2024-09-15T22:30:25.534106+0000","last_fullsized":"2024-09-15T22:30:25.534106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:23.531646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529247+0000","last_change":"2024-09-15T22:30:23.525455+0000","last_active":"2024-09-15T22:30:25.529247+0000","last_peered":"2024-09-15T22:30:25.529247+0000","last_clean":"2024-09-15T22:30:25.529247+0000","last_became_active":"2024-09-15T22:30:23.525010+0000","last_became_peered":"2024-09-15T22:30:23.525010+0000","last_unstale":"2024-09-15T22:30:25.529247+0000","last_undegraded":"2024-09-15T22:30:25.529247+0000","last_fullsized":"2024-09-15T22:30:25.529247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.783445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534381+0000","last_change":"2024-09-15T22:30:21.081906+0000","last_active":"2024-09-15T22:30:25.534381+0000","last_peered":"2024-09-15T22:30:25.534381+0000","last_clean":"2024-09-15T22:30:25.534381+0000","last_became_active":"2024-09-15T22:30:21.081508+0000","last_became_peered":"2024-09-15T22:30:21.081508+0000","last_unstale":"2024-09-15T22:30:25.534381+0000","last_undegraded":"2024-09-15T22:30:25.534381+0000","last_fullsized":"2024-09-15T22:30:25.534381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:10.781416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528969+0000","last_change":"2024-09-15T22:30:23.534015+0000","last_active":"2024-09-15T22:30:25.528969+0000","last_peered":"2024-09-15T22:30:25.528969+0000","last_clean":"2024-09-15T22:30:25.528969+0000","last_became_active":"2024-09-15T22:30:23.533273+0000","last_became_peered":"2024-09-15T22:30:23.533273+0000","last_unstale":"2024-09-15T22:30:25.528969+0000","last_undegraded":"2024-09-15T22:30:25.528969+0000","last_fullsized":"2024-09-15T22:30:25.528969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.752276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.647052+0000","last_change":"2024-09-15T22:30:21.099447+0000","last_active":"2024-09-15T22:30:36.647052+0000","last_peered":"2024-09-15T22:30:36.647052+0000","last_clean":"2024-09-15T22:30:36.647052+0000","last_became_active":"2024-09-15T22:30:21.099060+0000","last_became_peered":"2024-09-15T22:30:21.099060+0000","last_unstale":"2024-09-15T22:30:36.647052+0000","last_undegraded":"2024-09-15T22:30:36.647052+0000","last_fullsized":"2024-09-15T22:30:36.647052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:28.878596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529787+0000","last_change":"2024-09-15T22:30:23.528034+0000","last_active":"2024-09-15T22:30:25.529787+0000","last_peered":"2024-09-15T22:30:25.529787+0000","last_clean":"2024-09-15T22:30:25.529787+0000","last_became_active":"2024-09-15T22:30:23.527665+0000","last_became_peered":"2024-09-15T22:30:23.527665+0000","last_unstale":"2024-09-15T22:30:25.529787+0000","last_undegraded":"2024-09-15T22:30:25.529787+0000","last_fullsized":"2024-09-15T22:30:25.529787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:34.827296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528697+0000","last_change":"2024-09-15T22:29:04.533047+0000","last_active":"2024-09-15T22:30:25.528697+0000","last_peered":"2024-09-15T22:30:25.528697+0000","last_clean":"2024-09-15T22:30:25.528697+0000","last_became_active":"2024-09-15T22:29:04.532535+0000","last_became_peered":"2024-09-15T22:29:04.532535+0000","last_unstale":"2024-09-15T22:30:25.528697+0000","last_undegraded":"2024-09-15T22:30:25.528697+0000","last_fullsized":"2024-09-15T22:30:25.528697+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_clean_scrub_stamp":"2024-09-15T22:25:32.270999+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:13.428305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:37.649266+0000","last_change":"2024-09-15T22:30:21.080635+0000","last_active":"2024-09-15T22:30:37.649266+0000","last_peered":"2024-09-15T22:30:37.649266+0000","last_clean":"2024-09-15T22:30:37.649266+0000","last_became_active":"2024-09-15T22:30:21.080297+0000","last_became_peered":"2024-09-15T22:30:21.080297+0000","last_unstale":"2024-09-15T22:30:37.649266+0000","last_undegraded":"2024-09-15T22:30:37.649266+0000","last_fullsized":"2024-09-15T22:30:37.649266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:37.358138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535241+0000","last_change":"2024-09-15T22:30:23.529660+0000","last_active":"2024-09-15T22:30:25.535241+0000","last_peered":"2024-09-15T22:30:25.535241+0000","last_clean":"2024-09-15T22:30:25.535241+0000","last_became_active":"2024-09-15T22:30:23.529363+0000","last_became_peered":"2024-09-15T22:30:23.529363+0000","last_unstale":"2024-09-15T22:30:25.535241+0000","last_undegraded":"2024-09-15T22:30:25.535241+0000","last_fullsized":"2024-09-15T22:30:25.535241+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:20.301523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.644411+0000","last_change":"2024-09-15T22:30:21.083261+0000","last_active":"2024-09-15T22:30:36.644411+0000","last_peered":"2024-09-15T22:30:36.644411+0000","last_clean":"2024-09-15T22:30:36.644411+0000","last_became_active":"2024-09-15T22:30:21.082517+0000","last_became_peered":"2024-09-15T22:30:21.082517+0000","last_unstale":"2024-09-15T22:30:36.644411+0000","last_undegraded":"2024-09-15T22:30:36.644411+0000","last_fullsized":"2024-09-15T22:30:36.644411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:32.825877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515614+0000","last_change":"2024-09-15T22:30:23.535666+0000","last_active":"2024-09-15T22:30:25.515614+0000","last_peered":"2024-09-15T22:30:25.515614+0000","last_clean":"2024-09-15T22:30:25.515614+0000","last_became_active":"2024-09-15T22:30:23.532795+0000","last_became_peered":"2024-09-15T22:30:23.532795+0000","last_unstale":"2024-09-15T22:30:25.515614+0000","last_undegraded":"2024-09-15T22:30:25.515614+0000","last_fullsized":"2024-09-15T22:30:25.515614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:46.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:52.673632+0000","last_change":"2024-09-15T22:30:21.089614+0000","last_active":"2024-09-15T22:30:52.673632+0000","last_peered":"2024-09-15T22:30:52.673632+0000","last_clean":"2024-09-15T22:30:52.673632+0000","last_became_active":"2024-09-15T22:30:21.089252+0000","last_became_peered":"2024-09-15T22:30:21.089252+0000","last_unstale":"2024-09-15T22:30:52.673632+0000","last_undegraded":"2024-09-15T22:30:52.673632+0000","last_fullsized":"2024-09-15T22:30:52.673632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:48.491093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531377+0000","last_change":"2024-09-15T22:30:23.524558+0000","last_active":"2024-09-15T22:30:25.531377+0000","last_peered":"2024-09-15T22:30:25.531377+0000","last_clean":"2024-09-15T22:30:25.531377+0000","last_became_active":"2024-09-15T22:30:23.524237+0000","last_became_peered":"2024-09-15T22:30:23.524237+0000","last_unstale":"2024-09-15T22:30:25.531377+0000","last_undegraded":"2024-09-15T22:30:25.531377+0000","last_fullsized":"2024-09-15T22:30:25.531377+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:48.956855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529249+0000","last_change":"2024-09-15T22:30:21.084749+0000","last_active":"2024-09-15T22:30:25.529249+0000","last_peered":"2024-09-15T22:30:25.529249+0000","last_clean":"2024-09-15T22:30:25.529249+0000","last_became_active":"2024-09-15T22:30:21.083677+0000","last_became_peered":"2024-09-15T22:30:21.083677+0000","last_unstale":"2024-09-15T22:30:25.529249+0000","last_undegraded":"2024-09-15T22:30:25.529249+0000","last_fullsized":"2024-09-15T22:30:25.529249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:56.534120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529234+0000","last_change":"2024-09-15T22:30:23.525625+0000","last_active":"2024-09-15T22:30:25.529234+0000","last_peered":"2024-09-15T22:30:25.529234+0000","last_clean":"2024-09-15T22:30:25.529234+0000","last_became_active":"2024-09-15T22:30:23.525314+0000","last_became_peered":"2024-09-15T22:30:23.525314+0000","last_unstale":"2024-09-15T22:30:25.529234+0000","last_undegraded":"2024-09-15T22:30:25.529234+0000","last_fullsized":"2024-09-15T22:30:25.529234+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:37.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529734+0000","last_change":"2024-09-15T22:30:21.089819+0000","last_active":"2024-09-15T22:30:25.529734+0000","last_peered":"2024-09-15T22:30:25.529734+0000","last_clean":"2024-09-15T22:30:25.529734+0000","last_became_active":"2024-09-15T22:30:21.089432+0000","last_became_peered":"2024-09-15T22:30:21.089432+0000","last_unstale":"2024-09-15T22:30:25.529734+0000","last_undegraded":"2024-09-15T22:30:25.529734+0000","last_fullsized":"2024-09-15T22:30:25.529734+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:18.317959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:26.210539+0000","last_change":"2024-09-15T22:30:23.532949+0000","last_active":"2024-09-15T22:30:26.210539+0000","last_peered":"2024-09-15T22:30:26.210539+0000","last_clean":"2024-09-15T22:30:26.210539+0000","last_became_active":"2024-09-15T22:30:23.532622+0000","last_became_peered":"2024-09-15T22:30:23.532622+0000","last_unstale":"2024-09-15T22:30:26.210539+0000","last_undegraded":"2024-09-15T22:30:26.210539+0000","last_fullsized":"2024-09-15T22:30:26.210539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:57.296048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.638959+0000","last_change":"2024-09-15T22:30:21.091151+0000","last_active":"2024-09-15T22:30:35.638959+0000","last_peered":"2024-09-15T22:30:35.638959+0000","last_clean":"2024-09-15T22:30:35.638959+0000","last_became_active":"2024-09-15T22:30:21.090776+0000","last_became_peered":"2024-09-15T22:30:21.090776+0000","last_unstale":"2024-09-15T22:30:35.638959+0000","last_undegraded":"2024-09-15T22:30:35.638959+0000","last_fullsized":"2024-09-15T22:30:35.638959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:16.882946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515965+0000","last_change":"2024-09-15T22:30:23.522118+0000","last_active":"2024-09-15T22:30:25.515965+0000","last_peered":"2024-09-15T22:30:25.515965+0000","last_clean":"2024-09-15T22:30:25.515965+0000","last_became_active":"2024-09-15T22:30:23.521592+0000","last_became_peered":"2024-09-15T22:30:23.521592+0000","last_unstale":"2024-09-15T22:30:25.515965+0000","last_undegraded":"2024-09-15T22:30:25.515965+0000","last_fullsized":"2024-09-15T22:30:25.515965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:31.331703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'9","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:51.530905+0000","last_change":"2024-09-15T22:30:21.083399+0000","last_active":"2024-09-15T22:30:51.530905+0000","last_peered":"2024-09-15T22:30:51.530905+0000","last_clean":"2024-09-15T22:30:51.530905+0000","last_became_active":"2024-09-15T22:30:21.082863+0000","last_became_peered":"2024-09-15T22:30:21.082863+0000","last_unstale":"2024-09-15T22:30:51.530905+0000","last_undegraded":"2024-09-15T22:30:51.530905+0000","last_fullsized":"2024-09-15T22:30:51.530905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:51.895900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.536456+0000","last_change":"2024-09-15T22:30:23.530220+0000","last_active":"2024-09-15T22:30:25.536456+0000","last_peered":"2024-09-15T22:30:25.536456+0000","last_clean":"2024-09-15T22:30:25.536456+0000","last_became_active":"2024-09-15T22:30:23.529917+0000","last_became_peered":"2024-09-15T22:30:23.529917+0000","last_unstale":"2024-09-15T22:30:25.536456+0000","last_undegraded":"2024-09-15T22:30:25.536456+0000","last_fullsized":"2024-09-15T22:30:25.536456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:33.394454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.638546+0000","last_change":"2024-09-15T22:30:21.099112+0000","last_active":"2024-09-15T22:30:35.638546+0000","last_peered":"2024-09-15T22:30:35.638546+0000","last_clean":"2024-09-15T22:30:35.638546+0000","last_became_active":"2024-09-15T22:30:21.098814+0000","last_became_peered":"2024-09-15T22:30:21.098814+0000","last_unstale":"2024-09-15T22:30:35.638546+0000","last_undegraded":"2024-09-15T22:30:35.638546+0000","last_fullsized":"2024-09-15T22:30:35.638546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:52.202768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529630+0000","last_change":"2024-09-15T22:30:23.540456+0000","last_active":"2024-09-15T22:30:25.529630+0000","last_peered":"2024-09-15T22:30:25.529630+0000","last_clean":"2024-09-15T22:30:25.529630+0000","last_became_active":"2024-09-15T22:30:23.538273+0000","last_became_peered":"2024-09-15T22:30:23.538273+0000","last_unstale":"2024-09-15T22:30:25.529630+0000","last_undegraded":"2024-09-15T22:30:25.529630+0000","last_fullsized":"2024-09-15T22:30:25.529630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:21.507592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.640231+0000","last_change":"2024-09-15T22:30:21.088934+0000","last_active":"2024-09-15T22:30:35.640231+0000","last_peered":"2024-09-15T22:30:35.640231+0000","last_clean":"2024-09-15T22:30:35.640231+0000","last_became_active":"2024-09-15T22:30:21.088629+0000","last_became_peered":"2024-09-15T22:30:21.088629+0000","last_unstale":"2024-09-15T22:30:35.640231+0000","last_undegraded":"2024-09-15T22:30:35.640231+0000","last_fullsized":"2024-09-15T22:30:35.640231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:12.430279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518193+0000","last_change":"2024-09-15T22:30:23.523023+0000","last_active":"2024-09-15T22:30:25.518193+0000","last_peered":"2024-09-15T22:30:25.518193+0000","last_clean":"2024-09-15T22:30:25.518193+0000","last_became_active":"2024-09-15T22:30:23.522674+0000","last_became_peered":"2024-09-15T22:30:23.522674+0000","last_unstale":"2024-09-15T22:30:25.518193+0000","last_undegraded":"2024-09-15T22:30:25.518193+0000","last_fullsized":"2024-09-15T22:30:25.518193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:34.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.642631+0000","last_change":"2024-09-15T22:30:21.084287+0000","last_active":"2024-09-15T22:30:35.642631+0000","last_peered":"2024-09-15T22:30:35.642631+0000","last_clean":"2024-09-15T22:30:35.642631+0000","last_became_active":"2024-09-15T22:30:21.083686+0000","last_became_peered":"2024-09-15T22:30:21.083686+0000","last_unstale":"2024-09-15T22:30:35.642631+0000","last_undegraded":"2024-09-15T22:30:35.642631+0000","last_fullsized":"2024-09-15T22:30:35.642631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:18.737268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534242+0000","last_change":"2024-09-15T22:30:23.529327+0000","last_active":"2024-09-15T22:30:25.534242+0000","last_peered":"2024-09-15T22:30:25.534242+0000","last_clean":"2024-09-15T22:30:25.534242+0000","last_became_active":"2024-09-15T22:30:23.529013+0000","last_became_peered":"2024-09-15T22:30:23.529013+0000","last_unstale":"2024-09-15T22:30:25.534242+0000","last_undegraded":"2024-09-15T22:30:25.534242+0000","last_fullsized":"2024-09-15T22:30:25.534242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:39.722197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529191+0000","last_change":"2024-09-15T22:30:21.081443+0000","last_active":"2024-09-15T22:30:25.529191+0000","last_peered":"2024-09-15T22:30:25.529191+0000","last_clean":"2024-09-15T22:30:25.529191+0000","last_became_active":"2024-09-15T22:30:21.081105+0000","last_became_peered":"2024-09-15T22:30:21.081105+0000","last_unstale":"2024-09-15T22:30:25.529191+0000","last_undegraded":"2024-09-15T22:30:25.529191+0000","last_fullsized":"2024-09-15T22:30:25.529191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:56.796153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535103+0000","last_change":"2024-09-15T22:30:23.533866+0000","last_active":"2024-09-15T22:30:25.535103+0000","last_peered":"2024-09-15T22:30:25.535103+0000","last_clean":"2024-09-15T22:30:25.535103+0000","last_became_active":"2024-09-15T22:30:23.533541+0000","last_became_peered":"2024-09-15T22:30:23.533541+0000","last_unstale":"2024-09-15T22:30:25.535103+0000","last_undegraded":"2024-09-15T22:30:25.535103+0000","last_fullsized":"2024-09-15T22:30:25.535103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:26.923241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.639834+0000","last_change":"2024-09-15T22:30:21.084794+0000","last_active":"2024-09-15T22:30:35.639834+0000","last_peered":"2024-09-15T22:30:35.639834+0000","last_clean":"2024-09-15T22:30:35.639834+0000","last_became_active":"2024-09-15T22:30:21.083415+0000","last_became_peered":"2024-09-15T22:30:21.083415+0000","last_unstale":"2024-09-15T22:30:35.639834+0000","last_undegraded":"2024-09-15T22:30:35.639834+0000","last_fullsized":"2024-09-15T22:30:35.639834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:13.689217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528913+0000","last_change":"2024-09-15T22:30:23.527870+0000","last_active":"2024-09-15T22:30:25.528913+0000","last_peered":"2024-09-15T22:30:25.528913+0000","last_clean":"2024-09-15T22:30:25.528913+0000","last_became_active":"2024-09-15T22:30:23.527529+0000","last_became_peered":"2024-09-15T22:30:23.527529+0000","last_unstale":"2024-09-15T22:30:25.528913+0000","last_undegraded":"2024-09-15T22:30:25.528913+0000","last_fullsized":"2024-09-15T22:30:25.528913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:30.086127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529807+0000","last_change":"2024-09-15T22:30:23.528943+0000","last_active":"2024-09-15T22:30:25.529807+0000","last_peered":"2024-09-15T22:30:25.529807+0000","last_clean":"2024-09-15T22:30:25.529807+0000","last_became_active":"2024-09-15T22:30:23.528578+0000","last_became_peered":"2024-09-15T22:30:23.528578+0000","last_unstale":"2024-09-15T22:30:25.529807+0000","last_undegraded":"2024-09-15T22:30:25.529807+0000","last_fullsized":"2024-09-15T22:30:25.529807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:37.832903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.530457+0000","last_change":"2024-09-15T22:30:21.085166+0000","last_active":"2024-09-15T22:30:25.530457+0000","last_peered":"2024-09-15T22:30:25.530457+0000","last_clean":"2024-09-15T22:30:25.530457+0000","last_became_active":"2024-09-15T22:30:21.083482+0000","last_became_peered":"2024-09-15T22:30:21.083482+0000","last_unstale":"2024-09-15T22:30:25.530457+0000","last_undegraded":"2024-09-15T22:30:25.530457+0000","last_fullsized":"2024-09-15T22:30:25.530457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:47.430411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515885+0000","last_change":"2024-09-15T22:30:23.523096+0000","last_active":"2024-09-15T22:30:25.515885+0000","last_peered":"2024-09-15T22:30:25.515885+0000","last_clean":"2024-09-15T22:30:25.515885+0000","last_became_active":"2024-09-15T22:30:23.522736+0000","last_became_peered":"2024-09-15T22:30:23.522736+0000","last_unstale":"2024-09-15T22:30:25.515885+0000","last_undegraded":"2024-09-15T22:30:25.515885+0000","last_fullsized":"2024-09-15T22:30:25.515885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:06.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645200+0000","last_change":"2024-09-15T22:30:21.083395+0000","last_active":"2024-09-15T22:30:36.645200+0000","last_peered":"2024-09-15T22:30:36.645200+0000","last_clean":"2024-09-15T22:30:36.645200+0000","last_became_active":"2024-09-15T22:30:21.083083+0000","last_became_peered":"2024-09-15T22:30:21.083083+0000","last_unstale":"2024-09-15T22:30:36.645200+0000","last_undegraded":"2024-09-15T22:30:36.645200+0000","last_fullsized":"2024-09-15T22:30:36.645200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:41.170212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529690+0000","last_change":"2024-09-15T22:30:23.533926+0000","last_active":"2024-09-15T22:30:25.529690+0000","last_peered":"2024-09-15T22:30:25.529690+0000","last_clean":"2024-09-15T22:30:25.529690+0000","last_became_active":"2024-09-15T22:30:23.533640+0000","last_became_peered":"2024-09-15T22:30:23.533640+0000","last_unstale":"2024-09-15T22:30:25.529690+0000","last_undegraded":"2024-09-15T22:30:25.529690+0000","last_fullsized":"2024-09-15T22:30:25.529690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:07.684910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.538024+0000","last_change":"2024-09-15T22:30:21.090319+0000","last_active":"2024-09-15T22:30:25.538024+0000","last_peered":"2024-09-15T22:30:25.538024+0000","last_clean":"2024-09-15T22:30:25.538024+0000","last_became_active":"2024-09-15T22:30:21.089301+0000","last_became_peered":"2024-09-15T22:30:21.089301+0000","last_unstale":"2024-09-15T22:30:25.538024+0000","last_undegraded":"2024-09-15T22:30:25.538024+0000","last_fullsized":"2024-09-15T22:30:25.538024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:16.501805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.536379+0000","last_change":"2024-09-15T22:30:23.531710+0000","last_active":"2024-09-15T22:30:25.536379+0000","last_peered":"2024-09-15T22:30:25.536379+0000","last_clean":"2024-09-15T22:30:25.536379+0000","last_became_active":"2024-09-15T22:30:23.531400+0000","last_became_peered":"2024-09-15T22:30:23.531400+0000","last_unstale":"2024-09-15T22:30:25.536379+0000","last_undegraded":"2024-09-15T22:30:25.536379+0000","last_fullsized":"2024-09-15T22:30:25.536379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:11.865981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645407+0000","last_change":"2024-09-15T22:30:21.083039+0000","last_active":"2024-09-15T22:30:36.645407+0000","last_peered":"2024-09-15T22:30:36.645407+0000","last_clean":"2024-09-15T22:30:36.645407+0000","last_became_active":"2024-09-15T22:30:21.082634+0000","last_became_peered":"2024-09-15T22:30:21.082634+0000","last_unstale":"2024-09-15T22:30:36.645407+0000","last_undegraded":"2024-09-15T22:30:36.645407+0000","last_fullsized":"2024-09-15T22:30:36.645407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:01.545563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54115,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":116,"num_read_kb":115,"num_write":155,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":162345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645330,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":416251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41012,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704140,"statfs":{"total":95995035648,"available":95953039360,"internally_reserved":0,"allocated":1544192,"data_stored":1058237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005085,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":416487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234019,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":416407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36776,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708376,"statfs":{"total":95995035648,"available":95957377024,"internally_reserved":0,"allocated":1466368,"data_stored":1008339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626477,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":415876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855411,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1007630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018935,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":416706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247869,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":416187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444099,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":467131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":465781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":417147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:30:57.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:30:58.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:57 smithi022 ceph-mon[30634]: from='client.24682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:30:58.068 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:30:58.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:57 smithi112 ceph-mon[35032]: from='client.24682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:30:58.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:57 smithi110 ceph-mon[35282]: from='client.24682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 -- 172.21.15.22:0/2213801524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c24074e30 msgr2=0x7f8c2410dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 --2- 172.21.15.22:0/2213801524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c24074e30 0x7f8c2410dd40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009900 tx=0x7f8c0c02a480 comp rx=0 tx=0).stop 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 -- 172.21.15.22:0/2213801524 shutdown_connections 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 --2- 172.21.15.22:0/2213801524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c2410e280 0x7f8c24110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 --2- 172.21.15.22:0/2213801524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c24074e30 0x7f8c2410dd40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 --2- 172.21.15.22:0/2213801524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c24074510 0x7f8c240748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 -- 172.21.15.22:0/2213801524 >> 172.21.15.22:0/2213801524 conn(0x7f8c240fd740 msgr2=0x7f8c240ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 -- 172.21.15.22:0/2213801524 shutdown_connections 2024-09-15T22:30:58.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.614+0000 7f8c23200640 1 -- 172.21.15.22:0/2213801524 wait complete. 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.615+0000 7f8c23200640 1 Processor -- start 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.615+0000 7f8c23200640 1 -- start start 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c23200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c24074510 0x7f8c2419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c23200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c24074e30 0x7f8c2419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c23200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 0x7f8c2419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c23200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24113f70 con 0x7f8c2410e280 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c23200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24113df0 con 0x7f8c24074510 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c23200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c241140f0 con 0x7f8c24074e30 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 0x7f8c2419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c21e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c24074510 0x7f8c2419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 0x7f8c2419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42846/0 (socket says 172.21.15.22:42846) 2024-09-15T22:30:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 -- 172.21.15.22:0/3330875171 learned_addr learned my addr 172.21.15.22:0/3330875171 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:30:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c19400640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c24074e30 0x7f8c2419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 -- 172.21.15.22:0/3330875171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c24074e30 msgr2=0x7f8c2419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c24074e30 0x7f8c2419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 -- 172.21.15.22:0/3330875171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c24074510 msgr2=0x7f8c2419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c24074510 0x7f8c2419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.616+0000 7f8c22800640 1 -- 172.21.15.22:0/3330875171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2419f520 con 0x7f8c2410e280 2024-09-15T22:30:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c21e00640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c24074510 0x7f8c2419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:30:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c22800640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 0x7f8c2419ee40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00eb40 tx=0x7f8c1c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c004b20 con 0x7f8c2410e280 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c1c004cc0 con 0x7f8c2410e280 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2419f810 con 0x7f8c2410e280 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c010850 con 0x7f8c2410e280 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.617+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c241a70f0 con 0x7f8c2410e280 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.619+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c240748f0 con 0x7f8c2410e280 2024-09-15T22:30:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.620+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8c1c005020 con 0x7f8c2410e280 2024-09-15T22:30:58.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.622+0000 7f8c1b400640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c080a32d0 0x7f8c080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:30:58.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.622+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f8c1c0d0180 con 0x7f8c2410e280 2024-09-15T22:30:58.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.622+0000 7f8c21e00640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c080a32d0 0x7f8c080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:30:58.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.623+0000 7f8c21e00640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c080a32d0 0x7f8c080a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009fc0 tx=0x7f8c14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:30:58.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.626+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c1c09cdf0 con 0x7f8c2410e280 2024-09-15T22:30:58.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:58 smithi022 ceph-mon[30634]: pgmap v303: 97 pgs: 97 active+clean; 634 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-15T22:30:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.812+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c24062630 con 0x7f8c080a32d0 2024-09-15T22:30:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.819+0000 7f8c1b400640 1 -- 172.21.15.22:0/3330875171 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258700 (secure 0 0 0) 0x7f8c24062630 con 0x7f8c080a32d0 2024-09-15T22:30:58.822 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:30:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c080a32d0 msgr2=0x7f8c080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c080a32d0 0x7f8c080a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009fc0 tx=0x7f8c14005f90 comp rx=0 tx=0).stop 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 msgr2=0x7f8c2419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 0x7f8c2419ee40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00eb40 tx=0x7f8c1c00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 shutdown_connections 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c24074e30 0x7f8c2419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c080a32d0 0x7f8c080a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c2410e280 0x7f8c2419ee40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 --2- 172.21.15.22:0/3330875171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c24074510 0x7f8c2419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:30:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 >> 172.21.15.22:0/3330875171 conn(0x7f8c240fd740 msgr2=0x7f8c240fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:30:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 shutdown_connections 2024-09-15T22:30:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:30:58.823+0000 7f8c23200640 1 -- 172.21.15.22:0/3330875171 wait complete. 2024-09-15T22:30:59.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:58 smithi112 ceph-mon[35032]: pgmap v303: 97 pgs: 97 active+clean; 634 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-15T22:30:59.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:58 smithi110 ceph-mon[35282]: pgmap v303: 97 pgs: 97 active+clean; 634 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-15T22:30:59.697 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-15T22:30:57.553518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648974,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":263,"num_read_kb":239,"num_write":339,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":423792,"kb_used_data":12144,"kb_used_omap":18,"kb_used_meta":411437,"kb_avail":1124518032,"statfs":{"total":1151940427776,"available":1151506464768,"internally_reserved":0,"allocated":12435456,"data_stored":6934950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":421311802},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53384,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":95,"num_write":31,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003065"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535076+0000","last_change":"2024-09-15T22:30:23.540766+0000","last_active":"2024-09-15T22:30:25.535076+0000","last_peered":"2024-09-15T22:30:25.535076+0000","last_clean":"2024-09-15T22:30:25.535076+0000","last_became_active":"2024-09-15T22:30:23.540425+0000","last_became_peered":"2024-09-15T22:30:23.540425+0000","last_unstale":"2024-09-15T22:30:25.535076+0000","last_undegraded":"2024-09-15T22:30:25.535076+0000","last_fullsized":"2024-09-15T22:30:25.535076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:50.650220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529214+0000","last_change":"2024-09-15T22:30:23.533484+0000","last_active":"2024-09-15T22:30:25.529214+0000","last_peered":"2024-09-15T22:30:25.529214+0000","last_clean":"2024-09-15T22:30:25.529214+0000","last_became_active":"2024-09-15T22:30:23.532995+0000","last_became_peered":"2024-09-15T22:30:23.532995+0000","last_unstale":"2024-09-15T22:30:25.529214+0000","last_undegraded":"2024-09-15T22:30:25.529214+0000","last_fullsized":"2024-09-15T22:30:25.529214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:42.108789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529265+0000","last_change":"2024-09-15T22:30:23.529206+0000","last_active":"2024-09-15T22:30:25.529265+0000","last_peered":"2024-09-15T22:30:25.529265+0000","last_clean":"2024-09-15T22:30:25.529265+0000","last_became_active":"2024-09-15T22:30:23.528894+0000","last_became_peered":"2024-09-15T22:30:23.528894+0000","last_unstale":"2024-09-15T22:30:25.529265+0000","last_undegraded":"2024-09-15T22:30:25.529265+0000","last_fullsized":"2024-09-15T22:30:25.529265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:53.130553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531866+0000","last_change":"2024-09-15T22:30:23.529406+0000","last_active":"2024-09-15T22:30:25.531866+0000","last_peered":"2024-09-15T22:30:25.531866+0000","last_clean":"2024-09-15T22:30:25.531866+0000","last_became_active":"2024-09-15T22:30:23.529074+0000","last_became_peered":"2024-09-15T22:30:23.529074+0000","last_unstale":"2024-09-15T22:30:25.531866+0000","last_undegraded":"2024-09-15T22:30:25.531866+0000","last_fullsized":"2024-09-15T22:30:25.531866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:55.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518281+0000","last_change":"2024-09-15T22:30:23.525342+0000","last_active":"2024-09-15T22:30:25.518281+0000","last_peered":"2024-09-15T22:30:25.518281+0000","last_clean":"2024-09-15T22:30:25.518281+0000","last_became_active":"2024-09-15T22:30:23.524983+0000","last_became_peered":"2024-09-15T22:30:23.524983+0000","last_unstale":"2024-09-15T22:30:25.518281+0000","last_undegraded":"2024-09-15T22:30:25.518281+0000","last_fullsized":"2024-09-15T22:30:25.518281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:57.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528931+0000","last_change":"2024-09-15T22:30:23.522364+0000","last_active":"2024-09-15T22:30:25.528931+0000","last_peered":"2024-09-15T22:30:25.528931+0000","last_clean":"2024-09-15T22:30:25.528931+0000","last_became_active":"2024-09-15T22:30:23.522018+0000","last_became_peered":"2024-09-15T22:30:23.522018+0000","last_unstale":"2024-09-15T22:30:25.528931+0000","last_undegraded":"2024-09-15T22:30:25.528931+0000","last_fullsized":"2024-09-15T22:30:25.528931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:24.373042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529276+0000","last_change":"2024-09-15T22:30:23.531767+0000","last_active":"2024-09-15T22:30:25.529276+0000","last_peered":"2024-09-15T22:30:25.529276+0000","last_clean":"2024-09-15T22:30:25.529276+0000","last_became_active":"2024-09-15T22:30:23.530522+0000","last_became_peered":"2024-09-15T22:30:23.530522+0000","last_unstale":"2024-09-15T22:30:25.529276+0000","last_undegraded":"2024-09-15T22:30:25.529276+0000","last_fullsized":"2024-09-15T22:30:25.529276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:16.225467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534779+0000","last_change":"2024-09-15T22:30:23.528714+0000","last_active":"2024-09-15T22:30:25.534779+0000","last_peered":"2024-09-15T22:30:25.534779+0000","last_clean":"2024-09-15T22:30:25.534779+0000","last_became_active":"2024-09-15T22:30:23.528412+0000","last_became_peered":"2024-09-15T22:30:23.528412+0000","last_unstale":"2024-09-15T22:30:25.534779+0000","last_undegraded":"2024-09-15T22:30:25.534779+0000","last_fullsized":"2024-09-15T22:30:25.534779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:25.020500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516335+0000","last_change":"2024-09-15T22:30:23.523940+0000","last_active":"2024-09-15T22:30:25.516335+0000","last_peered":"2024-09-15T22:30:25.516335+0000","last_clean":"2024-09-15T22:30:25.516335+0000","last_became_active":"2024-09-15T22:30:23.522682+0000","last_became_peered":"2024-09-15T22:30:23.522682+0000","last_unstale":"2024-09-15T22:30:25.516335+0000","last_undegraded":"2024-09-15T22:30:25.516335+0000","last_fullsized":"2024-09-15T22:30:25.516335+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:48.164040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528938+0000","last_change":"2024-09-15T22:30:23.524927+0000","last_active":"2024-09-15T22:30:25.528938+0000","last_peered":"2024-09-15T22:30:25.528938+0000","last_clean":"2024-09-15T22:30:25.528938+0000","last_became_active":"2024-09-15T22:30:23.524578+0000","last_became_peered":"2024-09-15T22:30:23.524578+0000","last_unstale":"2024-09-15T22:30:25.528938+0000","last_undegraded":"2024-09-15T22:30:25.528938+0000","last_fullsized":"2024-09-15T22:30:25.528938+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:15.093534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529650+0000","last_change":"2024-09-15T22:30:23.527258+0000","last_active":"2024-09-15T22:30:25.529650+0000","last_peered":"2024-09-15T22:30:25.529650+0000","last_clean":"2024-09-15T22:30:25.529650+0000","last_became_active":"2024-09-15T22:30:23.526842+0000","last_became_peered":"2024-09-15T22:30:23.526842+0000","last_unstale":"2024-09-15T22:30:25.529650+0000","last_undegraded":"2024-09-15T22:30:25.529650+0000","last_fullsized":"2024-09-15T22:30:25.529650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:45.861445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.532033+0000","last_change":"2024-09-15T22:30:23.524525+0000","last_active":"2024-09-15T22:30:25.532033+0000","last_peered":"2024-09-15T22:30:25.532033+0000","last_clean":"2024-09-15T22:30:25.532033+0000","last_became_active":"2024-09-15T22:30:23.523915+0000","last_became_peered":"2024-09-15T22:30:23.523915+0000","last_unstale":"2024-09-15T22:30:25.532033+0000","last_undegraded":"2024-09-15T22:30:25.532033+0000","last_fullsized":"2024-09-15T22:30:25.532033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:24.954632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516041+0000","last_change":"2024-09-15T22:30:23.522262+0000","last_active":"2024-09-15T22:30:25.516041+0000","last_peered":"2024-09-15T22:30:25.516041+0000","last_clean":"2024-09-15T22:30:25.516041+0000","last_became_active":"2024-09-15T22:30:23.521919+0000","last_became_peered":"2024-09-15T22:30:23.521919+0000","last_unstale":"2024-09-15T22:30:25.516041+0000","last_undegraded":"2024-09-15T22:30:25.516041+0000","last_fullsized":"2024-09-15T22:30:25.516041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:48.362426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529662+0000","last_change":"2024-09-15T22:30:23.526652+0000","last_active":"2024-09-15T22:30:25.529662+0000","last_peered":"2024-09-15T22:30:25.529662+0000","last_clean":"2024-09-15T22:30:25.529662+0000","last_became_active":"2024-09-15T22:30:23.526204+0000","last_became_peered":"2024-09-15T22:30:23.526204+0000","last_unstale":"2024-09-15T22:30:25.529662+0000","last_undegraded":"2024-09-15T22:30:25.529662+0000","last_fullsized":"2024-09-15T22:30:25.529662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:40.914567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529060+0000","last_change":"2024-09-15T22:30:23.528996+0000","last_active":"2024-09-15T22:30:25.529060+0000","last_peered":"2024-09-15T22:30:25.529060+0000","last_clean":"2024-09-15T22:30:25.529060+0000","last_became_active":"2024-09-15T22:30:23.528666+0000","last_became_peered":"2024-09-15T22:30:23.528666+0000","last_unstale":"2024-09-15T22:30:25.529060+0000","last_undegraded":"2024-09-15T22:30:25.529060+0000","last_fullsized":"2024-09-15T22:30:25.529060+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:10.895994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515801+0000","last_change":"2024-09-15T22:30:23.525288+0000","last_active":"2024-09-15T22:30:25.515801+0000","last_peered":"2024-09-15T22:30:25.515801+0000","last_clean":"2024-09-15T22:30:25.515801+0000","last_became_active":"2024-09-15T22:30:23.524956+0000","last_became_peered":"2024-09-15T22:30:23.524956+0000","last_unstale":"2024-09-15T22:30:25.515801+0000","last_undegraded":"2024-09-15T22:30:25.515801+0000","last_fullsized":"2024-09-15T22:30:25.515801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:06.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535111+0000","last_change":"2024-09-15T22:30:23.540709+0000","last_active":"2024-09-15T22:30:25.535111+0000","last_peered":"2024-09-15T22:30:25.535111+0000","last_clean":"2024-09-15T22:30:25.535111+0000","last_became_active":"2024-09-15T22:30:23.540332+0000","last_became_peered":"2024-09-15T22:30:23.540332+0000","last_unstale":"2024-09-15T22:30:25.535111+0000","last_undegraded":"2024-09-15T22:30:25.535111+0000","last_fullsized":"2024-09-15T22:30:25.535111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:46.817361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.530529+0000","last_change":"2024-09-15T22:30:23.521007+0000","last_active":"2024-09-15T22:30:25.530529+0000","last_peered":"2024-09-15T22:30:25.530529+0000","last_clean":"2024-09-15T22:30:25.530529+0000","last_became_active":"2024-09-15T22:30:23.520678+0000","last_became_peered":"2024-09-15T22:30:23.520678+0000","last_unstale":"2024-09-15T22:30:25.530529+0000","last_undegraded":"2024-09-15T22:30:25.530529+0000","last_fullsized":"2024-09-15T22:30:25.530529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:44.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528673+0000","last_change":"2024-09-15T22:30:23.528280+0000","last_active":"2024-09-15T22:30:25.528673+0000","last_peered":"2024-09-15T22:30:25.528673+0000","last_clean":"2024-09-15T22:30:25.528673+0000","last_became_active":"2024-09-15T22:30:23.527888+0000","last_became_peered":"2024-09-15T22:30:23.527888+0000","last_unstale":"2024-09-15T22:30:25.528673+0000","last_undegraded":"2024-09-15T22:30:25.528673+0000","last_fullsized":"2024-09-15T22:30:25.528673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:45.748437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534166+0000","last_change":"2024-09-15T22:30:23.525344+0000","last_active":"2024-09-15T22:30:25.534166+0000","last_peered":"2024-09-15T22:30:25.534166+0000","last_clean":"2024-09-15T22:30:25.534166+0000","last_became_active":"2024-09-15T22:30:23.525029+0000","last_became_peered":"2024-09-15T22:30:23.525029+0000","last_unstale":"2024-09-15T22:30:25.534166+0000","last_undegraded":"2024-09-15T22:30:25.534166+0000","last_fullsized":"2024-09-15T22:30:25.534166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:25.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516265+0000","last_change":"2024-09-15T22:30:23.530315+0000","last_active":"2024-09-15T22:30:25.516265+0000","last_peered":"2024-09-15T22:30:25.516265+0000","last_clean":"2024-09-15T22:30:25.516265+0000","last_became_active":"2024-09-15T22:30:23.529388+0000","last_became_peered":"2024-09-15T22:30:23.529388+0000","last_unstale":"2024-09-15T22:30:25.516265+0000","last_undegraded":"2024-09-15T22:30:25.516265+0000","last_fullsized":"2024-09-15T22:30:25.516265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:55.126701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516264+0000","last_change":"2024-09-15T22:30:23.530305+0000","last_active":"2024-09-15T22:30:25.516264+0000","last_peered":"2024-09-15T22:30:25.516264+0000","last_clean":"2024-09-15T22:30:25.516264+0000","last_became_active":"2024-09-15T22:30:23.529909+0000","last_became_peered":"2024-09-15T22:30:23.529909+0000","last_unstale":"2024-09-15T22:30:25.516264+0000","last_undegraded":"2024-09-15T22:30:25.516264+0000","last_fullsized":"2024-09-15T22:30:25.516264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:07.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534996+0000","last_change":"2024-09-15T22:30:23.524511+0000","last_active":"2024-09-15T22:30:25.534996+0000","last_peered":"2024-09-15T22:30:25.534996+0000","last_clean":"2024-09-15T22:30:25.534996+0000","last_became_active":"2024-09-15T22:30:23.524219+0000","last_became_peered":"2024-09-15T22:30:23.524219+0000","last_unstale":"2024-09-15T22:30:25.534996+0000","last_undegraded":"2024-09-15T22:30:25.534996+0000","last_fullsized":"2024-09-15T22:30:25.534996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:47.092184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.532204+0000","last_change":"2024-09-15T22:30:23.531690+0000","last_active":"2024-09-15T22:30:25.532204+0000","last_peered":"2024-09-15T22:30:25.532204+0000","last_clean":"2024-09-15T22:30:25.532204+0000","last_became_active":"2024-09-15T22:30:23.531372+0000","last_became_peered":"2024-09-15T22:30:23.531372+0000","last_unstale":"2024-09-15T22:30:25.532204+0000","last_undegraded":"2024-09-15T22:30:25.532204+0000","last_fullsized":"2024-09-15T22:30:25.532204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:11.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.536445+0000","last_change":"2024-09-15T22:30:23.538064+0000","last_active":"2024-09-15T22:30:25.536445+0000","last_peered":"2024-09-15T22:30:25.536445+0000","last_clean":"2024-09-15T22:30:25.536445+0000","last_became_active":"2024-09-15T22:30:23.537568+0000","last_became_peered":"2024-09-15T22:30:23.537568+0000","last_unstale":"2024-09-15T22:30:25.536445+0000","last_undegraded":"2024-09-15T22:30:25.536445+0000","last_fullsized":"2024-09-15T22:30:25.536445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:22.368267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528546+0000","last_change":"2024-09-15T22:30:23.528383+0000","last_active":"2024-09-15T22:30:25.528546+0000","last_peered":"2024-09-15T22:30:25.528546+0000","last_clean":"2024-09-15T22:30:25.528546+0000","last_became_active":"2024-09-15T22:30:23.527984+0000","last_became_peered":"2024-09-15T22:30:23.527984+0000","last_unstale":"2024-09-15T22:30:25.528546+0000","last_undegraded":"2024-09-15T22:30:25.528546+0000","last_fullsized":"2024-09-15T22:30:25.528546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:28.301070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534570+0000","last_change":"2024-09-15T22:30:23.526560+0000","last_active":"2024-09-15T22:30:25.534570+0000","last_peered":"2024-09-15T22:30:25.534570+0000","last_clean":"2024-09-15T22:30:25.534570+0000","last_became_active":"2024-09-15T22:30:23.526226+0000","last_became_peered":"2024-09-15T22:30:23.526226+0000","last_unstale":"2024-09-15T22:30:25.534570+0000","last_undegraded":"2024-09-15T22:30:25.534570+0000","last_fullsized":"2024-09-15T22:30:25.534570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:44.019439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515755+0000","last_change":"2024-09-15T22:30:23.532730+0000","last_active":"2024-09-15T22:30:25.515755+0000","last_peered":"2024-09-15T22:30:25.515755+0000","last_clean":"2024-09-15T22:30:25.515755+0000","last_became_active":"2024-09-15T22:30:23.532425+0000","last_became_peered":"2024-09-15T22:30:23.532425+0000","last_unstale":"2024-09-15T22:30:25.515755+0000","last_undegraded":"2024-09-15T22:30:25.515755+0000","last_fullsized":"2024-09-15T22:30:25.515755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:16.341971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529767+0000","last_change":"2024-09-15T22:30:23.535074+0000","last_active":"2024-09-15T22:30:25.529767+0000","last_peered":"2024-09-15T22:30:25.529767+0000","last_clean":"2024-09-15T22:30:25.529767+0000","last_became_active":"2024-09-15T22:30:23.534810+0000","last_became_peered":"2024-09-15T22:30:23.534810+0000","last_unstale":"2024-09-15T22:30:25.529767+0000","last_undegraded":"2024-09-15T22:30:25.529767+0000","last_fullsized":"2024-09-15T22:30:25.529767+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:28.085650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529039+0000","last_change":"2024-09-15T22:30:23.533870+0000","last_active":"2024-09-15T22:30:25.529039+0000","last_peered":"2024-09-15T22:30:25.529039+0000","last_clean":"2024-09-15T22:30:25.529039+0000","last_became_active":"2024-09-15T22:30:23.533377+0000","last_became_peered":"2024-09-15T22:30:23.533377+0000","last_unstale":"2024-09-15T22:30:25.529039+0000","last_undegraded":"2024-09-15T22:30:25.529039+0000","last_fullsized":"2024-09-15T22:30:25.529039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:50.466754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529496+0000","last_change":"2024-09-15T22:30:23.521423+0000","last_active":"2024-09-15T22:30:25.529496+0000","last_peered":"2024-09-15T22:30:25.529496+0000","last_clean":"2024-09-15T22:30:25.529496+0000","last_became_active":"2024-09-15T22:30:23.521092+0000","last_became_peered":"2024-09-15T22:30:23.521092+0000","last_unstale":"2024-09-15T22:30:25.529496+0000","last_undegraded":"2024-09-15T22:30:25.529496+0000","last_fullsized":"2024-09-15T22:30:25.529496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:50.499382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534086+0000","last_change":"2024-09-15T22:30:23.526096+0000","last_active":"2024-09-15T22:30:25.534086+0000","last_peered":"2024-09-15T22:30:25.534086+0000","last_clean":"2024-09-15T22:30:25.534086+0000","last_became_active":"2024-09-15T22:30:23.525746+0000","last_became_peered":"2024-09-15T22:30:23.525746+0000","last_unstale":"2024-09-15T22:30:25.534086+0000","last_undegraded":"2024-09-15T22:30:25.534086+0000","last_fullsized":"2024-09-15T22:30:25.534086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:57.303470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518419+0000","last_change":"2024-09-15T22:30:23.518856+0000","last_active":"2024-09-15T22:30:25.518419+0000","last_peered":"2024-09-15T22:30:25.518419+0000","last_clean":"2024-09-15T22:30:25.518419+0000","last_became_active":"2024-09-15T22:30:23.518385+0000","last_became_peered":"2024-09-15T22:30:23.518385+0000","last_unstale":"2024-09-15T22:30:25.518419+0000","last_undegraded":"2024-09-15T22:30:25.518419+0000","last_fullsized":"2024-09-15T22:30:25.518419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:19.783989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":45,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:53.675990+0000","last_change":"2024-09-15T22:30:21.083625+0000","last_active":"2024-09-15T22:30:53.675990+0000","last_peered":"2024-09-15T22:30:53.675990+0000","last_clean":"2024-09-15T22:30:53.675990+0000","last_became_active":"2024-09-15T22:30:21.083252+0000","last_became_peered":"2024-09-15T22:30:21.083252+0000","last_unstale":"2024-09-15T22:30:53.675990+0000","last_undegraded":"2024-09-15T22:30:53.675990+0000","last_fullsized":"2024-09-15T22:30:53.675990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:34.596784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531290+0000","last_change":"2024-09-15T22:30:23.539472+0000","last_active":"2024-09-15T22:30:25.531290+0000","last_peered":"2024-09-15T22:30:25.531290+0000","last_clean":"2024-09-15T22:30:25.531290+0000","last_became_active":"2024-09-15T22:30:23.539138+0000","last_became_peered":"2024-09-15T22:30:23.539138+0000","last_unstale":"2024-09-15T22:30:25.531290+0000","last_undegraded":"2024-09-15T22:30:25.531290+0000","last_fullsized":"2024-09-15T22:30:25.531290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:18.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645590+0000","last_change":"2024-09-15T22:30:21.084153+0000","last_active":"2024-09-15T22:30:36.645590+0000","last_peered":"2024-09-15T22:30:36.645590+0000","last_clean":"2024-09-15T22:30:36.645590+0000","last_became_active":"2024-09-15T22:30:21.083772+0000","last_became_peered":"2024-09-15T22:30:21.083772+0000","last_unstale":"2024-09-15T22:30:36.645590+0000","last_undegraded":"2024-09-15T22:30:36.645590+0000","last_fullsized":"2024-09-15T22:30:36.645590+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:42.435846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.644970+0000","last_change":"2024-09-15T22:30:21.081395+0000","last_active":"2024-09-15T22:30:36.644970+0000","last_peered":"2024-09-15T22:30:36.644970+0000","last_clean":"2024-09-15T22:30:36.644970+0000","last_became_active":"2024-09-15T22:30:21.080785+0000","last_became_peered":"2024-09-15T22:30:21.080785+0000","last_unstale":"2024-09-15T22:30:36.644970+0000","last_undegraded":"2024-09-15T22:30:36.644970+0000","last_fullsized":"2024-09-15T22:30:36.644970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:58.908942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534822+0000","last_change":"2024-09-15T22:30:23.525123+0000","last_active":"2024-09-15T22:30:25.534822+0000","last_peered":"2024-09-15T22:30:25.534822+0000","last_clean":"2024-09-15T22:30:25.534822+0000","last_became_active":"2024-09-15T22:30:23.524772+0000","last_became_peered":"2024-09-15T22:30:23.524772+0000","last_unstale":"2024-09-15T22:30:25.534822+0000","last_undegraded":"2024-09-15T22:30:25.534822+0000","last_fullsized":"2024-09-15T22:30:25.534822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:32.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531679+0000","last_change":"2024-09-15T22:30:21.084218+0000","last_active":"2024-09-15T22:30:25.531679+0000","last_peered":"2024-09-15T22:30:25.531679+0000","last_clean":"2024-09-15T22:30:25.531679+0000","last_became_active":"2024-09-15T22:30:21.083853+0000","last_became_peered":"2024-09-15T22:30:21.083853+0000","last_unstale":"2024-09-15T22:30:25.531679+0000","last_undegraded":"2024-09-15T22:30:25.531679+0000","last_fullsized":"2024-09-15T22:30:25.531679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:56.947260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529137+0000","last_change":"2024-09-15T22:30:23.526667+0000","last_active":"2024-09-15T22:30:25.529137+0000","last_peered":"2024-09-15T22:30:25.529137+0000","last_clean":"2024-09-15T22:30:25.529137+0000","last_became_active":"2024-09-15T22:30:23.524872+0000","last_became_peered":"2024-09-15T22:30:23.524872+0000","last_unstale":"2024-09-15T22:30:25.529137+0000","last_undegraded":"2024-09-15T22:30:25.529137+0000","last_fullsized":"2024-09-15T22:30:25.529137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:11.222255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:54.676628+0000","last_change":"2024-09-15T22:30:21.081582+0000","last_active":"2024-09-15T22:30:54.676628+0000","last_peered":"2024-09-15T22:30:54.676628+0000","last_clean":"2024-09-15T22:30:54.676628+0000","last_became_active":"2024-09-15T22:30:21.081217+0000","last_became_peered":"2024-09-15T22:30:21.081217+0000","last_unstale":"2024-09-15T22:30:54.676628+0000","last_undegraded":"2024-09-15T22:30:54.676628+0000","last_fullsized":"2024-09-15T22:30:54.676628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:21.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.516277+0000","last_change":"2024-09-15T22:30:23.523065+0000","last_active":"2024-09-15T22:30:25.516277+0000","last_peered":"2024-09-15T22:30:25.516277+0000","last_clean":"2024-09-15T22:30:25.516277+0000","last_became_active":"2024-09-15T22:30:23.522743+0000","last_became_peered":"2024-09-15T22:30:23.522743+0000","last_unstale":"2024-09-15T22:30:25.516277+0000","last_undegraded":"2024-09-15T22:30:25.516277+0000","last_fullsized":"2024-09-15T22:30:25.516277+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:11.459699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.639758+0000","last_change":"2024-09-15T22:30:21.082508+0000","last_active":"2024-09-15T22:30:35.639758+0000","last_peered":"2024-09-15T22:30:35.639758+0000","last_clean":"2024-09-15T22:30:35.639758+0000","last_became_active":"2024-09-15T22:30:21.082199+0000","last_became_peered":"2024-09-15T22:30:21.082199+0000","last_unstale":"2024-09-15T22:30:35.639758+0000","last_undegraded":"2024-09-15T22:30:35.639758+0000","last_fullsized":"2024-09-15T22:30:35.639758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529815+0000","last_change":"2024-09-15T22:30:23.537744+0000","last_active":"2024-09-15T22:30:25.529815+0000","last_peered":"2024-09-15T22:30:25.529815+0000","last_clean":"2024-09-15T22:30:25.529815+0000","last_became_active":"2024-09-15T22:30:23.537426+0000","last_became_peered":"2024-09-15T22:30:23.537426+0000","last_unstale":"2024-09-15T22:30:25.529815+0000","last_undegraded":"2024-09-15T22:30:25.529815+0000","last_fullsized":"2024-09-15T22:30:25.529815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.389998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.641922+0000","last_change":"2024-09-15T22:30:21.091503+0000","last_active":"2024-09-15T22:30:35.641922+0000","last_peered":"2024-09-15T22:30:35.641922+0000","last_clean":"2024-09-15T22:30:35.641922+0000","last_became_active":"2024-09-15T22:30:21.090880+0000","last_became_peered":"2024-09-15T22:30:21.090880+0000","last_unstale":"2024-09-15T22:30:35.641922+0000","last_undegraded":"2024-09-15T22:30:35.641922+0000","last_fullsized":"2024-09-15T22:30:35.641922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.908033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515946+0000","last_change":"2024-09-15T22:30:23.531619+0000","last_active":"2024-09-15T22:30:25.515946+0000","last_peered":"2024-09-15T22:30:25.515946+0000","last_clean":"2024-09-15T22:30:25.515946+0000","last_became_active":"2024-09-15T22:30:23.531287+0000","last_became_peered":"2024-09-15T22:30:23.531287+0000","last_unstale":"2024-09-15T22:30:25.515946+0000","last_undegraded":"2024-09-15T22:30:25.515946+0000","last_fullsized":"2024-09-15T22:30:25.515946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:18.026268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'26","reported_seq":91,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:55.678093+0000","last_change":"2024-09-15T22:30:21.078244+0000","last_active":"2024-09-15T22:30:55.678093+0000","last_peered":"2024-09-15T22:30:55.678093+0000","last_clean":"2024-09-15T22:30:55.678093+0000","last_became_active":"2024-09-15T22:30:21.077866+0000","last_became_peered":"2024-09-15T22:30:21.077866+0000","last_unstale":"2024-09-15T22:30:55.678093+0000","last_undegraded":"2024-09-15T22:30:55.678093+0000","last_fullsized":"2024-09-15T22:30:55.678093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.304360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54369,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":75,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518441+0000","last_change":"2024-09-15T22:30:23.530641+0000","last_active":"2024-09-15T22:30:25.518441+0000","last_peered":"2024-09-15T22:30:25.518441+0000","last_clean":"2024-09-15T22:30:25.518441+0000","last_became_active":"2024-09-15T22:30:23.530349+0000","last_became_peered":"2024-09-15T22:30:23.530349+0000","last_unstale":"2024-09-15T22:30:25.518441+0000","last_undegraded":"2024-09-15T22:30:25.518441+0000","last_fullsized":"2024-09-15T22:30:25.518441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:44.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645787+0000","last_change":"2024-09-15T22:30:21.080522+0000","last_active":"2024-09-15T22:30:36.645787+0000","last_peered":"2024-09-15T22:30:36.645787+0000","last_clean":"2024-09-15T22:30:36.645787+0000","last_became_active":"2024-09-15T22:30:21.079288+0000","last_became_peered":"2024-09-15T22:30:21.079288+0000","last_unstale":"2024-09-15T22:30:36.645787+0000","last_undegraded":"2024-09-15T22:30:36.645787+0000","last_fullsized":"2024-09-15T22:30:36.645787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:31.106479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515627+0000","last_change":"2024-09-15T22:30:23.535095+0000","last_active":"2024-09-15T22:30:25.515627+0000","last_peered":"2024-09-15T22:30:25.515627+0000","last_clean":"2024-09-15T22:30:25.515627+0000","last_became_active":"2024-09-15T22:30:23.534768+0000","last_became_peered":"2024-09-15T22:30:23.534768+0000","last_unstale":"2024-09-15T22:30:25.515627+0000","last_undegraded":"2024-09-15T22:30:25.515627+0000","last_fullsized":"2024-09-15T22:30:25.515627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:16.410104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.641665+0000","last_change":"2024-09-15T22:30:21.084422+0000","last_active":"2024-09-15T22:30:35.641665+0000","last_peered":"2024-09-15T22:30:35.641665+0000","last_clean":"2024-09-15T22:30:35.641665+0000","last_became_active":"2024-09-15T22:30:21.084006+0000","last_became_peered":"2024-09-15T22:30:21.084006+0000","last_unstale":"2024-09-15T22:30:35.641665+0000","last_undegraded":"2024-09-15T22:30:35.641665+0000","last_fullsized":"2024-09-15T22:30:35.641665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:28.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.530356+0000","last_change":"2024-09-15T22:30:23.520511+0000","last_active":"2024-09-15T22:30:25.530356+0000","last_peered":"2024-09-15T22:30:25.530356+0000","last_clean":"2024-09-15T22:30:25.530356+0000","last_became_active":"2024-09-15T22:30:23.520176+0000","last_became_peered":"2024-09-15T22:30:23.520176+0000","last_unstale":"2024-09-15T22:30:25.530356+0000","last_undegraded":"2024-09-15T22:30:25.530356+0000","last_fullsized":"2024-09-15T22:30:25.530356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.195058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:54.677111+0000","last_change":"2024-09-15T22:30:21.082312+0000","last_active":"2024-09-15T22:30:54.677111+0000","last_peered":"2024-09-15T22:30:54.677111+0000","last_clean":"2024-09-15T22:30:54.677111+0000","last_became_active":"2024-09-15T22:30:21.081919+0000","last_became_peered":"2024-09-15T22:30:21.081919+0000","last_unstale":"2024-09-15T22:30:54.677111+0000","last_undegraded":"2024-09-15T22:30:54.677111+0000","last_fullsized":"2024-09-15T22:30:54.677111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:19.893695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528372+0000","last_change":"2024-09-15T22:30:23.528002+0000","last_active":"2024-09-15T22:30:25.528372+0000","last_peered":"2024-09-15T22:30:25.528372+0000","last_clean":"2024-09-15T22:30:25.528372+0000","last_became_active":"2024-09-15T22:30:23.527648+0000","last_became_peered":"2024-09-15T22:30:23.527648+0000","last_unstale":"2024-09-15T22:30:25.528372+0000","last_undegraded":"2024-09-15T22:30:25.528372+0000","last_fullsized":"2024-09-15T22:30:25.528372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:17.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.647003+0000","last_change":"2024-09-15T22:30:21.089063+0000","last_active":"2024-09-15T22:30:36.647003+0000","last_peered":"2024-09-15T22:30:36.647003+0000","last_clean":"2024-09-15T22:30:36.647003+0000","last_became_active":"2024-09-15T22:30:21.088697+0000","last_became_peered":"2024-09-15T22:30:21.088697+0000","last_unstale":"2024-09-15T22:30:36.647003+0000","last_undegraded":"2024-09-15T22:30:36.647003+0000","last_fullsized":"2024-09-15T22:30:36.647003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:23.325725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.532088+0000","last_change":"2024-09-15T22:30:23.528039+0000","last_active":"2024-09-15T22:30:25.532088+0000","last_peered":"2024-09-15T22:30:25.532088+0000","last_clean":"2024-09-15T22:30:25.532088+0000","last_became_active":"2024-09-15T22:30:23.527724+0000","last_became_peered":"2024-09-15T22:30:23.527724+0000","last_unstale":"2024-09-15T22:30:25.532088+0000","last_undegraded":"2024-09-15T22:30:25.532088+0000","last_fullsized":"2024-09-15T22:30:25.532088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.935247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:37.649438+0000","last_change":"2024-09-15T22:30:21.082669+0000","last_active":"2024-09-15T22:30:37.649438+0000","last_peered":"2024-09-15T22:30:37.649438+0000","last_clean":"2024-09-15T22:30:37.649438+0000","last_became_active":"2024-09-15T22:30:21.082320+0000","last_became_peered":"2024-09-15T22:30:21.082320+0000","last_unstale":"2024-09-15T22:30:37.649438+0000","last_undegraded":"2024-09-15T22:30:37.649438+0000","last_fullsized":"2024-09-15T22:30:37.649438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:57.546498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534418+0000","last_change":"2024-09-15T22:30:23.526039+0000","last_active":"2024-09-15T22:30:25.534418+0000","last_peered":"2024-09-15T22:30:25.534418+0000","last_clean":"2024-09-15T22:30:25.534418+0000","last_became_active":"2024-09-15T22:30:23.525643+0000","last_became_peered":"2024-09-15T22:30:23.525643+0000","last_unstale":"2024-09-15T22:30:25.534418+0000","last_undegraded":"2024-09-15T22:30:25.534418+0000","last_fullsized":"2024-09-15T22:30:25.534418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:21:18.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534106+0000","last_change":"2024-09-15T22:30:21.082098+0000","last_active":"2024-09-15T22:30:25.534106+0000","last_peered":"2024-09-15T22:30:25.534106+0000","last_clean":"2024-09-15T22:30:25.534106+0000","last_became_active":"2024-09-15T22:30:21.081079+0000","last_became_peered":"2024-09-15T22:30:21.081079+0000","last_unstale":"2024-09-15T22:30:25.534106+0000","last_undegraded":"2024-09-15T22:30:25.534106+0000","last_fullsized":"2024-09-15T22:30:25.534106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:23.531646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529247+0000","last_change":"2024-09-15T22:30:23.525455+0000","last_active":"2024-09-15T22:30:25.529247+0000","last_peered":"2024-09-15T22:30:25.529247+0000","last_clean":"2024-09-15T22:30:25.529247+0000","last_became_active":"2024-09-15T22:30:23.525010+0000","last_became_peered":"2024-09-15T22:30:23.525010+0000","last_unstale":"2024-09-15T22:30:25.529247+0000","last_undegraded":"2024-09-15T22:30:25.529247+0000","last_fullsized":"2024-09-15T22:30:25.529247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.783445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534381+0000","last_change":"2024-09-15T22:30:21.081906+0000","last_active":"2024-09-15T22:30:25.534381+0000","last_peered":"2024-09-15T22:30:25.534381+0000","last_clean":"2024-09-15T22:30:25.534381+0000","last_became_active":"2024-09-15T22:30:21.081508+0000","last_became_peered":"2024-09-15T22:30:21.081508+0000","last_unstale":"2024-09-15T22:30:25.534381+0000","last_undegraded":"2024-09-15T22:30:25.534381+0000","last_fullsized":"2024-09-15T22:30:25.534381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:10.781416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528969+0000","last_change":"2024-09-15T22:30:23.534015+0000","last_active":"2024-09-15T22:30:25.528969+0000","last_peered":"2024-09-15T22:30:25.528969+0000","last_clean":"2024-09-15T22:30:25.528969+0000","last_became_active":"2024-09-15T22:30:23.533273+0000","last_became_peered":"2024-09-15T22:30:23.533273+0000","last_unstale":"2024-09-15T22:30:25.528969+0000","last_undegraded":"2024-09-15T22:30:25.528969+0000","last_fullsized":"2024-09-15T22:30:25.528969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.752276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.647052+0000","last_change":"2024-09-15T22:30:21.099447+0000","last_active":"2024-09-15T22:30:36.647052+0000","last_peered":"2024-09-15T22:30:36.647052+0000","last_clean":"2024-09-15T22:30:36.647052+0000","last_became_active":"2024-09-15T22:30:21.099060+0000","last_became_peered":"2024-09-15T22:30:21.099060+0000","last_unstale":"2024-09-15T22:30:36.647052+0000","last_undegraded":"2024-09-15T22:30:36.647052+0000","last_fullsized":"2024-09-15T22:30:36.647052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:28.878596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529787+0000","last_change":"2024-09-15T22:30:23.528034+0000","last_active":"2024-09-15T22:30:25.529787+0000","last_peered":"2024-09-15T22:30:25.529787+0000","last_clean":"2024-09-15T22:30:25.529787+0000","last_became_active":"2024-09-15T22:30:23.527665+0000","last_became_peered":"2024-09-15T22:30:23.527665+0000","last_unstale":"2024-09-15T22:30:25.529787+0000","last_undegraded":"2024-09-15T22:30:25.529787+0000","last_fullsized":"2024-09-15T22:30:25.529787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:34.827296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528697+0000","last_change":"2024-09-15T22:29:04.533047+0000","last_active":"2024-09-15T22:30:25.528697+0000","last_peered":"2024-09-15T22:30:25.528697+0000","last_clean":"2024-09-15T22:30:25.528697+0000","last_became_active":"2024-09-15T22:29:04.532535+0000","last_became_peered":"2024-09-15T22:29:04.532535+0000","last_unstale":"2024-09-15T22:30:25.528697+0000","last_undegraded":"2024-09-15T22:30:25.528697+0000","last_fullsized":"2024-09-15T22:30:25.528697+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_clean_scrub_stamp":"2024-09-15T22:25:32.270999+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:13.428305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:37.649266+0000","last_change":"2024-09-15T22:30:21.080635+0000","last_active":"2024-09-15T22:30:37.649266+0000","last_peered":"2024-09-15T22:30:37.649266+0000","last_clean":"2024-09-15T22:30:37.649266+0000","last_became_active":"2024-09-15T22:30:21.080297+0000","last_became_peered":"2024-09-15T22:30:21.080297+0000","last_unstale":"2024-09-15T22:30:37.649266+0000","last_undegraded":"2024-09-15T22:30:37.649266+0000","last_fullsized":"2024-09-15T22:30:37.649266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:37.358138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535241+0000","last_change":"2024-09-15T22:30:23.529660+0000","last_active":"2024-09-15T22:30:25.535241+0000","last_peered":"2024-09-15T22:30:25.535241+0000","last_clean":"2024-09-15T22:30:25.535241+0000","last_became_active":"2024-09-15T22:30:23.529363+0000","last_became_peered":"2024-09-15T22:30:23.529363+0000","last_unstale":"2024-09-15T22:30:25.535241+0000","last_undegraded":"2024-09-15T22:30:25.535241+0000","last_fullsized":"2024-09-15T22:30:25.535241+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:20.301523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.644411+0000","last_change":"2024-09-15T22:30:21.083261+0000","last_active":"2024-09-15T22:30:36.644411+0000","last_peered":"2024-09-15T22:30:36.644411+0000","last_clean":"2024-09-15T22:30:36.644411+0000","last_became_active":"2024-09-15T22:30:21.082517+0000","last_became_peered":"2024-09-15T22:30:21.082517+0000","last_unstale":"2024-09-15T22:30:36.644411+0000","last_undegraded":"2024-09-15T22:30:36.644411+0000","last_fullsized":"2024-09-15T22:30:36.644411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:32.825877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515614+0000","last_change":"2024-09-15T22:30:23.535666+0000","last_active":"2024-09-15T22:30:25.515614+0000","last_peered":"2024-09-15T22:30:25.515614+0000","last_clean":"2024-09-15T22:30:25.515614+0000","last_became_active":"2024-09-15T22:30:23.532795+0000","last_became_peered":"2024-09-15T22:30:23.532795+0000","last_unstale":"2024-09-15T22:30:25.515614+0000","last_undegraded":"2024-09-15T22:30:25.515614+0000","last_fullsized":"2024-09-15T22:30:25.515614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:46.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:52.673632+0000","last_change":"2024-09-15T22:30:21.089614+0000","last_active":"2024-09-15T22:30:52.673632+0000","last_peered":"2024-09-15T22:30:52.673632+0000","last_clean":"2024-09-15T22:30:52.673632+0000","last_became_active":"2024-09-15T22:30:21.089252+0000","last_became_peered":"2024-09-15T22:30:21.089252+0000","last_unstale":"2024-09-15T22:30:52.673632+0000","last_undegraded":"2024-09-15T22:30:52.673632+0000","last_fullsized":"2024-09-15T22:30:52.673632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:48.491093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.531377+0000","last_change":"2024-09-15T22:30:23.524558+0000","last_active":"2024-09-15T22:30:25.531377+0000","last_peered":"2024-09-15T22:30:25.531377+0000","last_clean":"2024-09-15T22:30:25.531377+0000","last_became_active":"2024-09-15T22:30:23.524237+0000","last_became_peered":"2024-09-15T22:30:23.524237+0000","last_unstale":"2024-09-15T22:30:25.531377+0000","last_undegraded":"2024-09-15T22:30:25.531377+0000","last_fullsized":"2024-09-15T22:30:25.531377+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:48.956855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529249+0000","last_change":"2024-09-15T22:30:21.084749+0000","last_active":"2024-09-15T22:30:25.529249+0000","last_peered":"2024-09-15T22:30:25.529249+0000","last_clean":"2024-09-15T22:30:25.529249+0000","last_became_active":"2024-09-15T22:30:21.083677+0000","last_became_peered":"2024-09-15T22:30:21.083677+0000","last_unstale":"2024-09-15T22:30:25.529249+0000","last_undegraded":"2024-09-15T22:30:25.529249+0000","last_fullsized":"2024-09-15T22:30:25.529249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:56.534120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529234+0000","last_change":"2024-09-15T22:30:23.525625+0000","last_active":"2024-09-15T22:30:25.529234+0000","last_peered":"2024-09-15T22:30:25.529234+0000","last_clean":"2024-09-15T22:30:25.529234+0000","last_became_active":"2024-09-15T22:30:23.525314+0000","last_became_peered":"2024-09-15T22:30:23.525314+0000","last_unstale":"2024-09-15T22:30:25.529234+0000","last_undegraded":"2024-09-15T22:30:25.529234+0000","last_fullsized":"2024-09-15T22:30:25.529234+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:37.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529734+0000","last_change":"2024-09-15T22:30:21.089819+0000","last_active":"2024-09-15T22:30:25.529734+0000","last_peered":"2024-09-15T22:30:25.529734+0000","last_clean":"2024-09-15T22:30:25.529734+0000","last_became_active":"2024-09-15T22:30:21.089432+0000","last_became_peered":"2024-09-15T22:30:21.089432+0000","last_unstale":"2024-09-15T22:30:25.529734+0000","last_undegraded":"2024-09-15T22:30:25.529734+0000","last_fullsized":"2024-09-15T22:30:25.529734+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:18.317959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:26.210539+0000","last_change":"2024-09-15T22:30:23.532949+0000","last_active":"2024-09-15T22:30:26.210539+0000","last_peered":"2024-09-15T22:30:26.210539+0000","last_clean":"2024-09-15T22:30:26.210539+0000","last_became_active":"2024-09-15T22:30:23.532622+0000","last_became_peered":"2024-09-15T22:30:23.532622+0000","last_unstale":"2024-09-15T22:30:26.210539+0000","last_undegraded":"2024-09-15T22:30:26.210539+0000","last_fullsized":"2024-09-15T22:30:26.210539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:57.296048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.638959+0000","last_change":"2024-09-15T22:30:21.091151+0000","last_active":"2024-09-15T22:30:35.638959+0000","last_peered":"2024-09-15T22:30:35.638959+0000","last_clean":"2024-09-15T22:30:35.638959+0000","last_became_active":"2024-09-15T22:30:21.090776+0000","last_became_peered":"2024-09-15T22:30:21.090776+0000","last_unstale":"2024-09-15T22:30:35.638959+0000","last_undegraded":"2024-09-15T22:30:35.638959+0000","last_fullsized":"2024-09-15T22:30:35.638959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:16.882946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515965+0000","last_change":"2024-09-15T22:30:23.522118+0000","last_active":"2024-09-15T22:30:25.515965+0000","last_peered":"2024-09-15T22:30:25.515965+0000","last_clean":"2024-09-15T22:30:25.515965+0000","last_became_active":"2024-09-15T22:30:23.521592+0000","last_became_peered":"2024-09-15T22:30:23.521592+0000","last_unstale":"2024-09-15T22:30:25.515965+0000","last_undegraded":"2024-09-15T22:30:25.515965+0000","last_fullsized":"2024-09-15T22:30:25.515965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:31.331703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'9","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:51.530905+0000","last_change":"2024-09-15T22:30:21.083399+0000","last_active":"2024-09-15T22:30:51.530905+0000","last_peered":"2024-09-15T22:30:51.530905+0000","last_clean":"2024-09-15T22:30:51.530905+0000","last_became_active":"2024-09-15T22:30:21.082863+0000","last_became_peered":"2024-09-15T22:30:21.082863+0000","last_unstale":"2024-09-15T22:30:51.530905+0000","last_undegraded":"2024-09-15T22:30:51.530905+0000","last_fullsized":"2024-09-15T22:30:51.530905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:51.895900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.536456+0000","last_change":"2024-09-15T22:30:23.530220+0000","last_active":"2024-09-15T22:30:25.536456+0000","last_peered":"2024-09-15T22:30:25.536456+0000","last_clean":"2024-09-15T22:30:25.536456+0000","last_became_active":"2024-09-15T22:30:23.529917+0000","last_became_peered":"2024-09-15T22:30:23.529917+0000","last_unstale":"2024-09-15T22:30:25.536456+0000","last_undegraded":"2024-09-15T22:30:25.536456+0000","last_fullsized":"2024-09-15T22:30:25.536456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:33.394454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.638546+0000","last_change":"2024-09-15T22:30:21.099112+0000","last_active":"2024-09-15T22:30:35.638546+0000","last_peered":"2024-09-15T22:30:35.638546+0000","last_clean":"2024-09-15T22:30:35.638546+0000","last_became_active":"2024-09-15T22:30:21.098814+0000","last_became_peered":"2024-09-15T22:30:21.098814+0000","last_unstale":"2024-09-15T22:30:35.638546+0000","last_undegraded":"2024-09-15T22:30:35.638546+0000","last_fullsized":"2024-09-15T22:30:35.638546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:52.202768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529630+0000","last_change":"2024-09-15T22:30:23.540456+0000","last_active":"2024-09-15T22:30:25.529630+0000","last_peered":"2024-09-15T22:30:25.529630+0000","last_clean":"2024-09-15T22:30:25.529630+0000","last_became_active":"2024-09-15T22:30:23.538273+0000","last_became_peered":"2024-09-15T22:30:23.538273+0000","last_unstale":"2024-09-15T22:30:25.529630+0000","last_undegraded":"2024-09-15T22:30:25.529630+0000","last_fullsized":"2024-09-15T22:30:25.529630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:21.507592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.640231+0000","last_change":"2024-09-15T22:30:21.088934+0000","last_active":"2024-09-15T22:30:35.640231+0000","last_peered":"2024-09-15T22:30:35.640231+0000","last_clean":"2024-09-15T22:30:35.640231+0000","last_became_active":"2024-09-15T22:30:21.088629+0000","last_became_peered":"2024-09-15T22:30:21.088629+0000","last_unstale":"2024-09-15T22:30:35.640231+0000","last_undegraded":"2024-09-15T22:30:35.640231+0000","last_fullsized":"2024-09-15T22:30:35.640231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:12.430279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.518193+0000","last_change":"2024-09-15T22:30:23.523023+0000","last_active":"2024-09-15T22:30:25.518193+0000","last_peered":"2024-09-15T22:30:25.518193+0000","last_clean":"2024-09-15T22:30:25.518193+0000","last_became_active":"2024-09-15T22:30:23.522674+0000","last_became_peered":"2024-09-15T22:30:23.522674+0000","last_unstale":"2024-09-15T22:30:25.518193+0000","last_undegraded":"2024-09-15T22:30:25.518193+0000","last_fullsized":"2024-09-15T22:30:25.518193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:34.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.642631+0000","last_change":"2024-09-15T22:30:21.084287+0000","last_active":"2024-09-15T22:30:35.642631+0000","last_peered":"2024-09-15T22:30:35.642631+0000","last_clean":"2024-09-15T22:30:35.642631+0000","last_became_active":"2024-09-15T22:30:21.083686+0000","last_became_peered":"2024-09-15T22:30:21.083686+0000","last_unstale":"2024-09-15T22:30:35.642631+0000","last_undegraded":"2024-09-15T22:30:35.642631+0000","last_fullsized":"2024-09-15T22:30:35.642631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:18.737268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.534242+0000","last_change":"2024-09-15T22:30:23.529327+0000","last_active":"2024-09-15T22:30:25.534242+0000","last_peered":"2024-09-15T22:30:25.534242+0000","last_clean":"2024-09-15T22:30:25.534242+0000","last_became_active":"2024-09-15T22:30:23.529013+0000","last_became_peered":"2024-09-15T22:30:23.529013+0000","last_unstale":"2024-09-15T22:30:25.534242+0000","last_undegraded":"2024-09-15T22:30:25.534242+0000","last_fullsized":"2024-09-15T22:30:25.534242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:39.722197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529191+0000","last_change":"2024-09-15T22:30:21.081443+0000","last_active":"2024-09-15T22:30:25.529191+0000","last_peered":"2024-09-15T22:30:25.529191+0000","last_clean":"2024-09-15T22:30:25.529191+0000","last_became_active":"2024-09-15T22:30:21.081105+0000","last_became_peered":"2024-09-15T22:30:21.081105+0000","last_unstale":"2024-09-15T22:30:25.529191+0000","last_undegraded":"2024-09-15T22:30:25.529191+0000","last_fullsized":"2024-09-15T22:30:25.529191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:56.796153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.535103+0000","last_change":"2024-09-15T22:30:23.533866+0000","last_active":"2024-09-15T22:30:25.535103+0000","last_peered":"2024-09-15T22:30:25.535103+0000","last_clean":"2024-09-15T22:30:25.535103+0000","last_became_active":"2024-09-15T22:30:23.533541+0000","last_became_peered":"2024-09-15T22:30:23.533541+0000","last_unstale":"2024-09-15T22:30:25.535103+0000","last_undegraded":"2024-09-15T22:30:25.535103+0000","last_fullsized":"2024-09-15T22:30:25.535103+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:26.923241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:35.639834+0000","last_change":"2024-09-15T22:30:21.084794+0000","last_active":"2024-09-15T22:30:35.639834+0000","last_peered":"2024-09-15T22:30:35.639834+0000","last_clean":"2024-09-15T22:30:35.639834+0000","last_became_active":"2024-09-15T22:30:21.083415+0000","last_became_peered":"2024-09-15T22:30:21.083415+0000","last_unstale":"2024-09-15T22:30:35.639834+0000","last_undegraded":"2024-09-15T22:30:35.639834+0000","last_fullsized":"2024-09-15T22:30:35.639834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:13.689217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.528913+0000","last_change":"2024-09-15T22:30:23.527870+0000","last_active":"2024-09-15T22:30:25.528913+0000","last_peered":"2024-09-15T22:30:25.528913+0000","last_clean":"2024-09-15T22:30:25.528913+0000","last_became_active":"2024-09-15T22:30:23.527529+0000","last_became_peered":"2024-09-15T22:30:23.527529+0000","last_unstale":"2024-09-15T22:30:25.528913+0000","last_undegraded":"2024-09-15T22:30:25.528913+0000","last_fullsized":"2024-09-15T22:30:25.528913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:30.086127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529807+0000","last_change":"2024-09-15T22:30:23.528943+0000","last_active":"2024-09-15T22:30:25.529807+0000","last_peered":"2024-09-15T22:30:25.529807+0000","last_clean":"2024-09-15T22:30:25.529807+0000","last_became_active":"2024-09-15T22:30:23.528578+0000","last_became_peered":"2024-09-15T22:30:23.528578+0000","last_unstale":"2024-09-15T22:30:25.529807+0000","last_undegraded":"2024-09-15T22:30:25.529807+0000","last_fullsized":"2024-09-15T22:30:25.529807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:37.832903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.530457+0000","last_change":"2024-09-15T22:30:21.085166+0000","last_active":"2024-09-15T22:30:25.530457+0000","last_peered":"2024-09-15T22:30:25.530457+0000","last_clean":"2024-09-15T22:30:25.530457+0000","last_became_active":"2024-09-15T22:30:21.083482+0000","last_became_peered":"2024-09-15T22:30:21.083482+0000","last_unstale":"2024-09-15T22:30:25.530457+0000","last_undegraded":"2024-09-15T22:30:25.530457+0000","last_fullsized":"2024-09-15T22:30:25.530457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:47.430411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.515885+0000","last_change":"2024-09-15T22:30:23.523096+0000","last_active":"2024-09-15T22:30:25.515885+0000","last_peered":"2024-09-15T22:30:25.515885+0000","last_clean":"2024-09-15T22:30:25.515885+0000","last_became_active":"2024-09-15T22:30:23.522736+0000","last_became_peered":"2024-09-15T22:30:23.522736+0000","last_unstale":"2024-09-15T22:30:25.515885+0000","last_undegraded":"2024-09-15T22:30:25.515885+0000","last_fullsized":"2024-09-15T22:30:25.515885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:06.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645200+0000","last_change":"2024-09-15T22:30:21.083395+0000","last_active":"2024-09-15T22:30:36.645200+0000","last_peered":"2024-09-15T22:30:36.645200+0000","last_clean":"2024-09-15T22:30:36.645200+0000","last_became_active":"2024-09-15T22:30:21.083083+0000","last_became_peered":"2024-09-15T22:30:21.083083+0000","last_unstale":"2024-09-15T22:30:36.645200+0000","last_undegraded":"2024-09-15T22:30:36.645200+0000","last_fullsized":"2024-09-15T22:30:36.645200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:41.170212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.529690+0000","last_change":"2024-09-15T22:30:23.533926+0000","last_active":"2024-09-15T22:30:25.529690+0000","last_peered":"2024-09-15T22:30:25.529690+0000","last_clean":"2024-09-15T22:30:25.529690+0000","last_became_active":"2024-09-15T22:30:23.533640+0000","last_became_peered":"2024-09-15T22:30:23.533640+0000","last_unstale":"2024-09-15T22:30:25.529690+0000","last_undegraded":"2024-09-15T22:30:25.529690+0000","last_fullsized":"2024-09-15T22:30:25.529690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:07.684910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.538024+0000","last_change":"2024-09-15T22:30:21.090319+0000","last_active":"2024-09-15T22:30:25.538024+0000","last_peered":"2024-09-15T22:30:25.538024+0000","last_clean":"2024-09-15T22:30:25.538024+0000","last_became_active":"2024-09-15T22:30:21.089301+0000","last_became_peered":"2024-09-15T22:30:21.089301+0000","last_unstale":"2024-09-15T22:30:25.538024+0000","last_undegraded":"2024-09-15T22:30:25.538024+0000","last_fullsized":"2024-09-15T22:30:25.538024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:16.501805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:25.536379+0000","last_change":"2024-09-15T22:30:23.531710+0000","last_active":"2024-09-15T22:30:25.536379+0000","last_peered":"2024-09-15T22:30:25.536379+0000","last_clean":"2024-09-15T22:30:25.536379+0000","last_became_active":"2024-09-15T22:30:23.531400+0000","last_became_peered":"2024-09-15T22:30:23.531400+0000","last_unstale":"2024-09-15T22:30:25.536379+0000","last_undegraded":"2024-09-15T22:30:25.536379+0000","last_fullsized":"2024-09-15T22:30:25.536379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:11.865981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T22:30:36.645407+0000","last_change":"2024-09-15T22:30:21.083039+0000","last_active":"2024-09-15T22:30:36.645407+0000","last_peered":"2024-09-15T22:30:36.645407+0000","last_clean":"2024-09-15T22:30:36.645407+0000","last_became_active":"2024-09-15T22:30:21.082634+0000","last_became_peered":"2024-09-15T22:30:21.082634+0000","last_unstale":"2024-09-15T22:30:36.645407+0000","last_undegraded":"2024-09-15T22:30:36.645407+0000","last_fullsized":"2024-09-15T22:30:36.645407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:01.545563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58372,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":156,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645331,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":416251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874264,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41016,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704136,"statfs":{"total":95995035648,"available":95953035264,"internally_reserved":0,"allocated":1548288,"data_stored":1062494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005085,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":416487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234019,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":416407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36776,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708376,"statfs":{"total":95995035648,"available":95957377024,"internally_reserved":0,"allocated":1466368,"data_stored":1008339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626477,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":415876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855411,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1007630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":416706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247869,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":416187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":471388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40400,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704752,"statfs":{"total":95995035648,"available":95953666048,"internally_reserved":0,"allocated":917504,"data_stored":470038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":417147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:30:59.701 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:30:59.702 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T22:30:59.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T22:30:59.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:30:59 smithi022 ceph-mon[30634]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:00.088 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:00.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:30:59 smithi112 ceph-mon[35032]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:00.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:30:59 smithi110 ceph-mon[35282]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 -- 172.21.15.22:0/3237021383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 msgr2=0x7f7040109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 --2- 172.21.15.22:0/3237021383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f7040109e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ca0 tx=0x7f703802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 -- 172.21.15.22:0/3237021383 shutdown_connections 2024-09-15T22:31:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 --2- 172.21.15.22:0/3237021383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f7040109e90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 --2- 172.21.15.22:0/3237021383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7040102c40 0x7f70401030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 --2- 172.21.15.22:0/3237021383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 0x7f7040101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 -- 172.21.15.22:0/3237021383 >> 172.21.15.22:0/3237021383 conn(0x7f70400fd1f0 msgr2=0x7f70400ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 -- 172.21.15.22:0/3237021383 shutdown_connections 2024-09-15T22:31:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.731+0000 7f7046400640 1 -- 172.21.15.22:0/3237021383 wait complete. 2024-09-15T22:31:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 Processor -- start 2024-09-15T22:31:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 -- start start 2024-09-15T22:31:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 0x7f7040199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7040102c40 0x7f704019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f70401a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f704010d710 con 0x7f7040103600 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f704010d590 con 0x7f7040102c40 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.732+0000 7f7046400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f704010d890 con 0x7f7040101a40 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f70401a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f70401a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37548/0 (socket says 172.21.15.22:37548) 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 0x7f7040199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f703fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7040102c40 0x7f704019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045a00640 1 -- 172.21.15.22:0/19508763 learned_addr learned my addr 172.21.15.22:0/19508763 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 -- 172.21.15.22:0/19508763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7040102c40 msgr2=0x7f704019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7040102c40 0x7f704019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 -- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 msgr2=0x7f70401a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f70401a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 -- 172.21.15.22:0/19508763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70401a1b10 con 0x7f7040101a40 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.733+0000 7f7045000640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 0x7f7040199ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f703400e9c0 tx=0x7f703400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.734+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703400ccc0 con 0x7f7040101a40 2024-09-15T22:31:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.734+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70340035f0 con 0x7f7040101a40 2024-09-15T22:31:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.734+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70401a1e00 con 0x7f7040101a40 2024-09-15T22:31:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.734+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703400ce60 con 0x7f7040101a40 2024-09-15T22:31:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.734+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a2250 con 0x7f7040101a40 2024-09-15T22:31:00.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.735+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70401a2510 con 0x7f7040101a40 2024-09-15T22:31:00.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.736+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f70340037a0 con 0x7f7040101a40 2024-09-15T22:31:00.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.738+0000 7f703d600640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70280a3380 0x7f70280a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:00.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.738+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f70340cfe30 con 0x7f7040101a40 2024-09-15T22:31:00.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.738+0000 7f703fe00640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70280a3380 0x7f70280a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:00.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.739+0000 7f703fe00640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70280a3380 0x7f70280a5840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f704019b400 tx=0x7f702c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:00.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.742+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f703409caa0 con 0x7f7040101a40 2024-09-15T22:31:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:00.993+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f70401a2780 con 0x7f7040101a40 2024-09-15T22:31:00.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:00 smithi022 ceph-mon[30634]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-09-15T22:31:01.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.001+0000 7f703d600640 1 -- 172.21.15.22:0/19508763 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f703409c3a0 con 0x7f7040101a40 2024-09-15T22:31:01.002 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-09-15T22:31:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAkYOdmnkpHOxAALhop3RUFxRRfi3M9xD/cSA== 2024-09-15T22:31:01.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70280a3380 msgr2=0x7f70280a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:01.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70280a3380 0x7f70280a5840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f704019b400 tx=0x7f702c005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:01.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 msgr2=0x7f7040199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 0x7f7040199ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f703400e9c0 tx=0x7f703400ee80 comp rx=0 tx=0).stop 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 shutdown_connections 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70280a3380 0x7f70280a5840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7040103600 0x7f70401a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7040102c40 0x7f704019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 --2- 172.21.15.22:0/19508763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7040101a40 0x7f7040199ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.003+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 >> 172.21.15.22:0/19508763 conn(0x7f70400fd1f0 msgr2=0x7f7040074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.004+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 shutdown_connections 2024-09-15T22:31:01.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:01.004+0000 7f7046400640 1 -- 172.21.15.22:0/19508763 wait complete. 2024-09-15T22:31:01.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:00 smithi112 ceph-mon[35032]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-09-15T22:31:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:00 smithi110 ceph-mon[35282]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-09-15T22:31:01.788 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:31:01.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T22:31:01.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:31:01.870 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:31:01.870 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:31:01.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T22:31:02.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:01 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/19508763' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:31:02.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:01 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:31:02.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:01 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:31:02.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:01 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/19508763' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:31:02.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:01 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:31:02.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:01 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:31:02.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:01 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/19508763' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:31:02.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:01 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:31:02.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:01 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:31:02.291 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.865+0000 7fd326800640 1 -- 172.21.15.22:0/3774837615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320076720 msgr2=0x7fd320076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.865+0000 7fd326800640 1 --2- 172.21.15.22:0/3774837615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320076720 0x7fd320076b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd314009900 tx=0x7fd31402a400 comp rx=0 tx=0).stop 2024-09-15T22:31:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 -- 172.21.15.22:0/3774837615 shutdown_connections 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 --2- 172.21.15.22:0/3774837615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320112870 0x7fd320114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 --2- 172.21.15.22:0/3774837615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 0x7fd320112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 --2- 172.21.15.22:0/3774837615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320076720 0x7fd320076b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 -- 172.21.15.22:0/3774837615 >> 172.21.15.22:0/3774837615 conn(0x7fd3200ff8d0 msgr2=0x7fd320101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 -- 172.21.15.22:0/3774837615 shutdown_connections 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.866+0000 7fd326800640 1 -- 172.21.15.22:0/3774837615 wait complete. 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 Processor -- start 2024-09-15T22:31:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 -- start start 2024-09-15T22:31:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320076720 0x7fd3201a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 0x7fd3201a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 0x7fd32019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd320118450 con 0x7fd320112870 2024-09-15T22:31:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd3201182d0 con 0x7fd320077040 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.867+0000 7fd326800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3201185d0 con 0x7fd320076720 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 0x7fd32019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 0x7fd32019e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37570/0 (socket says 172.21.15.22:37570) 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325e00640 1 -- 172.21.15.22:0/534169224 learned_addr learned my addr 172.21.15.22:0/534169224 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320076720 0x7fd3201a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd324a00640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 0x7fd3201a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 -- 172.21.15.22:0/534169224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 msgr2=0x7fd3201a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 0x7fd3201a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 -- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 msgr2=0x7fd32019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 0x7fd32019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 -- 172.21.15.22:0/534169224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32019ef80 con 0x7fd320076720 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd324a00640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 0x7fd3201a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325e00640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 0x7fd32019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.868+0000 7fd325400640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320076720 0x7fd3201a4640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd31402a920 tx=0x7fd314003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.869+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31403f070 con 0x7fd320076720 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.869+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32019f210 con 0x7fd320076720 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.869+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd314031c90 con 0x7fd320076720 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.869+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314035030 con 0x7fd320076720 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.869+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3201ab3f0 con 0x7fd320076720 2024-09-15T22:31:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.870+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd320077e60 con 0x7fd320076720 2024-09-15T22:31:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.872+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd314042070 con 0x7fd320076720 2024-09-15T22:31:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.873+0000 7fd31e000640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd3080a32d0 0x7fd3080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.874+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fd3140f0640 con 0x7fd320076720 2024-09-15T22:31:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.874+0000 7fd324a00640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd3080a32d0 0x7fd3080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.874+0000 7fd324a00640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd3080a32d0 0x7fd3080a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd32019ff60 tx=0x7fd30c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:02.875+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3140bd2b0 con 0x7fd320076720 2024-09-15T22:31:03.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:02 smithi022 ceph-mon[30634]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-09-15T22:31:03.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.109+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd32002d7c0 con 0x7fd320076720 2024-09-15T22:31:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.114+0000 7fd31e000640 1 -- 172.21.15.22:0/534169224 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264045 (secure 0 0 0) 0x7fd3140bcbb0 con 0x7fd320076720 2024-09-15T22:31:03.118 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd3080a32d0 msgr2=0x7fd3080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd3080a32d0 0x7fd3080a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd32019ff60 tx=0x7fd30c005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320076720 msgr2=0x7fd3201a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320076720 0x7fd3201a4640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd31402a920 tx=0x7fd314003b90 comp rx=0 tx=0).stop 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 shutdown_connections 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd3080a32d0 0x7fd3080a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd320112870 0x7fd32019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320077040 0x7fd3201a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 --2- 172.21.15.22:0/534169224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd320076720 0x7fd3201a4640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 >> 172.21.15.22:0/534169224 conn(0x7fd3200ff8d0 msgr2=0x7fd320101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 shutdown_connections 2024-09-15T22:31:03.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:03.118+0000 7fd326800640 1 -- 172.21.15.22:0/534169224 wait complete. 2024-09-15T22:31:03.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:02 smithi112 ceph-mon[35032]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-09-15T22:31:03.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:02 smithi110 ceph-mon[35282]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-09-15T22:31:03.885 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":191438634},{"type":"v1","addr":"172.21.15.22:6801","nonce":191438634}]},"active_addr":"172.21.15.22:6801/191438634","active_change":"2024-09-15T22:23:09.459836+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":700744220}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":202900109}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1518469017}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2656745080}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3919010724}]}]} 2024-09-15T22:31:03.893 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T22:31:03.893 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T22:31:03.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:31:04.273 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:04.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:04 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/534169224' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:31:04.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:04 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/534169224' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:31:04.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:04 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/534169224' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 -- 172.21.15.22:0/527494165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc103ff0 msgr2=0x7f93dc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 --2- 172.21.15.22:0/527494165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc103ff0 0x7f93dc1043d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009900 tx=0x7f93d002a410 comp rx=0 tx=0).stop 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 -- 172.21.15.22:0/527494165 shutdown_connections 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 --2- 172.21.15.22:0/527494165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93dc1049a0 0x7f93dc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 --2- 172.21.15.22:0/527494165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc109120 0x7f93dc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 --2- 172.21.15.22:0/527494165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc103ff0 0x7f93dc1043d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 -- 172.21.15.22:0/527494165 >> 172.21.15.22:0/527494165 conn(0x7f93dc0ffa90 msgr2=0x7f93dc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 -- 172.21.15.22:0/527494165 shutdown_connections 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.786+0000 7f93e3400640 1 -- 172.21.15.22:0/527494165 wait complete. 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.787+0000 7f93e3400640 1 Processor -- start 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.787+0000 7f93e3400640 1 -- start start 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 0x7f93dc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93dc1049a0 0x7f93dc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc109120 0x7f93dc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e3400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc114120 con 0x7f93dc109120 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e3400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc113fa0 con 0x7f93dc103ff0 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e3400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1142a0 con 0x7f93dc1049a0 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 0x7f93dc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 0x7f93dc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:46984/0 (socket says 172.21.15.22:46984) 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 -- 172.21.15.22:0/3954560097 learned_addr learned my addr 172.21.15.22:0/3954560097 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e1400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc109120 0x7f93dc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93dbe00640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93dc1049a0 0x7f93dc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 -- 172.21.15.22:0/3954560097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93dc1049a0 msgr2=0x7f93dc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93dc1049a0 0x7f93dc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 -- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc109120 msgr2=0x7f93dc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc109120 0x7f93dc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.788+0000 7f93e0a00640 1 -- 172.21.15.22:0/3954560097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc19f590 con 0x7f93dc103ff0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.789+0000 7f93e0a00640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 0x7f93dc19a5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006010 tx=0x7f93d0004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.789+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d003f030 con 0x7f93dc103ff0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.789+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc19f820 con 0x7f93dc103ff0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.789+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d0004440 con 0x7f93dc103ff0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.789+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0035070 con 0x7f93dc103ff0 2024-09-15T22:31:04.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.789+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1a7160 con 0x7f93dc103ff0 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.790+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93dc1054d0 con 0x7f93dc103ff0 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.792+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f93d0042030 con 0x7f93dc103ff0 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.793+0000 7f93d9600640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f93c40a32d0 0x7f93c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.793+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f93d00eff70 con 0x7f93dc103ff0 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.794+0000 7f93dbe00640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f93c40a32d0 0x7f93c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.794+0000 7f93dbe00640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f93c40a32d0 0x7f93c40a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0ffeb0 tx=0x7f93c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:04.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.796+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93d00bc590 con 0x7f93dc103ff0 2024-09-15T22:31:04.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.985+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93dc10c300 con 0x7f93dc103ff0 2024-09-15T22:31:04.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.987+0000 7f93d9600640 1 -- 172.21.15.22:0/3954560097 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22293 (secure 0 0 0) 0x7f93d00c0890 con 0x7f93dc103ff0 2024-09-15T22:31:04.988 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:04.988 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":79,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:30:24.572498+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:31:04.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.989+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f93c40a32d0 msgr2=0x7f93c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:04.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.989+0000 7f93e3400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f93c40a32d0 0x7f93c40a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0ffeb0 tx=0x7f93c8005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:04.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.989+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 msgr2=0x7f93dc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.989+0000 7f93e3400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 0x7f93dc19a5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006010 tx=0x7f93d0004040 comp rx=0 tx=0).stop 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 shutdown_connections 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93dc1049a0 0x7f93dc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f93c40a32d0 0x7f93c40a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93dc109120 0x7f93dc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 --2- 172.21.15.22:0/3954560097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93dc103ff0 0x7f93dc19a5e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 >> 172.21.15.22:0/3954560097 conn(0x7f93dc0ffa90 msgr2=0x7f93dc100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 shutdown_connections 2024-09-15T22:31:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:04.990+0000 7f93e3400640 1 -- 172.21.15.22:0/3954560097 wait complete. 2024-09-15T22:31:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:05 smithi022 ceph-mon[30634]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-15T22:31:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:05 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3954560097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:05 smithi112 ceph-mon[35032]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-15T22:31:05.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:05 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3954560097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:05 smithi110 ceph-mon[35282]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-15T22:31:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:05 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3954560097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:05.723 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T22:31:05.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:31:06.100 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.576+0000 7fc3bb600640 1 -- 172.21.15.22:0/1255589777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b41049c0 msgr2=0x7fc3b4108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.576+0000 7fc3bb600640 1 --2- 172.21.15.22:0/1255589777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b41049c0 0x7fc3b4108a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009900 tx=0x7fc39c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 -- 172.21.15.22:0/1255589777 shutdown_connections 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 --2- 172.21.15.22:0/1255589777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b4109140 0x7fc3b4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 --2- 172.21.15.22:0/1255589777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b41049c0 0x7fc3b4108a10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 --2- 172.21.15.22:0/1255589777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b4104010 0x7fc3b41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 -- 172.21.15.22:0/1255589777 >> 172.21.15.22:0/1255589777 conn(0x7fc3b40ffa50 msgr2=0x7fc3b4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 -- 172.21.15.22:0/1255589777 shutdown_connections 2024-09-15T22:31:06.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.577+0000 7fc3bb600640 1 -- 172.21.15.22:0/1255589777 wait complete. 2024-09-15T22:31:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 Processor -- start 2024-09-15T22:31:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 -- start start 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 0x7fc3b419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b41049c0 0x7fc3b419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b4109140 0x7fc3b419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4114140 con 0x7fc3b4104010 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4113fc0 con 0x7fc3b41049c0 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3bb600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41142c0 con 0x7fc3b4109140 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.578+0000 7fc3b8c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 0x7fc3b419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 0x7fc3b419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37616/0 (socket says 172.21.15.22:37616) 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 -- 172.21.15.22:0/2565012501 learned_addr learned my addr 172.21.15.22:0/2565012501 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b9600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b4109140 0x7fc3b419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3abe00640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b41049c0 0x7fc3b419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 -- 172.21.15.22:0/2565012501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b4109140 msgr2=0x7fc3b419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b4109140 0x7fc3b419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 -- 172.21.15.22:0/2565012501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b41049c0 msgr2=0x7fc3b419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b41049c0 0x7fc3b419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 -- 172.21.15.22:0/2565012501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b419f660 con 0x7fc3b4104010 2024-09-15T22:31:06.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.579+0000 7fc3b8c00640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 0x7fc3b419a6b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400d950 tx=0x7fc3a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.580+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4017070 con 0x7fc3b4104010 2024-09-15T22:31:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.580+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b419f950 con 0x7fc3b4104010 2024-09-15T22:31:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.580+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a4009c30 con 0x7fc3b4104010 2024-09-15T22:31:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.580+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400f6b0 con 0x7fc3b4104010 2024-09-15T22:31:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.580+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b41a7230 con 0x7fc3b4104010 2024-09-15T22:31:06.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.581+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b41043f0 con 0x7fc3b4104010 2024-09-15T22:31:06.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.583+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc3a40109d0 con 0x7fc3b4104010 2024-09-15T22:31:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.585+0000 7fc3b2000640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc3980a3350 0x7fc3980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.585+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fc3a40cf530 con 0x7fc3b4104010 2024-09-15T22:31:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.585+0000 7fc3abe00640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc3980a3350 0x7fc3980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:06.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.586+0000 7fc3abe00640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc3980a3350 0x7fc3980a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009230 tx=0x7fc39c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:06.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.590+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3a4009de0 con 0x7fc3b4104010 2024-09-15T22:31:06.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.777+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3b410c3b0 con 0x7fc3b4104010 2024-09-15T22:31:06.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.778+0000 7fc3b2000640 1 -- 172.21.15.22:0/2565012501 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22293 (secure 0 0 0) 0x7fc3a409bb50 con 0x7fc3b4104010 2024-09-15T22:31:06.779 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:06.779 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":79,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:30:24.572498+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:31:06.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.780+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc3980a3350 msgr2=0x7fc3980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:06.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.780+0000 7fc3bb600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc3980a3350 0x7fc3980a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009230 tx=0x7fc39c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.780+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 msgr2=0x7fc3b419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.780+0000 7fc3bb600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 0x7fc3b419a6b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400d950 tx=0x7fc3a400de10 comp rx=0 tx=0).stop 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 shutdown_connections 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b4109140 0x7fc3b419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc3980a3350 0x7fc3980a5810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3b41049c0 0x7fc3b419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 --2- 172.21.15.22:0/2565012501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3b4104010 0x7fc3b419a6b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 >> 172.21.15.22:0/2565012501 conn(0x7fc3b40ffa50 msgr2=0x7fc3b4100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 shutdown_connections 2024-09-15T22:31:06.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:06.781+0000 7fc3bb600640 1 -- 172.21.15.22:0/2565012501 wait complete. 2024-09-15T22:31:07.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:07 smithi022 ceph-mon[30634]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-15T22:31:07.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:07 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2565012501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:07 smithi112 ceph-mon[35032]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-15T22:31:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:07 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2565012501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:07 smithi110 ceph-mon[35282]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-15T22:31:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:07 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2565012501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:07.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T22:31:07.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T22:31:07.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T22:31:07.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T22:31:07.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T22:31:07.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T22:31:07.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T22:31:07.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T22:31:07.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T22:31:07.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T22:31:07.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T22:31:07.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T22:31:08.462 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:08.805 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:08.813 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:08.816 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:08.817 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:08.818 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 -- 172.21.15.22:0/3233300390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 msgr2=0x7ff1c01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/3233300390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c01089f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009900 tx=0x7ff1ac02a410 comp rx=0 tx=0).stop 2024-09-15T22:31:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 -- 172.21.15.22:0/3233300390 shutdown_connections 2024-09-15T22:31:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/3233300390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1c0109120 0x7ff1c0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/3233300390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c01089f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/3233300390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1c0103ff0 0x7ff1c01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 -- 172.21.15.22:0/3233300390 >> 172.21.15.22:0/3233300390 conn(0x7ff1c00ffa90 msgr2=0x7ff1c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 -- 172.21.15.22:0/3233300390 shutdown_connections 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.054+0000 7ff1c7a00640 1 -- 172.21.15.22:0/3233300390 wait complete. 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.055+0000 7ff1c7a00640 1 Processor -- start 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.055+0000 7ff1c7a00640 1 -- start start 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c7a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1c0103ff0 0x7ff1c019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c7a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c7a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1c0109120 0x7ff1c019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c7a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0114190 con 0x7ff1c01049a0 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c7a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0114010 con 0x7ff1c0103ff0 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c7a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0114310 con 0x7ff1c0109120 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1bfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1bfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37640/0 (socket says 172.21.15.22:37640) 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1bfe00640 1 -- 172.21.15.22:0/1100544084 learned_addr learned my addr 172.21.15.22:0/1100544084 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c5000640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1c0103ff0 0x7ff1c019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.056+0000 7ff1c5a00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1c0109120 0x7ff1c019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bfe00640 1 -- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1c0109120 msgr2=0x7ff1c019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bfe00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1c0109120 0x7ff1c019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bfe00640 1 -- 172.21.15.22:0/1100544084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1c0103ff0 msgr2=0x7ff1c019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bfe00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1c0103ff0 0x7ff1c019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bfe00640 1 -- 172.21.15.22:0/1100544084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c019f620 con 0x7ff1c01049a0 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1c5000640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1c0103ff0 0x7ff1c019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bfe00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c019abb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac004770 tx=0x7ff1ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac03f070 con 0x7ff1c01049a0 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c019f8b0 con 0x7ff1c01049a0 2024-09-15T22:31:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ac031ca0 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac035030 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.057+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c01a71f0 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.058+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1c0062980 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.060+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff1ac042070 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.061+0000 7ff1bd600640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff1a80a3350 0x7ff1a80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7ff1ac0f0770 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1c5000640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff1a80a3350 0x7ff1a80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1bd600640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] conn(0x7ff1a80acba0 0x7ff1a80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 --> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1ac00b0b0 con 0x7ff1a80acba0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7ff1ac0f0b20 con 0x7ff1c01049a0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1c5000640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff1a80a3350 0x7ff1a80a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009fc0 tx=0x7ff1b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.062+0000 7ff1c5a00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] conn(0x7ff1a80acba0 0x7ff1a80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.063+0000 7ff1c5a00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] conn(0x7ff1a80acba0 0x7ff1a80aefc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.064+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== osd.11 v2:172.21.15.112:6824/362844051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1ac00b0b0 con 0x7ff1a80acba0 2024-09-15T22:31:09.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.079+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 --> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1c0062d80 con 0x7ff1a80acba0 2024-09-15T22:31:09.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.079+0000 7ff1bd600640 1 -- 172.21.15.22:0/1100544084 <== osd.11 v2:172.21.15.112:6824/362844051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff1c0062d80 con 0x7ff1a80acba0 2024-09-15T22:31:09.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] conn(0x7ff1a80acba0 msgr2=0x7ff1a80aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] conn(0x7ff1a80acba0 0x7ff1a80aefc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff1a80a3350 msgr2=0x7ff1a80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff1a80a3350 0x7ff1a80a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009fc0 tx=0x7ff1b4005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 msgr2=0x7ff1c019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 --2- 172.21.15.22:0/1100544084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1c01049a0 0x7ff1c019abb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac004770 tx=0x7ff1ac003c10 comp rx=0 tx=0).stop 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c5a00640 1 -- 172.21.15.22:0/1100544084 reap_dead start 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 shutdown_connections 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.080+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 >> 172.21.15.22:0/1100544084 conn(0x7ff1c00ffa90 msgr2=0x7ff1c0100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.081+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 shutdown_connections 2024-09-15T22:31:09.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.081+0000 7ff1c7a00640 1 -- 172.21.15.22:0/1100544084 wait complete. 2024-09-15T22:31:09.099 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:09.194 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:09 smithi022 ceph-mon[30634]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-15T22:31:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:09 smithi112 ceph-mon[35032]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-15T22:31:09.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:09 smithi110 ceph-mon[35282]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-15T22:31:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 -- 172.21.15.22:0/3848249410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c1049a0 msgr2=0x7f447c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 --2- 172.21.15.22:0/3848249410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c1049a0 0x7f447c1089f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4468009900 tx=0x7f446802a400 comp rx=0 tx=0).stop 2024-09-15T22:31:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 -- 172.21.15.22:0/3848249410 shutdown_connections 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 --2- 172.21.15.22:0/3848249410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c1049a0 0x7f447c1089f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 --2- 172.21.15.22:0/3848249410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f447c109120 0x7f447c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 --2- 172.21.15.22:0/3848249410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c103ff0 0x7f447c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 -- 172.21.15.22:0/3848249410 >> 172.21.15.22:0/3848249410 conn(0x7f447c0ffa90 msgr2=0x7f447c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 -- 172.21.15.22:0/3848249410 shutdown_connections 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.786+0000 7f4481c00640 1 -- 172.21.15.22:0/3848249410 wait complete. 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.787+0000 7f4481c00640 1 Processor -- start 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 -- start start 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c103ff0 0x7f447c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f447c1049a0 0x7f447c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c109120 0x7f447c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f447c114170 con 0x7f447c109120 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f447c113ff0 con 0x7f447c1049a0 2024-09-15T22:31:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.788+0000 7f4481c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1142f0 con 0x7f447c103ff0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c109120 0x7f447c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c103ff0 0x7f447c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c109120 0x7f447c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37662/0 (socket says 172.21.15.22:37662) 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447b400640 1 -- 172.21.15.22:0/1709965196 learned_addr learned my addr 172.21.15.22:0/1709965196 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447a000640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f447c1049a0 0x7f447c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 -- 172.21.15.22:0/1709965196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f447c1049a0 msgr2=0x7f447c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f447c1049a0 0x7f447c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 -- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c109120 msgr2=0x7f447c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c109120 0x7f447c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 -- 172.21.15.22:0/1709965196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c19f5e0 con 0x7f447c103ff0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.789+0000 7f447aa00640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c103ff0 0x7f447c19a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e9f0 tx=0x7f446c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.790+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c00ccc0 con 0x7f447c103ff0 2024-09-15T22:31:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.790+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f446c010910 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.790+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c19f8d0 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.790+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c018960 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.790+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1a71b0 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.791+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f447c062980 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.793+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f446c010ac0 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.795+0000 7f4473400640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44600a3350 0x7f44600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.795+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f446c0cff90 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.796+0000 7f447a000640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44600a3350 0x7f44600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.796+0000 7f4473400640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] conn(0x7f44600acba0 0x7f44600aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.796+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 --> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f446c024e70 con 0x7f44600acba0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.796+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f446c0d0340 con 0x7f447c103ff0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.796+0000 7f447b400640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] conn(0x7f44600acba0 0x7f44600aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.796+0000 7f447a000640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44600a3350 0x7f44600a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4468000c00 tx=0x7f4468005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.797+0000 7f447b400640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] conn(0x7f44600acba0 0x7f44600aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.798+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== osd.0 v2:172.21.15.22:6802/1552898806 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f446c024e70 con 0x7f44600acba0 2024-09-15T22:31:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.825+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 --> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f447c062e00 con 0x7f44600acba0 2024-09-15T22:31:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4473400640 1 -- 172.21.15.22:0/1709965196 <== osd.0 v2:172.21.15.22:6802/1552898806 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f447c062e00 con 0x7f44600acba0 2024-09-15T22:31:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] conn(0x7f44600acba0 msgr2=0x7f44600aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] conn(0x7f44600acba0 0x7f44600aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44600a3350 msgr2=0x7f44600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44600a3350 0x7f44600a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4468000c00 tx=0x7f4468005b50 comp rx=0 tx=0).stop 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c103ff0 msgr2=0x7f447c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 --2- 172.21.15.22:0/1709965196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c103ff0 0x7f447c19a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e9f0 tx=0x7f446c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f447b400640 1 -- 172.21.15.22:0/1709965196 reap_dead start 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 shutdown_connections 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.826+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 >> 172.21.15.22:0/1709965196 conn(0x7f447c0ffa90 msgr2=0x7f447c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.827+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 shutdown_connections 2024-09-15T22:31:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.827+0000 7f4481c00640 1 -- 172.21.15.22:0/1709965196 wait complete. 2024-09-15T22:31:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-15T22:31:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-15T22:31:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-15T22:31:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-15T22:31:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T22:31:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-09-15T22:31:10.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2024-09-15T22:31:10.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-15T22:31:10.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:10 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-15T22:31:10.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:10 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-15T22:31:10.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-15T22:31:10.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-15T22:31:10.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-15T22:31:10.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-15T22:31:10.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T22:31:10.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-09-15T22:31:10.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2024-09-15T22:31:10.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-15T22:31:10.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:10 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-15T22:31:10.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 -- 172.21.15.22:0/131522633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 msgr2=0x7fb8d8101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 --2- 172.21.15.22:0/131522633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d8101e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009930 tx=0x7fb8c402a420 comp rx=0 tx=0).stop 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 -- 172.21.15.22:0/131522633 shutdown_connections 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 --2- 172.21.15.22:0/131522633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8d8102360 0x7fb8d810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 --2- 172.21.15.22:0/131522633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d8101e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 --2- 172.21.15.22:0/131522633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d81079c0 0x7fb8d8107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 -- 172.21.15.22:0/131522633 >> 172.21.15.22:0/131522633 conn(0x7fb8d80fd740 msgr2=0x7fb8d80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 -- 172.21.15.22:0/131522633 shutdown_connections 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.907+0000 7fb8dee00640 1 -- 172.21.15.22:0/131522633 wait complete. 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 Processor -- start 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 -- start start 2024-09-15T22:31:10.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8d8102360 0x7fb8d819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d81079c0 0x7fb8d819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8111dc0 con 0x7fb8d81019c0 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8111c40 con 0x7fb8d81079c0 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.908+0000 7fb8dee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8111f40 con 0x7fb8d8102360 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39734/0 (socket says 172.21.15.22:39734) 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 -- 172.21.15.22:0/4140028266 learned_addr learned my addr 172.21.15.22:0/4140028266 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dd000640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8d8102360 0x7fb8d819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8de400640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d81079c0 0x7fb8d819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 -- 172.21.15.22:0/4140028266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8d8102360 msgr2=0x7fb8d819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8d8102360 0x7fb8d819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 -- 172.21.15.22:0/4140028266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d81079c0 msgr2=0x7fb8d819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d81079c0 0x7fb8d819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 -- 172.21.15.22:0/4140028266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d819f450 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8de400640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d81079c0 0x7fb8d819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.909+0000 7fb8dda00640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d819a4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00d950 tx=0x7fb8cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.910+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc017030 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.910+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8cc004020 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.910+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0047a0 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.910+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d819f740 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.910+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d81a7020 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.911+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8d80ff0b0 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.913+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb8cc0041d0 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.914+0000 7fb8d6000640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3350 0x7fb8c00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.914+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fb8cc0cf9d0 con 0x7fb8d81019c0 2024-09-15T22:31:10.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.914+0000 7fb8dd000640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3350 0x7fb8c00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.915+0000 7fb8d6000640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] conn(0x7fb8c00acba0 0x7fb8c00aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.915+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 --> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8cc011e50 con 0x7fb8c00acba0 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.915+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fb8cc0cfd80 con 0x7fb8d81019c0 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.915+0000 7fb8de400640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] conn(0x7fb8c00acba0 0x7fb8c00aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.915+0000 7fb8dd000640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3350 0x7fb8c00a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009900 tx=0x7fb8c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.915+0000 7fb8de400640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] conn(0x7fb8c00acba0 0x7fb8c00aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:10.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.916+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== osd.3 v2:172.21.15.22:6810/2418580016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8cc011e50 con 0x7fb8c00acba0 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.931+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 --> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8d8103100 con 0x7fb8c00acba0 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.931+0000 7fb8d6000640 1 -- 172.21.15.22:0/4140028266 <== osd.3 v2:172.21.15.22:6810/2418580016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb8d8103100 con 0x7fb8c00acba0 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] conn(0x7fb8c00acba0 msgr2=0x7fb8c00aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] conn(0x7fb8c00acba0 0x7fb8c00aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3350 msgr2=0x7fb8c00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3350 0x7fb8c00a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009900 tx=0x7fb8c40058d0 comp rx=0 tx=0).stop 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 msgr2=0x7fb8d819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 --2- 172.21.15.22:0/4140028266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d81019c0 0x7fb8d819a4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00d950 tx=0x7fb8cc00de10 comp rx=0 tx=0).stop 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8de400640 1 -- 172.21.15.22:0/4140028266 reap_dead start 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 shutdown_connections 2024-09-15T22:31:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 >> 172.21.15.22:0/4140028266 conn(0x7fb8d80fd740 msgr2=0x7fb8d810cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:10.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 shutdown_connections 2024-09-15T22:31:10.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:09.932+0000 7fb8dee00640 1 -- 172.21.15.22:0/4140028266 wait complete. 2024-09-15T22:31:11.127 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:31:11.127 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-15T22:31:11.128 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:11 smithi022 ceph-mon[30634]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:31:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 -- 172.21.15.22:0/660788113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 msgr2=0x7f0dc0101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 --2- 172.21.15.22:0/660788113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc0101e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009890 tx=0x7f0dac02a370 comp rx=0 tx=0).stop 2024-09-15T22:31:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 -- 172.21.15.22:0/660788113 shutdown_connections 2024-09-15T22:31:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 --2- 172.21.15.22:0/660788113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc0101e30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 --2- 172.21.15.22:0/660788113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0dc0102370 0x7f0dc010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 --2- 172.21.15.22:0/660788113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc01079d0 0x7f0dc0107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 -- 172.21.15.22:0/660788113 >> 172.21.15.22:0/660788113 conn(0x7f0dc00fd710 msgr2=0x7f0dc00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:11.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 -- 172.21.15.22:0/660788113 shutdown_connections 2024-09-15T22:31:11.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.139+0000 7f0dc5800640 1 -- 172.21.15.22:0/660788113 wait complete. 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.140+0000 7f0dc5800640 1 Processor -- start 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.140+0000 7f0dc5800640 1 -- start start 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.140+0000 7f0dc5800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.140+0000 7f0dc5800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0dc0102370 0x7f0dc019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dc5800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc01079d0 0x7f0dc019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dc5800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0111dd0 con 0x7f0dc0102370 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dc5800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0111c50 con 0x7f0dc01079d0 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dc5800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0111f50 con 0x7f0dc01019d0 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbf400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0dc0102370 0x7f0dc019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:44032/0 (socket says 172.21.15.22:44032) 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 -- 172.21.15.22:0/3108565301 learned_addr learned my addr 172.21.15.22:0/3108565301 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dc4e00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc01079d0 0x7f0dc019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 -- 172.21.15.22:0/3108565301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc01079d0 msgr2=0x7f0dc019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dc01079d0 0x7f0dc019ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 -- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0dc0102370 msgr2=0x7f0dc019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0dc0102370 0x7f0dc019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.141+0000 7f0dbfe00640 1 -- 172.21.15.22:0/3108565301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc019f4c0 con 0x7f0dc01019d0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.142+0000 7f0dbfe00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc019a510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0db000e9f0 tx=0x7f0db000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.142+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db000cd80 con 0x7f0dc01019d0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.142+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc019f7b0 con 0x7f0dc01019d0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.142+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0db0005500 con 0x7f0dc01019d0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.142+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0010690 con 0x7f0dc01019d0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.142+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc01a7090 con 0x7f0dc01019d0 2024-09-15T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.143+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0dc00ff030 con 0x7f0dc01019d0 2024-09-15T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.145+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0db00046c0 con 0x7f0dc01019d0 2024-09-15T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.146+0000 7f0dbcc00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0da40a32d0 0x7f0da40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.147+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f0db00d0260 con 0x7f0dc01019d0 2024-09-15T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.147+0000 7f0dbf400640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0da40a32d0 0x7f0da40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.147+0000 7f0dbcc00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] conn(0x7f0da40acf00 0x7f0da40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.147+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 --> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0db0004470 con 0x7f0da40acf00 2024-09-15T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.147+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f0db00d0610 con 0x7f0dc01019d0 2024-09-15T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.147+0000 7f0dc4e00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] conn(0x7f0da40acf00 0x7f0da40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.148+0000 7f0dbf400640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0da40a32d0 0x7f0da40a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0dac02a960 tx=0x7f0dac0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.148+0000 7f0dc4e00640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] conn(0x7f0da40acf00 0x7f0da40af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.149+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== osd.9 v2:172.21.15.22:6826/2222374873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0db0004470 con 0x7f0da40acf00 2024-09-15T22:31:11.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.163+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 --> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0dc0103110 con 0x7f0da40acf00 2024-09-15T22:31:11.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dbcc00640 1 -- 172.21.15.22:0/3108565301 <== osd.9 v2:172.21.15.22:6826/2222374873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0dc0103110 con 0x7f0da40acf00 2024-09-15T22:31:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] conn(0x7f0da40acf00 msgr2=0x7f0da40af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] conn(0x7f0da40acf00 0x7f0da40af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0da40a32d0 msgr2=0x7f0da40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f0da40a32d0 0x7f0da40a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0dac02a960 tx=0x7f0dac0056d0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 msgr2=0x7f0dc019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 --2- 172.21.15.22:0/3108565301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc01019d0 0x7f0dc019a510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0db000e9f0 tx=0x7f0db000edf0 comp rx=0 tx=0).stop 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc4e00640 1 -- 172.21.15.22:0/3108565301 reap_dead start 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 shutdown_connections 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 >> 172.21.15.22:0/3108565301 conn(0x7f0dc00fd710 msgr2=0x7f0dc010d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.164+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 shutdown_connections 2024-09-15T22:31:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:11.165+0000 7f0dc5800640 1 -- 172.21.15.22:0/3108565301 wait complete. 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-15T22:31:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2024-09-15T22:31:11.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-15T22:31:11.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-15T22:31:11.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:11 smithi112 ceph-mon[35032]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:31:11.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-15T22:31:11.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-15T22:31:11.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-15T22:31:11.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-15T22:31:11.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:11 smithi110 ceph-mon[35282]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:31:11.798 INFO:teuthology.orchestra.run.smithi022.stdout:34359738449 2024-09-15T22:31:11.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T22:31:12.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:12 smithi112 ceph-mon[35032]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:31:12.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:12 smithi110 ceph-mon[35282]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:31:12.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:12 smithi022 ceph-mon[30634]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:31:12.692 INFO:teuthology.orchestra.run.smithi022.stdout:309237645334 2024-09-15T22:31:12.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T22:31:13.034 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:13.037 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:13.069 INFO:teuthology.orchestra.run.smithi022.stdout:98784247872 2024-09-15T22:31:13.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T22:31:13.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:13 smithi022 ceph-mon[30634]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:13.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:13 smithi112 ceph-mon[35032]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:13.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:13 smithi110 ceph-mon[35282]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:13.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 -- 172.21.15.22:0/2675794979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab4109140 msgr2=0x7f1ab4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 --2- 172.21.15.22:0/2675794979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab4109140 0x7f1ab4110cc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009900 tx=0x7f1aac02a410 comp rx=0 tx=0).stop 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 -- 172.21.15.22:0/2675794979 shutdown_connections 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 --2- 172.21.15.22:0/2675794979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab4109140 0x7f1ab4110cc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 --2- 172.21.15.22:0/2675794979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab41049c0 0x7f1ab4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 --2- 172.21.15.22:0/2675794979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab4104010 0x7f1ab41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.100+0000 7f1abc400640 1 -- 172.21.15.22:0/2675794979 >> 172.21.15.22:0/2675794979 conn(0x7f1ab40ffa50 msgr2=0x7f1ab4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.101+0000 7f1abc400640 1 -- 172.21.15.22:0/2675794979 shutdown_connections 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.101+0000 7f1abc400640 1 -- 172.21.15.22:0/2675794979 wait complete. 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 Processor -- start 2024-09-15T22:31:13.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 -- start start 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab4104010 0x7f1ab419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab41049c0 0x7f1ab419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab4109140 0x7f1ab419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41141c0 con 0x7f1ab41049c0 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4114040 con 0x7f1ab4104010 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1abc400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4114340 con 0x7f1ab4109140 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1ab9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab4104010 0x7f1ab419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1ab9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab41049c0 0x7f1ab419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1ab9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab4104010 0x7f1ab419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:36686/0 (socket says 172.21.15.22:36686) 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1ab9a00640 1 -- 172.21.15.22:0/1247785614 learned_addr learned my addr 172.21.15.22:0/1247785614 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.102+0000 7f1aba400640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab4109140 0x7f1ab419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.103+0000 7f1ab9a00640 1 -- 172.21.15.22:0/1247785614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab4109140 msgr2=0x7f1ab419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:13.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.103+0000 7f1ab9a00640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ab4109140 0x7f1ab419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.103+0000 7f1ab9a00640 1 -- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab41049c0 msgr2=0x7f1ab419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.103+0000 7f1ab9a00640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ab41049c0 0x7f1ab419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.103+0000 7f1ab9a00640 1 -- 172.21.15.22:0/1247785614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab419f690 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.103+0000 7f1ab9a00640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab4104010 0x7f1ab419a6e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800eb90 tx=0x7f1aa800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.104+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8004d20 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.104+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab419f980 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.104+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa800ee90 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.104+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8010830 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.104+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab41a7260 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.105+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ab4062900 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.107+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1aa8005020 con 0x7f1ab4104010 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.108+0000 7f1ab2000640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a9c0a3350 0x7f1a9c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:13.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.108+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1aa80cff80 con 0x7f1ab4104010 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.108+0000 7f1ab9000640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a9c0a3350 0x7f1a9c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.108+0000 7f1ab2000640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] conn(0x7f1a9c0acf80 0x7f1a9c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.108+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 --> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a9c0afaf0 con 0x7f1a9c0acf80 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.108+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f1aa80d7050 con 0x7f1ab4104010 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.109+0000 7f1aba400640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] conn(0x7f1a9c0acf80 0x7f1a9c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.109+0000 7f1ab9000640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a9c0a3350 0x7f1a9c0a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1ab410aab0 tx=0x7f1aa0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.109+0000 7f1aba400640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] conn(0x7f1a9c0acf80 0x7f1a9c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.110+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== osd.1 v2:172.21.15.110:6800/2485792273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a9c0afaf0 con 0x7f1a9c0acf80 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.125+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 --> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ab4062d00 con 0x7f1a9c0acf80 2024-09-15T22:31:13.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.125+0000 7f1ab2000640 1 -- 172.21.15.22:0/1247785614 <== osd.1 v2:172.21.15.110:6800/2485792273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ab4062d00 con 0x7f1a9c0acf80 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] conn(0x7f1a9c0acf80 msgr2=0x7f1a9c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] conn(0x7f1a9c0acf80 0x7f1a9c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a9c0a3350 msgr2=0x7f1a9c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1a9c0a3350 0x7f1a9c0a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1ab410aab0 tx=0x7f1aa0005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab4104010 msgr2=0x7f1ab419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 --2- 172.21.15.22:0/1247785614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ab4104010 0x7f1ab419a6e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800eb90 tx=0x7f1aa800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1aba400640 1 -- 172.21.15.22:0/1247785614 reap_dead start 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 shutdown_connections 2024-09-15T22:31:13.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 >> 172.21.15.22:0/1247785614 conn(0x7f1ab40ffa50 msgr2=0x7f1ab4100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:13.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 shutdown_connections 2024-09-15T22:31:13.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:12.126+0000 7f1abc400640 1 -- 172.21.15.22:0/1247785614 wait complete. 2024-09-15T22:31:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 -- 172.21.15.22:0/640371170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124112870 msgr2=0x7f4124114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 --2- 172.21.15.22:0/640371170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124112870 0x7f4124114c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f411c009ca0 tx=0x7f411c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 -- 172.21.15.22:0/640371170 shutdown_connections 2024-09-15T22:31:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 --2- 172.21.15.22:0/640371170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4124077040 0x7f4124112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 --2- 172.21.15.22:0/640371170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124112870 0x7f4124114c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 --2- 172.21.15.22:0/640371170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4124076720 0x7f4124076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 -- 172.21.15.22:0/640371170 >> 172.21.15.22:0/640371170 conn(0x7f41240ff910 msgr2=0x7f4124101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.341+0000 7f4128c00640 1 -- 172.21.15.22:0/640371170 shutdown_connections 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.342+0000 7f4128c00640 1 -- 172.21.15.22:0/640371170 wait complete. 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.342+0000 7f4128c00640 1 Processor -- start 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 -- start start 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124076720 0x7f41241a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4124077040 0x7f41241a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4124112870 0x7f412419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4124118400 con 0x7f4124076720 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4124118280 con 0x7f4124077040 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4128c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4124118580 con 0x7f4124112870 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4123400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124076720 0x7f41241a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4123400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124076720 0x7f41241a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39806/0 (socket says 172.21.15.22:39806) 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4123400640 1 -- 172.21.15.22:0/1504435250 learned_addr learned my addr 172.21.15.22:0/1504435250 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4122a00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4124077040 0x7f41241a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.343+0000 7f4123e00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4124112870 0x7f412419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4122a00640 1 -- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4124112870 msgr2=0x7f412419e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4122a00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4124112870 0x7f412419e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4122a00640 1 -- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124076720 msgr2=0x7f41241a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4122a00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4124076720 0x7f41241a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4122a00640 1 -- 172.21.15.22:0/1504435250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412419ef80 con 0x7f4124077040 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4122a00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4124077040 0x7f41241a4b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4110005fd0 tx=0x7f411000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110009c30 con 0x7f4124077040 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.344+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412419f270 con 0x7f4124077040 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.345+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4110009dd0 con 0x7f4124077040 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.345+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110010460 con 0x7f4124077040 2024-09-15T22:31:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.345+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41241ab5c0 con 0x7f4124077040 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.345+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41240628c0 con 0x7f4124077040 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.348+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4110003ef0 con 0x7f4124077040 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.349+0000 7f411be00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f41080a3350 0x7f41080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.349+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f41100cf8c0 con 0x7f4124077040 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.349+0000 7f4123400640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f41080a3350 0x7f41080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.349+0000 7f411be00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] conn(0x7f41080acf80 0x7f41080af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.349+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 --> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4110015ec0 con 0x7f41080acf80 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.349+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f41100cfc70 con 0x7f4124077040 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.350+0000 7f4123e00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] conn(0x7f41080acf80 0x7f41080af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.350+0000 7f4123400640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f41080a3350 0x7f41080a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4114005fd0 tx=0x7f411400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:14.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.350+0000 7f4123e00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] conn(0x7f41080acf80 0x7f41080af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:14.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.351+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== osd.2 v2:172.21.15.112:6800/1634459120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4110015ec0 con 0x7f41080acf80 2024-09-15T22:31:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.366+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 --> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4124062cc0 con 0x7f41080acf80 2024-09-15T22:31:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f411be00640 1 -- 172.21.15.22:0/1504435250 <== osd.2 v2:172.21.15.112:6800/1634459120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4124062cc0 con 0x7f41080acf80 2024-09-15T22:31:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] conn(0x7f41080acf80 msgr2=0x7f41080af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f4128c00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] conn(0x7f41080acf80 0x7f41080af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f41080a3350 msgr2=0x7f41080a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f4128c00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f41080a3350 0x7f41080a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4114005fd0 tx=0x7f411400b480 comp rx=0 tx=0).stop 2024-09-15T22:31:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4124077040 msgr2=0x7f41241a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:14.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.367+0000 7f4128c00640 1 --2- 172.21.15.22:0/1504435250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4124077040 0x7f41241a4b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4110005fd0 tx=0x7f411000dde0 comp rx=0 tx=0).stop 2024-09-15T22:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.368+0000 7f4123e00640 1 -- 172.21.15.22:0/1504435250 reap_dead start 2024-09-15T22:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.368+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 shutdown_connections 2024-09-15T22:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.368+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 >> 172.21.15.22:0/1504435250 conn(0x7f41240ff910 msgr2=0x7f4124101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.368+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 shutdown_connections 2024-09-15T22:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:14.368+0000 7f4128c00640 1 -- 172.21.15.22:0/1504435250 wait complete. 2024-09-15T22:31:15.260 INFO:teuthology.orchestra.run.smithi022.stdout:55834574923 2024-09-15T22:31:15.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T22:31:15.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:15 smithi022 ceph-mon[30634]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:15.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:15 smithi112 ceph-mon[35032]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:15.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:15 smithi110 ceph-mon[35282]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 -- 172.21.15.22:0/2624951902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5010e430 msgr2=0x7f9c50110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2624951902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5010e430 0x7f9c50110820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ca0 tx=0x7f9c4802a950 comp rx=0 tx=0).stop 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 -- 172.21.15.22:0/2624951902 shutdown_connections 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2624951902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50074ee0 0x7f9c5010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2624951902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c5010e430 0x7f9c50110820 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2624951902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c500745c0 0x7f9c500749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 -- 172.21.15.22:0/2624951902 >> 172.21.15.22:0/2624951902 conn(0x7f9c500fd8b0 msgr2=0x7f9c500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 -- 172.21.15.22:0/2624951902 shutdown_connections 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.952+0000 7f9c54a00640 1 -- 172.21.15.22:0/2624951902 wait complete. 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.953+0000 7f9c54a00640 1 Processor -- start 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.953+0000 7f9c54a00640 1 -- start start 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c54a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c500745c0 0x7f9c5019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c54a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50074ee0 0x7f9c5019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c54a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c5010e430 0x7f9c5019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c54a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50114180 con 0x7f9c500745c0 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c54a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50114000 con 0x7f9c5010e430 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c54a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50114300 con 0x7f9c50074ee0 2024-09-15T22:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c4de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c500745c0 0x7f9c5019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c4de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c500745c0 0x7f9c5019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39826/0 (socket says 172.21.15.22:39826) 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c4de00640 1 -- 172.21.15.22:0/2889475201 learned_addr learned my addr 172.21.15.22:0/2889475201 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c4e800640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c5010e430 0x7f9c5019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.954+0000 7f9c45400640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50074ee0 0x7f9c5019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c4de00640 1 -- 172.21.15.22:0/2889475201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50074ee0 msgr2=0x7f9c5019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c4de00640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50074ee0 0x7f9c5019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c4de00640 1 -- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c5010e430 msgr2=0x7f9c5019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c4de00640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c5010e430 0x7f9c5019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c4de00640 1 -- 172.21.15.22:0/2889475201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5019f5d0 con 0x7f9c500745c0 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c45400640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50074ee0 0x7f9c5019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c4de00640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c500745c0 0x7f9c5019a620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000e9f0 tx=0x7f9c4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000cd80 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c40010910 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5019f8c0 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40018990 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.955+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c501a71a0 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.956+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c50062980 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.958+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9c40010ac0 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c47400640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9c340a32d0 0x7f9c340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9c400d0510 con 0x7f9c500745c0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c45400640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9c340a32d0 0x7f9c340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c47400640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] conn(0x7f9c340acf00 0x7f9c340af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 --> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c40022e50 con 0x7f9c340acf00 2024-09-15T22:31:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f9c400d08c0 con 0x7f9c500745c0 2024-09-15T22:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.960+0000 7f9c4e800640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] conn(0x7f9c340acf00 0x7f9c340af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.961+0000 7f9c45400640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9c340a32d0 0x7f9c340a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9c5010f750 tx=0x7f9c38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.961+0000 7f9c4e800640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] conn(0x7f9c340acf00 0x7f9c340af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.962+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== osd.7 v2:172.21.15.110:6816/152931890 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c40022e50 con 0x7f9c340acf00 2024-09-15T22:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.976+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 --> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9c50062d80 con 0x7f9c340acf00 2024-09-15T22:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.977+0000 7f9c47400640 1 -- 172.21.15.22:0/2889475201 <== osd.7 v2:172.21.15.110:6816/152931890 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9c50062d80 con 0x7f9c340acf00 2024-09-15T22:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] conn(0x7f9c340acf00 msgr2=0x7f9c340af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] conn(0x7f9c340acf00 0x7f9c340af3a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9c340a32d0 msgr2=0x7f9c340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9c340a32d0 0x7f9c340a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9c5010f750 tx=0x7f9c38005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c500745c0 msgr2=0x7f9c5019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 --2- 172.21.15.22:0/2889475201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c500745c0 0x7f9c5019a620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000e9f0 tx=0x7f9c4000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c4e800640 1 -- 172.21.15.22:0/2889475201 reap_dead start 2024-09-15T22:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 shutdown_connections 2024-09-15T22:31:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 >> 172.21.15.22:0/2889475201 conn(0x7f9c500fd8b0 msgr2=0x7f9c500fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 shutdown_connections 2024-09-15T22:31:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:15.978+0000 7f9c54a00640 1 -- 172.21.15.22:0/2889475201 wait complete. 2024-09-15T22:31:16.619 INFO:teuthology.orchestra.run.smithi022.stdout:261993005089 2024-09-15T22:31:16.620 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T22:31:16.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.823+0000 7fccf2800640 1 -- 172.21.15.22:0/1667384523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec103ff0 msgr2=0x7fccec1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:16.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.823+0000 7fccf2800640 1 --2- 172.21.15.22:0/1667384523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec103ff0 0x7fccec1043d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009900 tx=0x7fccdc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 -- 172.21.15.22:0/1667384523 shutdown_connections 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 --2- 172.21.15.22:0/1667384523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 0x7fccec1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 --2- 172.21.15.22:0/1667384523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec109120 0x7fccec110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 --2- 172.21.15.22:0/1667384523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec103ff0 0x7fccec1043d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 -- 172.21.15.22:0/1667384523 >> 172.21.15.22:0/1667384523 conn(0x7fccec0ffa90 msgr2=0x7fccec101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 -- 172.21.15.22:0/1667384523 shutdown_connections 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.824+0000 7fccf2800640 1 -- 172.21.15.22:0/1667384523 wait complete. 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 Processor -- start 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 -- start start 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec103ff0 0x7fccec19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 0x7fccec19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec109120 0x7fccec19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fccec114190 con 0x7fccec109120 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fccec114010 con 0x7fccec103ff0 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccf2800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fccec114310 con 0x7fccec1049a0 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.825+0000 7fccebe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec109120 0x7fccec19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 0x7fccec19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 0x7fccec19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:44082/0 (socket says 172.21.15.22:44082) 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fccebe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec109120 0x7fccec19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39838/0 (socket says 172.21.15.22:39838) 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 -- 172.21.15.22:0/982711774 learned_addr learned my addr 172.21.15.22:0/982711774 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceb400640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec103ff0 0x7fccec19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 -- 172.21.15.22:0/982711774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec103ff0 msgr2=0x7fccec19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccec103ff0 0x7fccec19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 -- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec109120 msgr2=0x7fccec19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccec109120 0x7fccec19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 -- 172.21.15.22:0/982711774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccec19f5e0 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcceaa00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 0x7fccec19ab70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccd800e9f0 tx=0x7fccd800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.826+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd800ccc0 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.827+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd800ce60 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.827+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8010690 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.827+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccec19f8d0 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.827+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccec1a71b0 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.828+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccec062980 con 0x7fccec1049a0 2024-09-15T22:31:16.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.830+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fccd80046c0 con 0x7fccec1049a0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.831+0000 7fcce3e00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fccd00a32d0 0x7fccd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.831+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fccd80d0330 con 0x7fccec1049a0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.831+0000 7fcceb400640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fccd00a32d0 0x7fccd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.832+0000 7fcce3e00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] conn(0x7fccd00acf00 0x7fccd00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.832+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 --> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccd00afa70 con 0x7fccd00acf00 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.832+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fccd80d06e0 con 0x7fccec1049a0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.832+0000 7fccebe00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] conn(0x7fccd00acf00 0x7fccd00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.832+0000 7fcceb400640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fccd00a32d0 0x7fccd00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000c00 tx=0x7fccdc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.833+0000 7fccebe00640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] conn(0x7fccd00acf00 0x7fccd00af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.833+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== osd.5 v2:172.21.15.112:6808/1940652320 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccd00afa70 con 0x7fccd00acf00 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.848+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 --> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccec062e00 con 0x7fccd00acf00 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fcce3e00640 1 -- 172.21.15.22:0/982711774 <== osd.5 v2:172.21.15.112:6808/1940652320 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fccec062e00 con 0x7fccd00acf00 2024-09-15T22:31:16.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] conn(0x7fccd00acf00 msgr2=0x7fccd00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] conn(0x7fccd00acf00 0x7fccd00af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fccd00a32d0 msgr2=0x7fccd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fccd00a32d0 0x7fccd00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000c00 tx=0x7fccdc005b50 comp rx=0 tx=0).stop 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 msgr2=0x7fccec19ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 --2- 172.21.15.22:0/982711774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccec1049a0 0x7fccec19ab70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccd800e9f0 tx=0x7fccd800edf0 comp rx=0 tx=0).stop 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccebe00640 1 -- 172.21.15.22:0/982711774 reap_dead start 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 shutdown_connections 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 >> 172.21.15.22:0/982711774 conn(0x7fccec0ffa90 msgr2=0x7fccec100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 shutdown_connections 2024-09-15T22:31:16.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:16.849+0000 7fccf2800640 1 -- 172.21.15.22:0/982711774 wait complete. 2024-09-15T22:31:16.993 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:17.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:17 smithi022 ceph-mon[30634]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:17.132 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:17.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:17 smithi112 ceph-mon[35032]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:17.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:17 smithi110 ceph-mon[35282]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:17.671 INFO:teuthology.orchestra.run.smithi022.stdout:201863462957 2024-09-15T22:31:17.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T22:31:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:18.201 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:18 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:31:18.206 INFO:teuthology.orchestra.run.smithi022.stdout:150323855416 2024-09-15T22:31:18.206 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T22:31:18.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:18 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:31:18.389 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:18 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 -- 172.21.15.22:0/1932561217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 msgr2=0x7f01ec110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 --2- 172.21.15.22:0/1932561217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 0x7f01ec110910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009be0 tx=0x7f01e402a6c0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 -- 172.21.15.22:0/1932561217 shutdown_connections 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 --2- 172.21.15.22:0/1932561217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec101440 0x7f01ec10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 --2- 172.21.15.22:0/1932561217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 0x7f01ec110910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 --2- 172.21.15.22:0/1932561217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01ec100b20 0x7f01ec100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 -- 172.21.15.22:0/1932561217 >> 172.21.15.22:0/1932561217 conn(0x7f01ec0fc7d0 msgr2=0x7f01ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:18.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 -- 172.21.15.22:0/1932561217 shutdown_connections 2024-09-15T22:31:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.499+0000 7f01f4000640 1 -- 172.21.15.22:0/1932561217 wait complete. 2024-09-15T22:31:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.500+0000 7f01f4000640 1 Processor -- start 2024-09-15T22:31:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 -- start start 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01ec100b20 0x7f01ec10de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec101440 0x7f01ec10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 0x7f01ec10b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec114250 con 0x7f01ec100b20 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec1140d0 con 0x7f01ec10e500 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f4000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec1143d0 con 0x7f01ec101440 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.501+0000 7f01f1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01ec100b20 0x7f01ec10de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec101440 0x7f01ec10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:18.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 0x7f01ec10b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:18.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f1600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01ec100b20 0x7f01ec10de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39856/0 (socket says 172.21.15.22:39856) 2024-09-15T22:31:18.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f1600640 1 -- 172.21.15.22:0/1500727486 learned_addr learned my addr 172.21.15.22:0/1500727486 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:18.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 -- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec101440 msgr2=0x7f01ec10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:18.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec101440 0x7f01ec10afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 -- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01ec100b20 msgr2=0x7f01ec10de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01ec100b20 0x7f01ec10de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 -- 172.21.15.22:0/1500727486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec1aaf90 con 0x7f01ec10e500 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.502+0000 7f01f2000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 0x7f01ec10b580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01e4034040 tx=0x7f01e40305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.503+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4041020 con 0x7f01ec10e500 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.503+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec1ab160 con 0x7f01ec10e500 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.503+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e4003e50 con 0x7f01ec10e500 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.503+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4036040 con 0x7f01ec10e500 2024-09-15T22:31:18.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.503+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec1ab5b0 con 0x7f01ec10e500 2024-09-15T22:31:18.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.504+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01ec062900 con 0x7f01ec10e500 2024-09-15T22:31:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.508+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01e4044020 con 0x7f01ec10e500 2024-09-15T22:31:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.509+0000 7f01ea000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01d40a3350 0x7f01d40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.510+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f01e40f0340 con 0x7f01ec10e500 2024-09-15T22:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.510+0000 7f01f1600640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01d40a3350 0x7f01d40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.510+0000 7f01ea000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] conn(0x7f01d40acf80 0x7f01d40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.510+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 --> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01e400b0b0 con 0x7f01d40acf80 2024-09-15T22:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.510+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f01e40f0730 con 0x7f01ec10e500 2024-09-15T22:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.510+0000 7f01f0c00640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] conn(0x7f01d40acf80 0x7f01d40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.511+0000 7f01f1600640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01d40a3350 0x7f01d40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009c90 tx=0x7f01e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.511+0000 7f01f0c00640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] conn(0x7f01d40acf80 0x7f01d40af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.512+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== osd.8 v2:172.21.15.112:6816/126632637 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01e400b0b0 con 0x7f01d40acf80 2024-09-15T22:31:18.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.537+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 --> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01ec062d80 con 0x7f01d40acf80 2024-09-15T22:31:18.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.538+0000 7f01ea000640 1 -- 172.21.15.22:0/1500727486 <== osd.8 v2:172.21.15.112:6816/126632637 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f01ec062d80 con 0x7f01d40acf80 2024-09-15T22:31:18.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.538+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] conn(0x7f01d40acf80 msgr2=0x7f01d40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:18.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.538+0000 7f01f4000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] conn(0x7f01d40acf80 0x7f01d40af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01d40a3350 msgr2=0x7f01d40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01d40a3350 0x7f01d40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009c90 tx=0x7f01e0005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 msgr2=0x7f01ec10b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 --2- 172.21.15.22:0/1500727486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec10e500 0x7f01ec10b580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01e4034040 tx=0x7f01e40305d0 comp rx=0 tx=0).stop 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f2000640 1 -- 172.21.15.22:0/1500727486 reap_dead start 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 shutdown_connections 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 >> 172.21.15.22:0/1500727486 conn(0x7f01ec0fc7d0 msgr2=0x7f01ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:18.542 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:18.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 shutdown_connections 2024-09-15T22:31:18.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:18.539+0000 7f01f4000640 1 -- 172.21.15.22:0/1500727486 wait complete. 2024-09-15T22:31:18.544 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:19.070 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:19 smithi022 ceph-mon[30634]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:19.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:19 smithi112 ceph-mon[35032]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:19.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 -- 172.21.15.22:0/2384425907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c8102360 msgr2=0x7f84c810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 --2- 172.21.15.22:0/2384425907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c8102360 0x7f84c810e890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009cd0 tx=0x7f84c002a8f0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 -- 172.21.15.22:0/2384425907 shutdown_connections 2024-09-15T22:31:19.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 --2- 172.21.15.22:0/2384425907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c8102360 0x7f84c810e890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 --2- 172.21.15.22:0/2384425907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c81019c0 0x7f84c8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 --2- 172.21.15.22:0/2384425907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c81079c0 0x7f84c8107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 -- 172.21.15.22:0/2384425907 >> 172.21.15.22:0/2384425907 conn(0x7f84c80fd740 msgr2=0x7f84c80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:19.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 -- 172.21.15.22:0/2384425907 shutdown_connections 2024-09-15T22:31:19.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.287+0000 7f84cd400640 1 -- 172.21.15.22:0/2384425907 wait complete. 2024-09-15T22:31:19.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 Processor -- start 2024-09-15T22:31:19.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 -- start start 2024-09-15T22:31:19.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c81019c0 0x7f84c819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c8102360 0x7f84c819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c81079c0 0x7f84c819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8111e10 con 0x7f84c81019c0 2024-09-15T22:31:19.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8111c90 con 0x7f84c8102360 2024-09-15T22:31:19.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cd400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8111f90 con 0x7f84c81079c0 2024-09-15T22:31:19.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84c7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c81019c0 0x7f84c819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84c7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c8102360 0x7f84c819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84c7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c8102360 0x7f84c819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:36776/0 (socket says 172.21.15.22:36776) 2024-09-15T22:31:19.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84c7400640 1 -- 172.21.15.22:0/2523910488 learned_addr learned my addr 172.21.15.22:0/2523910488 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:19.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.289+0000 7f84cca00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c81079c0 0x7f84c819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c7400640 1 -- 172.21.15.22:0/2523910488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c81079c0 msgr2=0x7f84c819ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c7400640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c81079c0 0x7f84c819ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c7400640 1 -- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c81019c0 msgr2=0x7f84c819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c7400640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c81019c0 0x7f84c819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c7400640 1 -- 172.21.15.22:0/2523910488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c819f3d0 con 0x7f84c8102360 2024-09-15T22:31:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c7400640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c8102360 0x7f84c819a960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ea60 tx=0x7f84b400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b400cde0 con 0x7f84c8102360 2024-09-15T22:31:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c819f6c0 con 0x7f84c8102360 2024-09-15T22:31:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b40035f0 con 0x7f84c8102360 2024-09-15T22:31:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.290+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4010670 con 0x7f84c8102360 2024-09-15T22:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.291+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c81a6fa0 con 0x7f84c8102360 2024-09-15T22:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.291+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84c80ff760 con 0x7f84c8102360 2024-09-15T22:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.294+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f84b40037a0 con 0x7f84c8102360 2024-09-15T22:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.295+0000 7f84c4c00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84ac0a32d0 0x7f84ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f84b40d0070 con 0x7f84c8102360 2024-09-15T22:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84c7e00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84ac0a32d0 0x7f84ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84c4c00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] conn(0x7f84ac0acf00 0x7f84ac0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 --> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84b4023e50 con 0x7f84ac0acf00 2024-09-15T22:31:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f84b40d0420 con 0x7f84c8102360 2024-09-15T22:31:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84cca00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] conn(0x7f84ac0acf00 0x7f84ac0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.296+0000 7f84c7e00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84ac0a32d0 0x7f84ac0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009b50 tx=0x7f84b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:19.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.297+0000 7f84cca00640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] conn(0x7f84ac0acf00 0x7f84ac0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.298+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== osd.4 v2:172.21.15.110:6808/2813378643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84b4023e50 con 0x7f84ac0acf00 2024-09-15T22:31:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.312+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 --> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84c8103100 con 0x7f84ac0acf00 2024-09-15T22:31:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.312+0000 7f84c4c00640 1 -- 172.21.15.22:0/2523910488 <== osd.4 v2:172.21.15.110:6808/2813378643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f84c8103100 con 0x7f84ac0acf00 2024-09-15T22:31:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] conn(0x7f84ac0acf00 msgr2=0x7f84ac0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] conn(0x7f84ac0acf00 0x7f84ac0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84ac0a32d0 msgr2=0x7f84ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84ac0a32d0 0x7f84ac0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009b50 tx=0x7f84b8005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c8102360 msgr2=0x7f84c819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 --2- 172.21.15.22:0/2523910488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84c8102360 0x7f84c819a960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84b400ea60 tx=0x7f84b400ef20 comp rx=0 tx=0).stop 2024-09-15T22:31:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cca00640 1 -- 172.21.15.22:0/2523910488 reap_dead start 2024-09-15T22:31:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 shutdown_connections 2024-09-15T22:31:19.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 >> 172.21.15.22:0/2523910488 conn(0x7f84c80fd740 msgr2=0x7f84c80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:19.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 shutdown_connections 2024-09-15T22:31:19.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.313+0000 7f84cd400640 1 -- 172.21.15.22:0/2523910488 wait complete. 2024-09-15T22:31:19.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:19 smithi110 ceph-mon[35282]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 7.4 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:19.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 -- 172.21.15.22:0/1126607746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80501047e0 msgr2=0x7f8050108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 --2- 172.21.15.22:0/1126607746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80501047e0 0x7f8050108830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f803c009900 tx=0x7f803c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 -- 172.21.15.22:0/1126607746 shutdown_connections 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 --2- 172.21.15.22:0/1126607746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8050108f60 0x7f8050110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 --2- 172.21.15.22:0/1126607746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80501047e0 0x7f8050108830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 --2- 172.21.15.22:0/1126607746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8050103e30 0x7f8050104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 -- 172.21.15.22:0/1126607746 >> 172.21.15.22:0/1126607746 conn(0x7f80500ff8d0 msgr2=0x7f8050101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 -- 172.21.15.22:0/1126607746 shutdown_connections 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.398+0000 7f8056c00640 1 -- 172.21.15.22:0/1126607746 wait complete. 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.399+0000 7f8056c00640 1 Processor -- start 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 -- start start 2024-09-15T22:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 0x7f805019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80501047e0 0x7f805019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8050108f60 0x7f805019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8050113fc0 con 0x7f8050108f60 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8050113e40 con 0x7f8050103e30 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.400+0000 7f8056c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8050114140 con 0x7f80501047e0 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 0x7f805019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 0x7f805019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:36796/0 (socket says 172.21.15.22:36796) 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 -- 172.21.15.22:0/2894157131 learned_addr learned my addr 172.21.15.22:0/2894157131 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8054e00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80501047e0 0x7f805019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8056200640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8050108f60 0x7f805019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 -- 172.21.15.22:0/2894157131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80501047e0 msgr2=0x7f805019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80501047e0 0x7f805019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 -- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8050108f60 msgr2=0x7f805019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8050108f60 0x7f805019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 -- 172.21.15.22:0/2894157131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805019f400 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8054e00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80501047e0 0x7f805019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.401+0000 7f8055800640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 0x7f805019a450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f804400e9f0 tx=0x7f804400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.402+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804400cd80 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.402+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8044010910 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.402+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805019f6f0 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.402+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80440188f0 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.402+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80501a6fd0 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.403+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8050104210 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.405+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8044010ac0 con 0x7f8050103e30 2024-09-15T22:31:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.406+0000 7f804e000640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f80380a3350 0x7f80380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:19.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.406+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f80440d0240 con 0x7f8050103e30 2024-09-15T22:31:19.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.406+0000 7f8054e00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f80380a3350 0x7f80380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:19.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.407+0000 7f8054e00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f80380a3350 0x7f80380a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f80500ffcf0 tx=0x7f803c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:19.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.408+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f804409cdc0 con 0x7f8050103e30 2024-09-15T22:31:19.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.600+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f805019b7b0 con 0x7f8050103e30 2024-09-15T22:31:19.752 INFO:teuthology.orchestra.run.smithi022.stdout:309237645336 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.600+0000 7f804e000640 1 -- 172.21.15.22:0/2894157131 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f805019b7b0 con 0x7f8050103e30 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f80380a3350 msgr2=0x7f80380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f80380a3350 0x7f80380a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f80500ffcf0 tx=0x7f803c005a20 comp rx=0 tx=0).stop 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 msgr2=0x7f805019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 0x7f805019a450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f804400e9f0 tx=0x7f804400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 shutdown_connections 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80501047e0 0x7f805019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f80380a3350 0x7f80380a5810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8050108f60 0x7f805019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 --2- 172.21.15.22:0/2894157131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8050103e30 0x7f805019a450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 >> 172.21.15.22:0/2894157131 conn(0x7f80500ff8d0 msgr2=0x7f8050100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 shutdown_connections 2024-09-15T22:31:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:19.603+0000 7f8056c00640 1 -- 172.21.15.22:0/2894157131 wait complete. 2024-09-15T22:31:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:20 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:20 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2894157131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:31:20.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:20 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:20 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2894157131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:31:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:20 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:20.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:20 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2894157131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:31:21.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 -- 172.21.15.22:0/619563798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 msgr2=0x7f2b08100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:21.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 --2- 172.21.15.22:0/619563798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b08100d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009900 tx=0x7f2af802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 -- 172.21.15.22:0/619563798 shutdown_connections 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 --2- 172.21.15.22:0/619563798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b0810e4e0 0x7f2b081108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 --2- 172.21.15.22:0/619563798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b081012e0 0x7f2b0810dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 --2- 172.21.15.22:0/619563798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b08100d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 -- 172.21.15.22:0/619563798 >> 172.21.15.22:0/619563798 conn(0x7f2b080fc7a0 msgr2=0x7f2b080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 -- 172.21.15.22:0/619563798 shutdown_connections 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.068+0000 7f2b0e200640 1 -- 172.21.15.22:0/619563798 wait complete. 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 Processor -- start 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 -- start start 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b0819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b081012e0 0x7f2b0819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b0810e4e0 0x7f2b0819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2b081141c0 con 0x7f2b08100930 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2b08114040 con 0x7f2b0810e4e0 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.069+0000 7f2b0e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b08114340 con 0x7f2b081012e0 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b0819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b0819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46616/0 (socket says 172.21.15.22:46616) 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 -- 172.21.15.22:0/1496705575 learned_addr learned my addr 172.21.15.22:0/1496705575 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b06a00640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b081012e0 0x7f2b0819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07e00640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b0810e4e0 0x7f2b0819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 -- 172.21.15.22:0/1496705575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b081012e0 msgr2=0x7f2b0819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b081012e0 0x7f2b0819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 -- 172.21.15.22:0/1496705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b0810e4e0 msgr2=0x7f2b0819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b0810e4e0 0x7f2b0819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 -- 172.21.15.22:0/1496705575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0819f690 con 0x7f2b08100930 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b06a00640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b081012e0 0x7f2b0819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.070+0000 7f2b07400640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b0819a6e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2af8004770 tx=0x7f2af8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stdout:98784247874 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.071+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af803f070 con 0x7f2b08100930 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.071+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af8031ca0 con 0x7f2b08100930 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.071+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0819f920 con 0x7f2b08100930 2024-09-15T22:31:21.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.071+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8035030 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.071+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b081a7260 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.072+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0806b010 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.074+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2af8042070 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.075+0000 7f2affe00640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2aec0a32d0 0x7f2aec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.075+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f2af80efea0 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.075+0000 7f2b06a00640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2aec0a32d0 0x7f2aec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.076+0000 7f2b06a00640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2aec0a32d0 0x7f2aec0a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b0810edb0 tx=0x7f2af400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.079+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2af80bc3d0 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.269+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2b08109670 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.270+0000 7f2affe00640 1 -- 172.21.15.22:0/1496705575 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2af80c06d0 con 0x7f2b08100930 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2aec0a32d0 msgr2=0x7f2aec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2aec0a32d0 0x7f2aec0a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b0810edb0 tx=0x7f2af400b410 comp rx=0 tx=0).stop 2024-09-15T22:31:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 msgr2=0x7f2b0819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b0819a6e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2af8004770 tx=0x7f2af8003c10 comp rx=0 tx=0).stop 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 shutdown_connections 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b081012e0 0x7f2b0819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2aec0a32d0 0x7f2aec0a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b0810e4e0 0x7f2b0819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 --2- 172.21.15.22:0/1496705575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b08100930 0x7f2b0819a6e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.272+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 >> 172.21.15.22:0/1496705575 conn(0x7f2b080fc7a0 msgr2=0x7f2b080feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.273+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 shutdown_connections 2024-09-15T22:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:21.273+0000 7f2b0e200640 1 -- 172.21.15.22:0/1496705575 wait complete. 2024-09-15T22:31:21.371 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:21 smithi110 ceph-mon[35282]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 6.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:21.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:21 smithi022 ceph-mon[30634]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 6.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:21.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:21 smithi112 ceph-mon[35032]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 6.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.009+0000 7f8ad4600640 1 -- 172.21.15.22:0/1073020524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc10e3c0 msgr2=0x7f8acc110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.009+0000 7f8ad4600640 1 --2- 172.21.15.22:0/1073020524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc10e3c0 0x7f8acc110810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009ca0 tx=0x7f8ac402a950 comp rx=0 tx=0).stop 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 -- 172.21.15.22:0/1073020524 shutdown_connections 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 --2- 172.21.15.22:0/1073020524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074f40 0x7f8acc10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 --2- 172.21.15.22:0/1073020524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc10e3c0 0x7f8acc110810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 --2- 172.21.15.22:0/1073020524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc074620 0x7f8acc074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 -- 172.21.15.22:0/1073020524 >> 172.21.15.22:0/1073020524 conn(0x7f8acc0fd8c0 msgr2=0x7f8acc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 -- 172.21.15.22:0/1073020524 shutdown_connections 2024-09-15T22:31:22.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.010+0000 7f8ad4600640 1 -- 172.21.15.22:0/1073020524 wait complete. 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 Processor -- start 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 -- start start 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074620 0x7f8acc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc074f40 0x7f8acc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc10e3c0 0x7f8acc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1141c0 con 0x7f8acc074f40 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc114040 con 0x7f8acc10e3c0 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad4600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc114340 con 0x7f8acc074620 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074620 0x7f8acc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.011+0000 7f8ad1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc074f40 0x7f8acc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074620 0x7f8acc19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47268/0 (socket says 172.21.15.22:47268) 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 -- 172.21.15.22:0/2106416840 learned_addr learned my addr 172.21.15.22:0/2106416840 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad2600640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc10e3c0 0x7f8acc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:22.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 -- 172.21.15.22:0/2106416840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc10e3c0 msgr2=0x7f8acc19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:22.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8acc10e3c0 0x7f8acc19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 -- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc074f40 msgr2=0x7f8acc19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:22.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8acc074f40 0x7f8acc19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 -- 172.21.15.22:0/2106416840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc19f610 con 0x7f8acc074620 2024-09-15T22:31:22.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.012+0000 7f8ad1c00640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074620 0x7f8acc19a660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000e9f0 tx=0x7f8ac000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.013+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000cd80 con 0x7f8acc074620 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.013+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac0010910 con 0x7f8acc074620 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.013+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0018990 con 0x7f8acc074620 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.013+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8acc19f900 con 0x7f8acc074620 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.013+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8acc1a71e0 con 0x7f8acc074620 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.014+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8acc0fff30 con 0x7f8acc074620 2024-09-15T22:31:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.016+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8ac0010ac0 con 0x7f8acc074620 2024-09-15T22:31:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.017+0000 7f8aca000640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8ab40a3350 0x7f8ab40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.017+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8ac00d0410 con 0x7f8acc074620 2024-09-15T22:31:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.018+0000 7f8ad1200640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8ab40a3350 0x7f8ab40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.018+0000 7f8aca000640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] conn(0x7f8ab40acf80 0x7f8ab40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.018+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 --> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ac0019ec0 con 0x7f8ab40acf80 2024-09-15T22:31:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.018+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f8ac00d07c0 con 0x7f8acc074620 2024-09-15T22:31:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.018+0000 7f8ad2600640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] conn(0x7f8ab40acf80 0x7f8ab40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.018+0000 7f8ad1200640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8ab40a3350 0x7f8ab40a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8acc10f750 tx=0x7f8ab8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.019+0000 7f8ad2600640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] conn(0x7f8ab40acf80 0x7f8ab40af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.020+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== osd.6 v2:172.21.15.22:6818/4293876036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ac0019ec0 con 0x7f8ab40acf80 2024-09-15T22:31:22.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 --> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8acc075cd0 con 0x7f8ab40acf80 2024-09-15T22:31:22.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8aca000640 1 -- 172.21.15.22:0/2106416840 <== osd.6 v2:172.21.15.22:6818/4293876036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8acc075cd0 con 0x7f8ab40acf80 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] conn(0x7f8ab40acf80 msgr2=0x7f8ab40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] conn(0x7f8ab40acf80 0x7f8ab40af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8ab40a3350 msgr2=0x7f8ab40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8ab40a3350 0x7f8ab40a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8acc10f750 tx=0x7f8ab8005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074620 msgr2=0x7f8acc19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.035+0000 7f8ad4600640 1 --2- 172.21.15.22:0/2106416840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8acc074620 0x7f8acc19a660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000e9f0 tx=0x7f8ac000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.036+0000 7f8ad2600640 1 -- 172.21.15.22:0/2106416840 reap_dead start 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.036+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 shutdown_connections 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.036+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 >> 172.21.15.22:0/2106416840 conn(0x7f8acc0fd8c0 msgr2=0x7f8acc0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.036+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 shutdown_connections 2024-09-15T22:31:22.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:22.036+0000 7f8ad4600640 1 -- 172.21.15.22:0/2106416840 wait complete. 2024-09-15T22:31:22.190 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:22 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1496705575' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:31:22.192 INFO:teuthology.orchestra.run.smithi022.stdout:231928234025 2024-09-15T22:31:22.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T22:31:22.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:22 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1496705575' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:31:22.502 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:22 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1496705575' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:31:22.903 INFO:teuthology.orchestra.run.smithi022.stdout:180388626483 2024-09-15T22:31:22.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T22:31:23.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:23 smithi110 ceph-mon[35282]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 5.6 KiB/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:31:23.490 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:23 smithi022 ceph-mon[30634]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 5.6 KiB/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:31:23.527 INFO:teuthology.orchestra.run.smithi022.stdout:73014444104 2024-09-15T22:31:23.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T22:31:23.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:23 smithi112 ceph-mon[35032]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 5.6 KiB/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:31:24.350 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247872 got 98784247874 for osd.3 2024-09-15T22:31:24.350 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:24.697 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645334 got 309237645336 for osd.11 2024-09-15T22:31:24.697 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:24.908 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:25 smithi022 ceph-mon[30634]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:31:25.329 INFO:teuthology.orchestra.run.smithi022.stdout:128849018941 2024-09-15T22:31:25.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T22:31:25.343 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 -- 172.21.15.22:0/659134385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5488103ff0 msgr2=0x7f54881043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 --2- 172.21.15.22:0/659134385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5488103ff0 0x7f54881043d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5478009900 tx=0x7f547802a410 comp rx=0 tx=0).stop 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 -- 172.21.15.22:0/659134385 shutdown_connections 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 --2- 172.21.15.22:0/659134385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488109120 0x7f5488110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 --2- 172.21.15.22:0/659134385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54881049a0 0x7f54881089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 --2- 172.21.15.22:0/659134385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5488103ff0 0x7f54881043d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 -- 172.21.15.22:0/659134385 >> 172.21.15.22:0/659134385 conn(0x7f54880ffa90 msgr2=0x7f5488101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 -- 172.21.15.22:0/659134385 shutdown_connections 2024-09-15T22:31:25.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.011+0000 7f548f400640 1 -- 172.21.15.22:0/659134385 wait complete. 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 Processor -- start 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 -- start start 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488103ff0 0x7f548819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54881049a0 0x7f548819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5488109120 0x7f548819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5488114120 con 0x7f54881049a0 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5488113fa0 con 0x7f5488109120 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.013+0000 7f548f400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f54881142a0 con 0x7f5488103ff0 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488103ff0 0x7f548819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f547fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54881049a0 0x7f548819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488103ff0 0x7f548819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47294/0 (socket says 172.21.15.22:47294) 2024-09-15T22:31:25.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f547fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54881049a0 0x7f548819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46658/0 (socket says 172.21.15.22:46658) 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 -- 172.21.15.22:0/3799490352 learned_addr learned my addr 172.21.15.22:0/3799490352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548d400640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5488109120 0x7f548819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 -- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5488109120 msgr2=0x7f548819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5488109120 0x7f548819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 -- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54881049a0 msgr2=0x7f548819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54881049a0 0x7f548819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 -- 172.21.15.22:0/3799490352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548819f5d0 con 0x7f5488103ff0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f547fe00640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54881049a0 0x7f548819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.014+0000 7f548ca00640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488103ff0 0x7f548819a620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5478006010 tx=0x7f5478004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.015+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547803f030 con 0x7f5488103ff0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.015+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5478004440 con 0x7f5488103ff0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.015+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548819f860 con 0x7f5488103ff0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.015+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478035070 con 0x7f5488103ff0 2024-09-15T22:31:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.015+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54881a71a0 con 0x7f5488103ff0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.016+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5488062980 con 0x7f5488103ff0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.018+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5478042030 con 0x7f5488103ff0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.019+0000 7f5486000640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f546c0a32d0 0x7f546c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.019+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f54780f0690 con 0x7f5488103ff0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.019+0000 7f547fe00640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f546c0a32d0 0x7f546c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.020+0000 7f5486000640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] conn(0x7f546c0acf00 0x7f546c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.020+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 --> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f546c0afa70 con 0x7f546c0acf00 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.020+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f54780f0a40 con 0x7f5488103ff0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.020+0000 7f548d400640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] conn(0x7f546c0acf00 0x7f546c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.020+0000 7f547fe00640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f546c0a32d0 0x7f546c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54880ffeb0 tx=0x7f5470005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.021+0000 7f548d400640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] conn(0x7f546c0acf00 0x7f546c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.022+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== osd.10 v2:172.21.15.110:6824/1916851446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f546c0afa70 con 0x7f546c0acf00 2024-09-15T22:31:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.037+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 --> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5488062e00 con 0x7f546c0acf00 2024-09-15T22:31:25.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.037+0000 7f5486000640 1 -- 172.21.15.22:0/3799490352 <== osd.10 v2:172.21.15.110:6824/1916851446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5488062e00 con 0x7f546c0acf00 2024-09-15T22:31:25.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.037+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] conn(0x7f546c0acf00 msgr2=0x7f546c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:25.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.037+0000 7f548f400640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] conn(0x7f546c0acf00 0x7f546c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:25.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f546c0a32d0 msgr2=0x7f546c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:25.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f546c0a32d0 0x7f546c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54880ffeb0 tx=0x7f5470005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488103ff0 msgr2=0x7f548819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 --2- 172.21.15.22:0/3799490352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5488103ff0 0x7f548819a620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5478006010 tx=0x7f5478004040 comp rx=0 tx=0).stop 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548d400640 1 -- 172.21.15.22:0/3799490352 reap_dead start 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 shutdown_connections 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 >> 172.21.15.22:0/3799490352 conn(0x7f54880ffa90 msgr2=0x7f5488100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 shutdown_connections 2024-09-15T22:31:25.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:25.038+0000 7f548f400640 1 -- 172.21.15.22:0/3799490352 wait complete. 2024-09-15T22:31:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:25 smithi110 ceph-mon[35282]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:31:25.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:25 smithi112 ceph-mon[35032]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:31:26.154 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:26.169 INFO:teuthology.orchestra.run.smithi022.stdout:279172874270 2024-09-15T22:31:26.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 -- 172.21.15.22:0/4118017702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa22410e3c0 msgr2=0x7fa224110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 --2- 172.21.15.22:0/4118017702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa22410e3c0 0x7fa224110810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009ca0 tx=0x7fa21c02a950 comp rx=0 tx=0).stop 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 -- 172.21.15.22:0/4118017702 shutdown_connections 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 --2- 172.21.15.22:0/4118017702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa22410e3c0 0x7fa224110810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 --2- 172.21.15.22:0/4118017702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074f40 0x7fa22410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 --2- 172.21.15.22:0/4118017702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa224074620 0x7fa224074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 -- 172.21.15.22:0/4118017702 >> 172.21.15.22:0/4118017702 conn(0x7fa2240fd8c0 msgr2=0x7fa2240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 -- 172.21.15.22:0/4118017702 shutdown_connections 2024-09-15T22:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.910+0000 7fa22aa00640 1 -- 172.21.15.22:0/4118017702 wait complete. 2024-09-15T22:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 Processor -- start 2024-09-15T22:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 -- start start 2024-09-15T22:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 0x7fa22419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa224074f40 0x7fa22419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa22410e3c0 0x7fa22419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa224114160 con 0x7fa224074f40 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa224113fe0 con 0x7fa224074620 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.911+0000 7fa22aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241142e0 con 0x7fa22410e3c0 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa224074f40 0x7fa22419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 0x7fa22419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 0x7fa22419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56190/0 (socket says 172.21.15.22:56190) 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa228a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa22410e3c0 0x7fa22419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa224074f40 0x7fa22419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46678/0 (socket says 172.21.15.22:46678) 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 -- 172.21.15.22:0/3129520320 learned_addr learned my addr 172.21.15.22:0/3129520320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 -- 172.21.15.22:0/3129520320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa22410e3c0 msgr2=0x7fa22419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa22410e3c0 0x7fa22419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 -- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa224074f40 msgr2=0x7fa22419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa224074f40 0x7fa22419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa223e00640 1 -- 172.21.15.22:0/3129520320 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22419f640 con 0x7fa224074620 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.912+0000 7fa228a00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa22410e3c0 0x7fa22419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.913+0000 7fa223e00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 0x7fa22419a690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa21400e9f0 tx=0x7fa21400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.913+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21400cd80 con 0x7fa224074620 2024-09-15T22:31:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.913+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22419f930 con 0x7fa224074620 2024-09-15T22:31:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.913+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa214005500 con 0x7fa224074620 2024-09-15T22:31:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.913+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214010690 con 0x7fa224074620 2024-09-15T22:31:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.913+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2241a7210 con 0x7fa224074620 2024-09-15T22:31:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.914+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224074a00 con 0x7fa224074620 2024-09-15T22:31:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.916+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa2140046c0 con 0x7fa224074620 2024-09-15T22:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.917+0000 7fa220c00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2080a32d0 0x7fa2080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.918+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fa2140d0180 con 0x7fa224074620 2024-09-15T22:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.918+0000 7fa223400640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2080a32d0 0x7fa2080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.918+0000 7fa223400640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2080a32d0 0x7fa2080a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2240ffee0 tx=0x7fa210005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:26.919+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa21409cd00 con 0x7fa224074620 2024-09-15T22:31:27.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.109+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa2241095a0 con 0x7fa224074620 2024-09-15T22:31:27.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.110+0000 7fa220c00640 1 -- 172.21.15.22:0/3129520320 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa21409c600 con 0x7fa224074620 2024-09-15T22:31:27.112 INFO:teuthology.orchestra.run.smithi022.stdout:34359738452 2024-09-15T22:31:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2080a32d0 msgr2=0x7fa2080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2080a32d0 0x7fa2080a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2240ffee0 tx=0x7fa210005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 msgr2=0x7fa22419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 0x7fa22419a690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa21400e9f0 tx=0x7fa21400edf0 comp rx=0 tx=0).stop 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 shutdown_connections 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa22410e3c0 0x7fa22419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa2080a32d0 0x7fa2080a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa224074f40 0x7fa22419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 --2- 172.21.15.22:0/3129520320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa224074620 0x7fa22419a690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.112+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 >> 172.21.15.22:0/3129520320 conn(0x7fa2240fd8c0 msgr2=0x7fa2240fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.113+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 shutdown_connections 2024-09-15T22:31:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:27.113+0000 7fa22aa00640 1 -- 172.21.15.22:0/3129520320 wait complete. 2024-09-15T22:31:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:27 smithi110 ceph-mon[35282]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:31:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:27 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3129520320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:31:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:27 smithi022 ceph-mon[30634]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:31:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:27 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3129520320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:31:27.537 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:27.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:27 smithi112 ceph-mon[35032]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:31:27.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:27 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3129520320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:31:28.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 -- 172.21.15.22:0/1095195259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088108f60 msgr2=0x7f6088110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:28.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 --2- 172.21.15.22:0/1095195259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088108f60 0x7f6088110ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6080009ca0 tx=0x7f608002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 -- 172.21.15.22:0/1095195259 shutdown_connections 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 --2- 172.21.15.22:0/1095195259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60881047e0 0x7f6088108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 --2- 172.21.15.22:0/1095195259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088108f60 0x7f6088110ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 --2- 172.21.15.22:0/1095195259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088103e30 0x7f6088104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 -- 172.21.15.22:0/1095195259 >> 172.21.15.22:0/1095195259 conn(0x7f60880ff910 msgr2=0x7f6088101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 -- 172.21.15.22:0/1095195259 shutdown_connections 2024-09-15T22:31:28.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.203+0000 7f608d800640 1 -- 172.21.15.22:0/1095195259 wait complete. 2024-09-15T22:31:28.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.204+0000 7f608d800640 1 Processor -- start 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 -- start start 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 0x7f608819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60881047e0 0x7f608819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088108f60 0x7f608819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6088114010 con 0x7f6088103e30 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6088113e90 con 0x7f6088108f60 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608d800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6088114190 con 0x7f60881047e0 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f6087e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 0x7f608819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f6087e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 0x7f608819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46698/0 (socket says 172.21.15.22:46698) 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f6087e00640 1 -- 172.21.15.22:0/3790611978 learned_addr learned my addr 172.21.15.22:0/3790611978 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f608ce00640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088108f60 0x7f608819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.205+0000 7f6087400640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60881047e0 0x7f608819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:28.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6087e00640 1 -- 172.21.15.22:0/3790611978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60881047e0 msgr2=0x7f608819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:28.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6087e00640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60881047e0 0x7f608819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6087e00640 1 -- 172.21.15.22:0/3790611978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088108f60 msgr2=0x7f608819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:28.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6087e00640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088108f60 0x7f608819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6087e00640 1 -- 172.21.15.22:0/3790611978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608819f3e0 con 0x7f6088103e30 2024-09-15T22:31:28.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f608ce00640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088108f60 0x7f608819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:28.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6087e00640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 0x7f608819a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f607800e9f0 tx=0x7f607800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:28.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607800cd80 con 0x7f6088103e30 2024-09-15T22:31:28.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078010910 con 0x7f6088103e30 2024-09-15T22:31:28.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608819f6d0 con 0x7f6088103e30 2024-09-15T22:31:28.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078018990 con 0x7f6088103e30 2024-09-15T22:31:28.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.206+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60881a6fb0 con 0x7f6088103e30 2024-09-15T22:31:28.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.208+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6088105310 con 0x7f6088103e30 2024-09-15T22:31:28.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.209+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6078010ac0 con 0x7f6088103e30 2024-09-15T22:31:28.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.211+0000 7f6084c00640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f606c0a32d0 0x7f606c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:28.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.211+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f60780d0120 con 0x7f6088103e30 2024-09-15T22:31:28.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.211+0000 7f6087400640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f606c0a32d0 0x7f606c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:28.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.212+0000 7f6087400640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f606c0a32d0 0x7f606c0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f608810a3c0 tx=0x7f6074005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:28.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.215+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f607809cca0 con 0x7f6088103e30 2024-09-15T22:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.405+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6088104210 con 0x7f6088103e30 2024-09-15T22:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.406+0000 7f6084c00640 1 -- 172.21.15.22:0/3790611978 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f607809c5a0 con 0x7f6088103e30 2024-09-15T22:31:28.408 INFO:teuthology.orchestra.run.smithi022.stdout:150323855418 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f606c0a32d0 msgr2=0x7f606c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f606c0a32d0 0x7f606c0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f608810a3c0 tx=0x7f6074005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 msgr2=0x7f608819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 0x7f608819a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f607800e9f0 tx=0x7f607800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 shutdown_connections 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60881047e0 0x7f608819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f606c0a32d0 0x7f606c0a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6088108f60 0x7f608819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 --2- 172.21.15.22:0/3790611978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6088103e30 0x7f608819a430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 >> 172.21.15.22:0/3790611978 conn(0x7f60880ff910 msgr2=0x7f6088100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 shutdown_connections 2024-09-15T22:31:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:28.408+0000 7f608d800640 1 -- 172.21.15.22:0/3790611978 wait complete. 2024-09-15T22:31:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:28.591 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:28.632 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738452 for osd.0 2024-09-15T22:31:28.632 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:28.788 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:29.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:29 smithi022 ceph-mon[30634]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:29.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:29 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3790611978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:31:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:29 smithi110 ceph-mon[35282]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:29 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3790611978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:31:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:29 smithi112 ceph-mon[35032]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:29 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3790611978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 -- 172.21.15.22:0/1536356550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc109120 msgr2=0x7f2ccc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 --2- 172.21.15.22:0/1536356550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc109120 0x7f2ccc110ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009ca0 tx=0x7f2cc402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 -- 172.21.15.22:0/1536356550 shutdown_connections 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 --2- 172.21.15.22:0/1536356550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc109120 0x7f2ccc110ca0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 --2- 172.21.15.22:0/1536356550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc1049a0 0x7f2ccc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 --2- 172.21.15.22:0/1536356550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 -- 172.21.15.22:0/1536356550 >> 172.21.15.22:0/1536356550 conn(0x7f2ccc0ffa90 msgr2=0x7f2ccc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.828+0000 7f2cd4600640 1 -- 172.21.15.22:0/1536356550 shutdown_connections 2024-09-15T22:31:29.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.829+0000 7f2cd4600640 1 -- 172.21.15.22:0/1536356550 wait complete. 2024-09-15T22:31:29.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.830+0000 7f2cd4600640 1 Processor -- start 2024-09-15T22:31:29.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.830+0000 7f2cd4600640 1 -- start start 2024-09-15T22:31:29.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.830+0000 7f2cd4600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:29.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.830+0000 7f2cd4600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc1049a0 0x7f2ccc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:29.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.830+0000 7f2cd4600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ccc109120 0x7f2ccc19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:29.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.830+0000 7f2cd4600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1141a0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd4600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc114020 con 0x7f2ccc103ff0 2024-09-15T22:31:29.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd4600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc114320 con 0x7f2ccc109120 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc1049a0 0x7f2ccc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56244/0 (socket says 172.21.15.22:56244) 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1c00640 1 -- 172.21.15.22:0/3607691833 learned_addr learned my addr 172.21.15.22:0/3607691833 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd2600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ccc109120 0x7f2ccc19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1200640 1 -- 172.21.15.22:0/3607691833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ccc109120 msgr2=0x7f2ccc19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1200640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ccc109120 0x7f2ccc19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1200640 1 -- 172.21.15.22:0/3607691833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 msgr2=0x7f2ccc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:29.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1200640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1200640 1 -- 172.21.15.22:0/3607691833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc19f5b0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.831+0000 7f2cd1c00640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.832+0000 7f2cd1200640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc1049a0 0x7f2ccc19ab40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800e9f0 tx=0x7f2cb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.832+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800cd80 con 0x7f2ccc1049a0 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.832+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc19f8a0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.832+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb80035f0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.832+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8010670 con 0x7f2ccc1049a0 2024-09-15T22:31:29.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.832+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc1a7180 con 0x7f2ccc1049a0 2024-09-15T22:31:29.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.834+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ccc1043d0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.837+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2cb80037a0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.839+0000 7f2cca000640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2cb40a3350 0x7f2cb40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:29.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.839+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f2cb80cfde0 con 0x7f2ccc1049a0 2024-09-15T22:31:29.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.839+0000 7f2cd1c00640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2cb40a3350 0x7f2cb40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:29.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.840+0000 7f2cd1c00640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2cb40a3350 0x7f2cb40a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0011500 tx=0x7f2cc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:29.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:29.841+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cb809c9f0 con 0x7f2ccc1049a0 2024-09-15T22:31:30.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.041+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2ccc19b960 con 0x7f2ccc1049a0 2024-09-15T22:31:30.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.041+0000 7f2cca000640 1 -- 172.21.15.22:0/3607691833 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2ccc19b960 con 0x7f2ccc1049a0 2024-09-15T22:31:30.044 INFO:teuthology.orchestra.run.smithi022.stdout:201863462959 2024-09-15T22:31:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.045+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2cb40a3350 msgr2=0x7f2cb40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.045+0000 7f2cd4600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2cb40a3350 0x7f2cb40a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0011500 tx=0x7f2cc0005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.045+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc1049a0 msgr2=0x7f2ccc19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.045+0000 7f2cd4600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc1049a0 0x7f2ccc19ab40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800e9f0 tx=0x7f2cb800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 shutdown_connections 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ccc109120 0x7f2ccc19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2cb40a3350 0x7f2cb40a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc1049a0 0x7f2ccc19ab40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 --2- 172.21.15.22:0/3607691833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc103ff0 0x7f2ccc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 >> 172.21.15.22:0/3607691833 conn(0x7f2ccc0ffa90 msgr2=0x7f2ccc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 shutdown_connections 2024-09-15T22:31:30.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.046+0000 7f2cd4600640 1 -- 172.21.15.22:0/3607691833 wait complete. 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 -- 172.21.15.22:0/543345939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c102360 msgr2=0x7f078c10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 --2- 172.21.15.22:0/543345939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c102360 0x7f078c10e890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0784009cd0 tx=0x7f078402a8f0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 -- 172.21.15.22:0/543345939 shutdown_connections 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 --2- 172.21.15.22:0/543345939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1019c0 0x7f078c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 --2- 172.21.15.22:0/543345939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c102360 0x7f078c10e890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 --2- 172.21.15.22:0/543345939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c1079c0 0x7f078c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 -- 172.21.15.22:0/543345939 >> 172.21.15.22:0/543345939 conn(0x7f078c0fd740 msgr2=0x7f078c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.109+0000 7f0790c00640 1 -- 172.21.15.22:0/543345939 shutdown_connections 2024-09-15T22:31:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.110+0000 7f0790c00640 1 -- 172.21.15.22:0/543345939 wait complete. 2024-09-15T22:31:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 Processor -- start 2024-09-15T22:31:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 -- start start 2024-09-15T22:31:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c1019c0 0x7f078c1088f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c102360 0x7f078c108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 0x7f078c109370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f078c111e10 con 0x7f078c1019c0 2024-09-15T22:31:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f078c111c90 con 0x7f078c102360 2024-09-15T22:31:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.111+0000 7f0790c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f078c111f90 con 0x7f078c1079c0 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c1019c0 0x7f078c1088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 0x7f078c109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 0x7f078c109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46572/0 (socket says 172.21.15.22:46572) 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 -- 172.21.15.22:0/1552594947 learned_addr learned my addr 172.21.15.22:0/1552594947 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078aa00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c102360 0x7f078c108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 -- 172.21.15.22:0/1552594947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c102360 msgr2=0x7f078c108e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c102360 0x7f078c108e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 -- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c1019c0 msgr2=0x7f078c1088f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c1019c0 0x7f078c1088f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 -- 172.21.15.22:0/1552594947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c1aab60 con 0x7f078c1079c0 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.112+0000 7f078be00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 0x7f078c109370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f078402ae10 tx=0x7f0784003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.113+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784030e40 con 0x7f078c1079c0 2024-09-15T22:31:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.113+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0784040070 con 0x7f078c1079c0 2024-09-15T22:31:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.113+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784045b70 con 0x7f078c1079c0 2024-09-15T22:31:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.113+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c1aadf0 con 0x7f078c1079c0 2024-09-15T22:31:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.113+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c1ab2b0 con 0x7f078c1079c0 2024-09-15T22:31:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.114+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c103100 con 0x7f078c1079c0 2024-09-15T22:31:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.116+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0784045d10 con 0x7f078c1079c0 2024-09-15T22:31:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.118+0000 7f0783e00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07700a3350 0x7f07700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.118+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f07840f0d90 con 0x7f078c1079c0 2024-09-15T22:31:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.119+0000 7f078b400640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07700a3350 0x7f07700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.119+0000 7f078b400640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07700a3350 0x7f07700a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f077c009b50 tx=0x7f077c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.120+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07840bda20 con 0x7f078c1079c0 2024-09-15T22:31:30.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.309+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f078c101e20 con 0x7f078c1079c0 2024-09-15T22:31:30.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.310+0000 7f0783e00640 1 -- 172.21.15.22:0/1552594947 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f078c101e20 con 0x7f078c1079c0 2024-09-15T22:31:30.312 INFO:teuthology.orchestra.run.smithi022.stdout:261993005093 2024-09-15T22:31:30.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07700a3350 msgr2=0x7f07700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07700a3350 0x7f07700a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f077c009b50 tx=0x7f077c005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:30.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 msgr2=0x7f078c109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:30.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 0x7f078c109370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f078402ae10 tx=0x7f0784003f10 comp rx=0 tx=0).stop 2024-09-15T22:31:30.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:30 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3607691833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 shutdown_connections 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f078c1079c0 0x7f078c109370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07700a3350 0x7f07700a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c102360 0x7f078c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 --2- 172.21.15.22:0/1552594947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f078c1019c0 0x7f078c1088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 >> 172.21.15.22:0/1552594947 conn(0x7f078c0fd740 msgr2=0x7f078c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 shutdown_connections 2024-09-15T22:31:30.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:30.312+0000 7f0790c00640 1 -- 172.21.15.22:0/1552594947 wait complete. 2024-09-15T22:31:30.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:30 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3607691833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:31:30.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:30 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3607691833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:31:30.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855416 got 150323855418 for osd.5 2024-09-15T22:31:30.929 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:31.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:31 smithi022 ceph-mon[30634]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:31.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:31 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1552594947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:31:31.272 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005089 got 261993005093 for osd.9 2024-09-15T22:31:31.272 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:31 smithi110 ceph-mon[35282]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:31 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1552594947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:31:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:31 smithi112 ceph-mon[35032]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:31 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1552594947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:31:31.645 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:32.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 -- 172.21.15.22:0/4119337463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c1049a0 msgr2=0x7f191c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 --2- 172.21.15.22:0/4119337463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c1049a0 0x7f191c1089f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1908009900 tx=0x7f190802a410 comp rx=0 tx=0).stop 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 -- 172.21.15.22:0/4119337463 shutdown_connections 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 --2- 172.21.15.22:0/4119337463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c109120 0x7f191c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 --2- 172.21.15.22:0/4119337463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c1049a0 0x7f191c1089f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 --2- 172.21.15.22:0/4119337463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191c103ff0 0x7f191c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 -- 172.21.15.22:0/4119337463 >> 172.21.15.22:0/4119337463 conn(0x7f191c0ffa90 msgr2=0x7f191c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 -- 172.21.15.22:0/4119337463 shutdown_connections 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.663+0000 7f1923600640 1 -- 172.21.15.22:0/4119337463 wait complete. 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 Processor -- start 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 -- start start 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 0x7f191c076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c1049a0 0x7f191c076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191c109120 0x7f191c077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f191c114190 con 0x7f191c103ff0 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f191c114010 con 0x7f191c1049a0 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.664+0000 7f1923600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f191c114310 con 0x7f191c109120 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f1920c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 0x7f191c076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f1920c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 0x7f191c076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38316/0 (socket says 172.21.15.22:38316) 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f1920c00640 1 -- 172.21.15.22:0/3492035909 learned_addr learned my addr 172.21.15.22:0/3492035909 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f191be00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c1049a0 0x7f191c076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f1921600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191c109120 0x7f191c077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f191be00640 1 -- 172.21.15.22:0/3492035909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191c109120 msgr2=0x7f191c077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f191be00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191c109120 0x7f191c077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f191be00640 1 -- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 msgr2=0x7f191c076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f191be00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 0x7f191c076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f191be00640 1 -- 172.21.15.22:0/3492035909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c1aad10 con 0x7f191c1049a0 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.665+0000 7f1920c00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 0x7f191c076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.666+0000 7f191be00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c1049a0 0x7f191c076c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1908009900 tx=0x7f1908003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.666+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190803f070 con 0x7f191c1049a0 2024-09-15T22:31:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.666+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c1aafa0 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.666+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1908031c90 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.666+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908035030 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.666+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c1ab400 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.667+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c1054d0 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.669+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1908042070 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.671+0000 7f1919600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f19040a3350 0x7f19040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.671+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f19080f0250 con 0x7f191c1049a0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.671+0000 7f1920c00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f19040a3350 0x7f19040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.672+0000 7f1920c00640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f19040a3350 0x7f19040a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1910011500 tx=0x7f1910005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.674+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19080bc780 con 0x7f191c1049a0 2024-09-15T22:31:32.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.868+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f191c077c30 con 0x7f191c1049a0 2024-09-15T22:31:32.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.869+0000 7f1919600640 1 -- 172.21.15.22:0/3492035909 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f19080c0a80 con 0x7f191c1049a0 2024-09-15T22:31:32.870 INFO:teuthology.orchestra.run.smithi022.stdout:128849018944 2024-09-15T22:31:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f19040a3350 msgr2=0x7f19040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f19040a3350 0x7f19040a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1910011500 tx=0x7f1910005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c1049a0 msgr2=0x7f191c076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c1049a0 0x7f191c076c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1908009900 tx=0x7f1908003b20 comp rx=0 tx=0).stop 2024-09-15T22:31:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 shutdown_connections 2024-09-15T22:31:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f191c109120 0x7f191c077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f19040a3350 0x7f19040a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f191c1049a0 0x7f191c076c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 --2- 172.21.15.22:0/3492035909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f191c103ff0 0x7f191c076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 >> 172.21.15.22:0/3492035909 conn(0x7f191c0ffa90 msgr2=0x7f191c100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 shutdown_connections 2024-09-15T22:31:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.871+0000 7f1923600640 1 -- 172.21.15.22:0/3492035909 wait complete. 2024-09-15T22:31:32.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 -- 172.21.15.22:0/4137817550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8103ff0 msgr2=0x7f8fe81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 --2- 172.21.15.22:0/4137817550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8103ff0 0x7f8fe81043d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009900 tx=0x7f8fd802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 -- 172.21.15.22:0/4137817550 shutdown_connections 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 --2- 172.21.15.22:0/4137817550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8109120 0x7f8fe8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 --2- 172.21.15.22:0/4137817550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe81049a0 0x7f8fe81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 --2- 172.21.15.22:0/4137817550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8103ff0 0x7f8fe81043d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 -- 172.21.15.22:0/4137817550 >> 172.21.15.22:0/4137817550 conn(0x7f8fe80ffa90 msgr2=0x7f8fe8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 -- 172.21.15.22:0/4137817550 shutdown_connections 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.771+0000 7f8feda00640 1 -- 172.21.15.22:0/4137817550 wait complete. 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.772+0000 7f8feda00640 1 Processor -- start 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.772+0000 7f8feda00640 1 -- start start 2024-09-15T22:31:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8feda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 0x7f8fe819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8feda00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe81049a0 0x7f8fe819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8feda00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8109120 0x7f8fe819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8feda00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8114120 con 0x7f8fe81049a0 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8feda00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8113fa0 con 0x7f8fe8103ff0 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8feda00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe81142a0 con 0x7f8fe8109120 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8fe6000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe81049a0 0x7f8fe819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8fe6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 0x7f8fe819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8fe6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 0x7f8fe819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:45214/0 (socket says 172.21.15.22:45214) 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8fe6a00640 1 -- 172.21.15.22:0/15398401 learned_addr learned my addr 172.21.15.22:0/15398401 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.773+0000 7f8fe7400640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8109120 0x7f8fe819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe6a00640 1 -- 172.21.15.22:0/15398401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8109120 msgr2=0x7f8fe819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe6a00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8109120 0x7f8fe819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe6a00640 1 -- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe81049a0 msgr2=0x7f8fe819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe6a00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe81049a0 0x7f8fe819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe6a00640 1 -- 172.21.15.22:0/15398401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe819f5d0 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe7400640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8109120 0x7f8fe819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fe6a00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 0x7f8fe819a620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8006010 tx=0x7f8fd8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd803f030 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe819f860 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.774+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe81a71a0 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.775+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fd8004440 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.775+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8049060 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.775+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc8005290 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.777+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8fd8042030 con 0x7f8fe8103ff0 2024-09-15T22:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.778+0000 7f8fdf400640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8fcc0a32d0 0x7f8fcc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:32.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.779+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8fd80eff10 con 0x7f8fe8103ff0 2024-09-15T22:31:32.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.779+0000 7f8fe6000640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8fcc0a32d0 0x7f8fcc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:32.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.779+0000 7f8fe6000640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8fcc0a32d0 0x7f8fcc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40095f0 tx=0x7f8fd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:32.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.783+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fd80bca70 con 0x7f8fe8103ff0 2024-09-15T22:31:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.972+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8fc8005850 con 0x7f8fe8103ff0 2024-09-15T22:31:32.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.973+0000 7f8fdf400640 1 -- 172.21.15.22:0/15398401 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fd80bc370 con 0x7f8fe8103ff0 2024-09-15T22:31:32.974 INFO:teuthology.orchestra.run.smithi022.stdout:73014444108 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8fcc0a32d0 msgr2=0x7f8fcc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8fcc0a32d0 0x7f8fcc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40095f0 tx=0x7f8fd4005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 msgr2=0x7f8fe819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 0x7f8fe819a620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8006010 tx=0x7f8fd8004040 comp rx=0 tx=0).stop 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 shutdown_connections 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fe8109120 0x7f8fe819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8fcc0a32d0 0x7f8fcc0a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe81049a0 0x7f8fe819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 --2- 172.21.15.22:0/15398401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fe8103ff0 0x7f8fe819a620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 >> 172.21.15.22:0/15398401 conn(0x7f8fe80ffa90 msgr2=0x7f8fe8100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 shutdown_connections 2024-09-15T22:31:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:32.975+0000 7f8feda00640 1 -- 172.21.15.22:0/15398401 wait complete. 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 -- 172.21.15.22:0/2893455984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 msgr2=0x7fa504076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 --2- 172.21.15.22:0/2893455984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa504076b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009900 tx=0x7fa4f802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 -- 172.21.15.22:0/2893455984 shutdown_connections 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 --2- 172.21.15.22:0/2893455984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 0x7fa504112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 --2- 172.21.15.22:0/2893455984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 0x7fa504114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 --2- 172.21.15.22:0/2893455984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa504076b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 -- 172.21.15.22:0/2893455984 >> 172.21.15.22:0/2893455984 conn(0x7fa5040ffa50 msgr2=0x7fa504101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 -- 172.21.15.22:0/2893455984 shutdown_connections 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.364+0000 7fa50c800640 1 -- 172.21.15.22:0/2893455984 wait complete. 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 Processor -- start 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 -- start start 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa5041a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 0x7fa5041a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 0x7fa50419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa504118610 con 0x7fa504076720 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa504118490 con 0x7fa504112a50 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.366+0000 7fa50c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa504118790 con 0x7fa504077040 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 0x7fa5041a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa5041a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 0x7fa5041a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46614/0 (socket says 172.21.15.22:46614) 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa5041a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38356/0 (socket says 172.21.15.22:38356) 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509400640 1 -- 172.21.15.22:0/3299085202 learned_addr learned my addr 172.21.15.22:0/3299085202 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa50a800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 0x7fa50419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 -- 172.21.15.22:0/3299085202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 msgr2=0x7fa5041a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 0x7fa5041a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 -- 172.21.15.22:0/3299085202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 msgr2=0x7fa50419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 0x7fa50419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 -- 172.21.15.22:0/3299085202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50419efd0 con 0x7fa504076720 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa50a800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 0x7fa50419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.367+0000 7fa509e00640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa5041a46e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4f802a910 tx=0x7fa4f8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.368+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f803f070 con 0x7fa504076720 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.368+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f8031c90 con 0x7fa504076720 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.368+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8035030 con 0x7fa504076720 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.368+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50419f260 con 0x7fa504076720 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.368+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041ab5b0 con 0x7fa504076720 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.369+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa504076b00 con 0x7fa504076720 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.371+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa4f8042070 con 0x7fa504076720 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.372+0000 7fa4fea00640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa4ec0a3350 0x7fa4ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.372+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fa4f80f0140 con 0x7fa504076720 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.372+0000 7fa509400640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa4ec0a3350 0x7fa4ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.373+0000 7fa509400640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa4ec0a3350 0x7fa4ec0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa504079290 tx=0x7fa4f400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.377+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4f80bc670 con 0x7fa504076720 2024-09-15T22:31:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:33 smithi110 ceph-mon[35282]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-15T22:31:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:33 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3492035909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:31:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:33 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/15398401' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:31:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:33 smithi022 ceph-mon[30634]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-15T22:31:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:33 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3492035909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:31:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:33 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/15398401' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:31:33.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.565+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa5041ab870 con 0x7fa504076720 2024-09-15T22:31:33.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.565+0000 7fa4fea00640 1 -- 172.21.15.22:0/3299085202 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa4f80c0970 con 0x7fa504076720 2024-09-15T22:31:33.567 INFO:teuthology.orchestra.run.smithi022.stdout:180388626485 2024-09-15T22:31:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.567+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa4ec0a3350 msgr2=0x7fa4ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.567+0000 7fa50c800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa4ec0a3350 0x7fa4ec0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa504079290 tx=0x7fa4f400b480 comp rx=0 tx=0).stop 2024-09-15T22:31:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.567+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 msgr2=0x7fa5041a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.567+0000 7fa50c800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa5041a46e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4f802a910 tx=0x7fa4f8003b90 comp rx=0 tx=0).stop 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 shutdown_connections 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa504077040 0x7fa5041a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa4ec0a3350 0x7fa4ec0a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa504112a50 0x7fa50419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 --2- 172.21.15.22:0/3299085202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa504076720 0x7fa5041a46e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 >> 172.21.15.22:0/3299085202 conn(0x7fa5040ffa50 msgr2=0x7fa504101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 shutdown_connections 2024-09-15T22:31:33.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:33.568+0000 7fa50c800640 1 -- 172.21.15.22:0/3299085202 wait complete. 2024-09-15T22:31:33.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:33 smithi112 ceph-mon[35032]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-15T22:31:33.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:33 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3492035909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:31:33.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:33 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/15398401' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:31:33.756 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462957 got 201863462959 for osd.7 2024-09-15T22:31:33.757 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:34.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:34 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3299085202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:31:34.443 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444104 got 73014444108 for osd.2 2024-09-15T22:31:34.443 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:34.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:34 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3299085202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:31:34.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:34 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3299085202' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:31:35.095 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626483 got 180388626485 for osd.6 2024-09-15T22:31:35.285 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:35.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:35 smithi022 ceph-mon[30634]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.306+0000 7fc473e00640 1 -- 172.21.15.22:0/1226443974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474077040 msgr2=0x7fc474112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.306+0000 7fc473e00640 1 --2- 172.21.15.22:0/1226443974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474077040 0x7fc474112330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009900 tx=0x7fc45c02a410 comp rx=0 tx=0).stop 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 -- 172.21.15.22:0/1226443974 shutdown_connections 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 --2- 172.21.15.22:0/1226443974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc474112870 0x7fc474114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 --2- 172.21.15.22:0/1226443974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474077040 0x7fc474112330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 --2- 172.21.15.22:0/1226443974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc474076720 0x7fc474076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 -- 172.21.15.22:0/1226443974 >> 172.21.15.22:0/1226443974 conn(0x7fc4740ff8d0 msgr2=0x7fc474101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 -- 172.21.15.22:0/1226443974 shutdown_connections 2024-09-15T22:31:35.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.307+0000 7fc473e00640 1 -- 172.21.15.22:0/1226443974 wait complete. 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.308+0000 7fc473e00640 1 Processor -- start 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.308+0000 7fc473e00640 1 -- start start 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc474076720 0x7fc4741a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc474077040 0x7fc4741a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 0x7fc47419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc474118400 con 0x7fc474112870 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc474118280 con 0x7fc474077040 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc474118580 con 0x7fc474076720 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 0x7fc47419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 0x7fc47419e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38372/0 (socket says 172.21.15.22:38372) 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc472a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc474076720 0x7fc4741a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc473400640 1 -- 172.21.15.22:0/3324108039 learned_addr learned my addr 172.21.15.22:0/3324108039 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:35.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.309+0000 7fc46a000640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc474077040 0x7fc4741a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473400640 1 -- 172.21.15.22:0/3324108039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc474076720 msgr2=0x7fc4741a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473400640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc474076720 0x7fc4741a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473400640 1 -- 172.21.15.22:0/3324108039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc474077040 msgr2=0x7fc4741a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473400640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc474077040 0x7fc4741a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473400640 1 -- 172.21.15.22:0/3324108039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47419efa0 con 0x7fc474112870 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473400640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 0x7fc47419e730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00eb10 tx=0x7fc46c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c004b20 con 0x7fc474112870 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc46c004cc0 con 0x7fc474112870 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47419f290 con 0x7fc474112870 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c010790 con 0x7fc474112870 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.310+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4741ab410 con 0x7fc474112870 2024-09-15T22:31:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.311+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc474077e60 con 0x7fc474112870 2024-09-15T22:31:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.313+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc46c005020 con 0x7fc474112870 2024-09-15T22:31:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.315+0000 7fc46be00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4580a32d0 0x7fc4580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.316+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fc46c0d01e0 con 0x7fc474112870 2024-09-15T22:31:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.316+0000 7fc472a00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4580a32d0 0x7fc4580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.316+0000 7fc472a00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4580a32d0 0x7fc4580a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc464005fd0 tx=0x7fc46400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:35.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.319+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc46c09cd60 con 0x7fc474112870 2024-09-15T22:31:35.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:35 smithi110 ceph-mon[35282]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-15T22:31:35.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.509+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc47410d470 con 0x7fc474112870 2024-09-15T22:31:35.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.509+0000 7fc46be00640 1 -- 172.21.15.22:0/3324108039 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc46c09c660 con 0x7fc474112870 2024-09-15T22:31:35.511 INFO:teuthology.orchestra.run.smithi022.stdout:231928234028 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4580a32d0 msgr2=0x7fc4580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4580a32d0 0x7fc4580a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc464005fd0 tx=0x7fc46400b390 comp rx=0 tx=0).stop 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 msgr2=0x7fc47419e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 0x7fc47419e730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00eb10 tx=0x7fc46c00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 shutdown_connections 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4580a32d0 0x7fc4580a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc474112870 0x7fc47419e730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc474077040 0x7fc4741a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 --2- 172.21.15.22:0/3324108039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc474076720 0x7fc4741a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 >> 172.21.15.22:0/3324108039 conn(0x7fc4740ff8d0 msgr2=0x7fc474101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 shutdown_connections 2024-09-15T22:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:35.512+0000 7fc473e00640 1 -- 172.21.15.22:0/3324108039 wait complete. 2024-09-15T22:31:35.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:35 smithi112 ceph-mon[35032]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-15T22:31:35.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018941 got 128849018944 for osd.4 2024-09-15T22:31:35.929 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:36.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:36 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3324108039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:31:36.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:36 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3324108039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:31:36.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:36 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3324108039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:31:36.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 -- 172.21.15.22:0/1839164460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 msgr2=0x7f89fc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1839164460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc108830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009900 tx=0x7f89e802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 -- 172.21.15.22:0/1839164460 shutdown_connections 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1839164460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc108f60 0x7f89fc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1839164460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc108830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1839164460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc103e30 0x7f89fc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 -- 172.21.15.22:0/1839164460 >> 172.21.15.22:0/1839164460 conn(0x7f89fc0ff8d0 msgr2=0x7f89fc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 -- 172.21.15.22:0/1839164460 shutdown_connections 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.766+0000 7f8a01c00640 1 -- 172.21.15.22:0/1839164460 wait complete. 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 Processor -- start 2024-09-15T22:31:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 -- start start 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc103e30 0x7f89fc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc108f60 0x7f89fc19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc114010 con 0x7f89fc1047e0 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc113e90 con 0x7f89fc103e30 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.768+0000 7f8a01c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc114190 con 0x7f89fc108f60 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f8a01200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc108f60 0x7f89fc19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38398/0 (socket says 172.21.15.22:38398) 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f8a01200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc108f60 0x7f89fc19ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46660/0 (socket says 172.21.15.22:46660) 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 -- 172.21.15.22:0/1743544291 learned_addr learned my addr 172.21.15.22:0/1743544291 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fbe00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc103e30 0x7f89fc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 -- 172.21.15.22:0/1743544291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc108f60 msgr2=0x7f89fc19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc108f60 0x7f89fc19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 -- 172.21.15.22:0/1743544291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc103e30 msgr2=0x7f89fc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc103e30 0x7f89fc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 -- 172.21.15.22:0/1743544291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc19f460 con 0x7f89fc1047e0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.769+0000 7f89fb400640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc19a9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89e8004770 tx=0x7f89e8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.770+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e803f070 con 0x7f89fc1047e0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.770+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e8031ca0 con 0x7f89fc1047e0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.770+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8035030 con 0x7f89fc1047e0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.770+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc19f6f0 con 0x7f89fc1047e0 2024-09-15T22:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.770+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc19fb80 con 0x7f89fc1047e0 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.771+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc104210 con 0x7f89fc1047e0 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.773+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f89e8042070 con 0x7f89fc1047e0 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.775+0000 7f89f8c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f89e00a32d0 0x7f89e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.775+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f89e80f0040 con 0x7f89fc1047e0 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.775+0000 7f89fbe00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f89e00a32d0 0x7f89e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.776+0000 7f89fbe00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f89e00a32d0 0x7f89e00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009bd0 tx=0x7f89ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.779+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89e80bc670 con 0x7f89fc1047e0 2024-09-15T22:31:36.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.970+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f89fc10bc10 con 0x7f89fc1047e0 2024-09-15T22:31:36.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.970+0000 7f89f8c00640 1 -- 172.21.15.22:0/1743544291 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89e80c0970 con 0x7f89fc1047e0 2024-09-15T22:31:36.972 INFO:teuthology.orchestra.run.smithi022.stdout:55834574928 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f89e00a32d0 msgr2=0x7f89e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f89e00a32d0 0x7f89e00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009bd0 tx=0x7f89ec005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 msgr2=0x7f89fc19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc19a9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89e8004770 tx=0x7f89e8003c10 comp rx=0 tx=0).stop 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 shutdown_connections 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc108f60 0x7f89fc19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f89e00a32d0 0x7f89e00a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89fc1047e0 0x7f89fc19a9f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 --2- 172.21.15.22:0/1743544291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc103e30 0x7f89fc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 >> 172.21.15.22:0/1743544291 conn(0x7f89fc0ff8d0 msgr2=0x7f89fc100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 shutdown_connections 2024-09-15T22:31:36.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:36.973+0000 7f8a01c00640 1 -- 172.21.15.22:0/1743544291 wait complete. 2024-09-15T22:31:37.292 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234025 got 231928234028 for osd.8 2024-09-15T22:31:37.293 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:37 smithi110 ceph-mon[35282]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-15T22:31:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:37 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1743544291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:31:37.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:37 smithi022 ceph-mon[30634]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-15T22:31:37.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:37 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1743544291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:31:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:37.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:37 smithi112 ceph-mon[35032]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-15T22:31:37.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:37 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1743544291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:31:38.000 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574928 for osd.1 2024-09-15T22:31:38.001 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 -- 172.21.15.22:0/43577136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60076720 msgr2=0x7f2f60076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 --2- 172.21.15.22:0/43577136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60076720 0x7f2f60076b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009900 tx=0x7f2f5002a410 comp rx=0 tx=0).stop 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 -- 172.21.15.22:0/43577136 shutdown_connections 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 --2- 172.21.15.22:0/43577136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f60077040 0x7f2f601124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 --2- 172.21.15.22:0/43577136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60112a30 0x7f2f60114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 --2- 172.21.15.22:0/43577136 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60076720 0x7f2f60076b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.574+0000 7f2f65a00640 1 -- 172.21.15.22:0/43577136 >> 172.21.15.22:0/43577136 conn(0x7f2f600ffa90 msgr2=0x7f2f60101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.575+0000 7f2f65a00640 1 -- 172.21.15.22:0/43577136 shutdown_connections 2024-09-15T22:31:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.575+0000 7f2f65a00640 1 -- 172.21.15.22:0/43577136 wait complete. 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.576+0000 7f2f65a00640 1 Processor -- start 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.576+0000 7f2f65a00640 1 -- start start 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f65a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f60076720 0x7f2f601a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f65a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 0x7f2f601a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f65a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60112a30 0x7f2f6019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f65a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60118610 con 0x7f2f60112a30 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f65a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60118490 con 0x7f2f60077040 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f65a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60118790 con 0x7f2f60076720 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60112a30 0x7f2f6019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 0x7f2f601a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:38.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 0x7f2f601a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:45286/0 (socket says 172.21.15.22:45286) 2024-09-15T22:31:38.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 -- 172.21.15.22:0/139044411 learned_addr learned my addr 172.21.15.22:0/139044411 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:38.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5ea00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f60076720 0x7f2f601a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 -- 172.21.15.22:0/139044411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f60076720 msgr2=0x7f2f601a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f60076720 0x7f2f601a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 -- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60112a30 msgr2=0x7f2f6019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60112a30 0x7f2f6019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5e000640 1 -- 172.21.15.22:0/139044411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6019efd0 con 0x7f2f60077040 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.577+0000 7f2f5f400640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60112a30 0x7f2f6019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.578+0000 7f2f5e000640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 0x7f2f601a4c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00e9f0 tx=0x7f2f4c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.578+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00cd80 con 0x7f2f60077040 2024-09-15T22:31:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.578+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f4c005500 con 0x7f2f60077040 2024-09-15T22:31:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.578+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c010690 con 0x7f2f60077040 2024-09-15T22:31:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.578+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6019f2c0 con 0x7f2f60077040 2024-09-15T22:31:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.578+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f601ab5b0 con 0x7f2f60077040 2024-09-15T22:31:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.579+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f60076b00 con 0x7f2f60077040 2024-09-15T22:31:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.582+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2f4c0046c0 con 0x7f2f60077040 2024-09-15T22:31:38.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.583+0000 7f2f57400640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2f440a32d0 0x7f2f440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:38.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:31:38.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:31:38.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.583+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f2f4c0d0180 con 0x7f2f60077040 2024-09-15T22:31:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.583+0000 7f2f5ea00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2f440a32d0 0x7f2f440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.584+0000 7f2f5ea00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2f440a32d0 0x7f2f440a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f50006010 tx=0x7f2f50000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.585+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f4c09cd00 con 0x7f2f60077040 2024-09-15T22:31:38.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:31:38.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:31:38.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:31:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:31:38.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:31:38.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.775+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f2f6019fdd0 con 0x7f2f60077040 2024-09-15T22:31:38.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.776+0000 7f2f57400640 1 -- 172.21.15.22:0/139044411 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2f6019fdd0 con 0x7f2f60077040 2024-09-15T22:31:38.777 INFO:teuthology.orchestra.run.smithi022.stdout:279172874273 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2f440a32d0 msgr2=0x7f2f440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2f440a32d0 0x7f2f440a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f50006010 tx=0x7f2f50000bc0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 msgr2=0x7f2f601a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 0x7f2f601a4c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00e9f0 tx=0x7f2f4c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 shutdown_connections 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2f440a32d0 0x7f2f440a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60112a30 0x7f2f6019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f60077040 0x7f2f601a4c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 --2- 172.21.15.22:0/139044411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f60076720 0x7f2f601a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 >> 172.21.15.22:0/139044411 conn(0x7f2f600ffa90 msgr2=0x7f2f60101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 shutdown_connections 2024-09-15T22:31:38.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:38.778+0000 7f2f65a00640 1 -- 172.21.15.22:0/139044411 wait complete. 2024-09-15T22:31:39.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:39 smithi022 ceph-mon[30634]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-15T22:31:39.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:39 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/139044411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:31:39.480 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874270 got 279172874273 for osd.10 2024-09-15T22:31:39.480 DEBUG:teuthology.parallel:result is None 2024-09-15T22:31:39.480 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:31:39.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:31:39.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:39 smithi112 ceph-mon[35032]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-15T22:31:39.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:39 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/139044411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:31:39.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:39 smithi110 ceph-mon[35282]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-15T22:31:39.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:39 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/139044411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:31:39.862 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 -- 172.21.15.22:0/2785300954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114109140 msgr2=0x7fe114110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 --2- 172.21.15.22:0/2785300954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114109140 0x7fe114110cc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009900 tx=0x7fe10c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 -- 172.21.15.22:0/2785300954 shutdown_connections 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 --2- 172.21.15.22:0/2785300954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114109140 0x7fe114110cc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 --2- 172.21.15.22:0/2785300954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1141049c0 0x7fe114108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 --2- 172.21.15.22:0/2785300954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe114104010 0x7fe1141043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 -- 172.21.15.22:0/2785300954 >> 172.21.15.22:0/2785300954 conn(0x7fe1140ffa50 msgr2=0x7fe114101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 -- 172.21.15.22:0/2785300954 shutdown_connections 2024-09-15T22:31:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.399+0000 7fe119800640 1 -- 172.21.15.22:0/2785300954 wait complete. 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 Processor -- start 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 -- start start 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 0x7fe11419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1141049c0 0x7fe11419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe114109140 0x7fe11419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1141141c0 con 0x7fe114104010 2024-09-15T22:31:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe114114040 con 0x7fe114109140 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe119800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe114114340 con 0x7fe1141049c0 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.400+0000 7fe112a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 0x7fe11419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe10a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1141049c0 0x7fe11419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 0x7fe11419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55786/0 (socket says 172.21.15.22:55786) 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 -- 172.21.15.22:0/2202797921 learned_addr learned my addr 172.21.15.22:0/2202797921 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe113400640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe114109140 0x7fe11419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 -- 172.21.15.22:0/2202797921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1141049c0 msgr2=0x7fe11419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1141049c0 0x7fe11419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 -- 172.21.15.22:0/2202797921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe114109140 msgr2=0x7fe11419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe114109140 0x7fe11419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 -- 172.21.15.22:0/2202797921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11419f670 con 0x7fe114104010 2024-09-15T22:31:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.401+0000 7fe112a00640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 0x7fe11419a6c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe10400ea80 tx=0x7fe10400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.402+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10400ce40 con 0x7fe114104010 2024-09-15T22:31:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.402+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11419f960 con 0x7fe114104010 2024-09-15T22:31:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.402+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe104005020 con 0x7fe114104010 2024-09-15T22:31:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.402+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104011760 con 0x7fe114104010 2024-09-15T22:31:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.402+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1141a7240 con 0x7fe114104010 2024-09-15T22:31:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.403+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1141043f0 con 0x7fe114104010 2024-09-15T22:31:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.405+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe1040051d0 con 0x7fe114104010 2024-09-15T22:31:40.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.406+0000 7fe10be00640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe0f80a3350 0x7fe0f80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:40.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.406+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe1040cfca0 con 0x7fe114104010 2024-09-15T22:31:40.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.406+0000 7fe10a000640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe0f80a3350 0x7fe0f80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:40.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.407+0000 7fe10a000640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe0f80a3350 0x7fe0f80a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe11410aab0 tx=0x7fe0fc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.411+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe104016030 con 0x7fe114104010 2024-09-15T22:31:40.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.601+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe114062630 con 0x7fe0f80a3350 2024-09-15T22:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.611+0000 7fe10be00640 1 -- 172.21.15.22:0/2202797921 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258724 (secure 0 0 0) 0x7fe114062630 con 0x7fe0f80a3350 2024-09-15T22:31:40.616 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:40.618 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-15T22:31:40.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.615+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe0f80a3350 msgr2=0x7fe0f80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.615+0000 7fe119800640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe0f80a3350 0x7fe0f80a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe11410aab0 tx=0x7fe0fc00b410 comp rx=0 tx=0).stop 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.615+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 msgr2=0x7fe11419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.615+0000 7fe119800640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 0x7fe11419a6c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe10400ea80 tx=0x7fe10400ef40 comp rx=0 tx=0).stop 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 shutdown_connections 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1141049c0 0x7fe11419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe0f80a3350 0x7fe0f80a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe114109140 0x7fe11419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 --2- 172.21.15.22:0/2202797921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe114104010 0x7fe11419a6c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 >> 172.21.15.22:0/2202797921 conn(0x7fe1140ffa50 msgr2=0x7fe114100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 shutdown_connections 2024-09-15T22:31:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:40.616+0000 7fe119800640 1 -- 172.21.15.22:0/2202797921 wait complete. 2024-09-15T22:31:41.338 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-15T22:31:39.563813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":505,"num_read_kb":368,"num_write":346,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1241082,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":428424,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":415597,"kb_avail":1124513400,"statfs":{"total":1151940427776,"available":1151501721600,"internally_reserved":0,"allocated":12840960,"data_stored":7157403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":425571642},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002770"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031717+0000","last_change":"2024-09-15T22:30:23.540766+0000","last_active":"2024-09-15T22:31:11.031717+0000","last_peered":"2024-09-15T22:31:11.031717+0000","last_clean":"2024-09-15T22:31:11.031717+0000","last_became_active":"2024-09-15T22:30:23.540425+0000","last_became_peered":"2024-09-15T22:30:23.540425+0000","last_unstale":"2024-09-15T22:31:11.031717+0000","last_undegraded":"2024-09-15T22:31:11.031717+0000","last_fullsized":"2024-09-15T22:31:11.031717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:50.650220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283500+0000","last_change":"2024-09-15T22:30:23.533484+0000","last_active":"2024-09-15T22:31:11.283500+0000","last_peered":"2024-09-15T22:31:11.283500+0000","last_clean":"2024-09-15T22:31:11.283500+0000","last_became_active":"2024-09-15T22:30:23.532995+0000","last_became_peered":"2024-09-15T22:30:23.532995+0000","last_unstale":"2024-09-15T22:31:11.283500+0000","last_undegraded":"2024-09-15T22:31:11.283500+0000","last_fullsized":"2024-09-15T22:31:11.283500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:42.108789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283410+0000","last_change":"2024-09-15T22:30:23.529206+0000","last_active":"2024-09-15T22:31:11.283410+0000","last_peered":"2024-09-15T22:31:11.283410+0000","last_clean":"2024-09-15T22:31:11.283410+0000","last_became_active":"2024-09-15T22:30:23.528894+0000","last_became_peered":"2024-09-15T22:30:23.528894+0000","last_unstale":"2024-09-15T22:31:11.283410+0000","last_undegraded":"2024-09-15T22:31:11.283410+0000","last_fullsized":"2024-09-15T22:31:11.283410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:53.130553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.187248+0000","last_change":"2024-09-15T22:30:23.529406+0000","last_active":"2024-09-15T22:31:11.187248+0000","last_peered":"2024-09-15T22:31:11.187248+0000","last_clean":"2024-09-15T22:31:11.187248+0000","last_became_active":"2024-09-15T22:30:23.529074+0000","last_became_peered":"2024-09-15T22:30:23.529074+0000","last_unstale":"2024-09-15T22:31:11.187248+0000","last_undegraded":"2024-09-15T22:31:11.187248+0000","last_fullsized":"2024-09-15T22:31:11.187248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:55.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035905+0000","last_change":"2024-09-15T22:30:23.525342+0000","last_active":"2024-09-15T22:31:11.035905+0000","last_peered":"2024-09-15T22:31:11.035905+0000","last_clean":"2024-09-15T22:31:11.035905+0000","last_became_active":"2024-09-15T22:30:23.524983+0000","last_became_peered":"2024-09-15T22:30:23.524983+0000","last_unstale":"2024-09-15T22:31:11.035905+0000","last_undegraded":"2024-09-15T22:31:11.035905+0000","last_fullsized":"2024-09-15T22:31:11.035905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:57.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031225+0000","last_change":"2024-09-15T22:30:23.522364+0000","last_active":"2024-09-15T22:31:11.031225+0000","last_peered":"2024-09-15T22:31:11.031225+0000","last_clean":"2024-09-15T22:31:11.031225+0000","last_became_active":"2024-09-15T22:30:23.522018+0000","last_became_peered":"2024-09-15T22:30:23.522018+0000","last_unstale":"2024-09-15T22:31:11.031225+0000","last_undegraded":"2024-09-15T22:31:11.031225+0000","last_fullsized":"2024-09-15T22:31:11.031225+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:24.373042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028110+0000","last_change":"2024-09-15T22:30:23.531767+0000","last_active":"2024-09-15T22:31:11.028110+0000","last_peered":"2024-09-15T22:31:11.028110+0000","last_clean":"2024-09-15T22:31:11.028110+0000","last_became_active":"2024-09-15T22:30:23.530522+0000","last_became_peered":"2024-09-15T22:30:23.530522+0000","last_unstale":"2024-09-15T22:31:11.028110+0000","last_undegraded":"2024-09-15T22:31:11.028110+0000","last_fullsized":"2024-09-15T22:31:11.028110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:16.225467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031696+0000","last_change":"2024-09-15T22:30:23.528714+0000","last_active":"2024-09-15T22:31:11.031696+0000","last_peered":"2024-09-15T22:31:11.031696+0000","last_clean":"2024-09-15T22:31:11.031696+0000","last_became_active":"2024-09-15T22:30:23.528412+0000","last_became_peered":"2024-09-15T22:30:23.528412+0000","last_unstale":"2024-09-15T22:31:11.031696+0000","last_undegraded":"2024-09-15T22:31:11.031696+0000","last_fullsized":"2024-09-15T22:31:11.031696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:25.020500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034856+0000","last_change":"2024-09-15T22:30:23.523940+0000","last_active":"2024-09-15T22:31:11.034856+0000","last_peered":"2024-09-15T22:31:11.034856+0000","last_clean":"2024-09-15T22:31:11.034856+0000","last_became_active":"2024-09-15T22:30:23.522682+0000","last_became_peered":"2024-09-15T22:30:23.522682+0000","last_unstale":"2024-09-15T22:31:11.034856+0000","last_undegraded":"2024-09-15T22:31:11.034856+0000","last_fullsized":"2024-09-15T22:31:11.034856+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:48.164040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031675+0000","last_change":"2024-09-15T22:30:23.524927+0000","last_active":"2024-09-15T22:31:11.031675+0000","last_peered":"2024-09-15T22:31:11.031675+0000","last_clean":"2024-09-15T22:31:11.031675+0000","last_became_active":"2024-09-15T22:30:23.524578+0000","last_became_peered":"2024-09-15T22:30:23.524578+0000","last_unstale":"2024-09-15T22:31:11.031675+0000","last_undegraded":"2024-09-15T22:31:11.031675+0000","last_fullsized":"2024-09-15T22:31:11.031675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:15.093534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028421+0000","last_change":"2024-09-15T22:30:23.527258+0000","last_active":"2024-09-15T22:31:11.028421+0000","last_peered":"2024-09-15T22:31:11.028421+0000","last_clean":"2024-09-15T22:31:11.028421+0000","last_became_active":"2024-09-15T22:30:23.526842+0000","last_became_peered":"2024-09-15T22:30:23.526842+0000","last_unstale":"2024-09-15T22:31:11.028421+0000","last_undegraded":"2024-09-15T22:31:11.028421+0000","last_fullsized":"2024-09-15T22:31:11.028421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:45.861445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.187371+0000","last_change":"2024-09-15T22:30:23.524525+0000","last_active":"2024-09-15T22:31:11.187371+0000","last_peered":"2024-09-15T22:31:11.187371+0000","last_clean":"2024-09-15T22:31:11.187371+0000","last_became_active":"2024-09-15T22:30:23.523915+0000","last_became_peered":"2024-09-15T22:30:23.523915+0000","last_unstale":"2024-09-15T22:31:11.187371+0000","last_undegraded":"2024-09-15T22:31:11.187371+0000","last_fullsized":"2024-09-15T22:31:11.187371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:24.954632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027843+0000","last_change":"2024-09-15T22:30:23.522262+0000","last_active":"2024-09-15T22:31:11.027843+0000","last_peered":"2024-09-15T22:31:11.027843+0000","last_clean":"2024-09-15T22:31:11.027843+0000","last_became_active":"2024-09-15T22:30:23.521919+0000","last_became_peered":"2024-09-15T22:30:23.521919+0000","last_unstale":"2024-09-15T22:31:11.027843+0000","last_undegraded":"2024-09-15T22:31:11.027843+0000","last_fullsized":"2024-09-15T22:31:11.027843+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:48.362426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283418+0000","last_change":"2024-09-15T22:30:23.526652+0000","last_active":"2024-09-15T22:31:11.283418+0000","last_peered":"2024-09-15T22:31:11.283418+0000","last_clean":"2024-09-15T22:31:11.283418+0000","last_became_active":"2024-09-15T22:30:23.526204+0000","last_became_peered":"2024-09-15T22:30:23.526204+0000","last_unstale":"2024-09-15T22:31:11.283418+0000","last_undegraded":"2024-09-15T22:31:11.283418+0000","last_fullsized":"2024-09-15T22:31:11.283418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:40.914567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283253+0000","last_change":"2024-09-15T22:30:23.528996+0000","last_active":"2024-09-15T22:31:11.283253+0000","last_peered":"2024-09-15T22:31:11.283253+0000","last_clean":"2024-09-15T22:31:11.283253+0000","last_became_active":"2024-09-15T22:30:23.528666+0000","last_became_peered":"2024-09-15T22:30:23.528666+0000","last_unstale":"2024-09-15T22:31:11.283253+0000","last_undegraded":"2024-09-15T22:31:11.283253+0000","last_fullsized":"2024-09-15T22:31:11.283253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:10.895994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034223+0000","last_change":"2024-09-15T22:30:23.525288+0000","last_active":"2024-09-15T22:31:11.034223+0000","last_peered":"2024-09-15T22:31:11.034223+0000","last_clean":"2024-09-15T22:31:11.034223+0000","last_became_active":"2024-09-15T22:30:23.524956+0000","last_became_peered":"2024-09-15T22:30:23.524956+0000","last_unstale":"2024-09-15T22:31:11.034223+0000","last_undegraded":"2024-09-15T22:31:11.034223+0000","last_fullsized":"2024-09-15T22:31:11.034223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:06.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031822+0000","last_change":"2024-09-15T22:30:23.540709+0000","last_active":"2024-09-15T22:31:11.031822+0000","last_peered":"2024-09-15T22:31:11.031822+0000","last_clean":"2024-09-15T22:31:11.031822+0000","last_became_active":"2024-09-15T22:30:23.540332+0000","last_became_peered":"2024-09-15T22:30:23.540332+0000","last_unstale":"2024-09-15T22:31:11.031822+0000","last_undegraded":"2024-09-15T22:31:11.031822+0000","last_fullsized":"2024-09-15T22:31:11.031822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:46.817361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032283+0000","last_change":"2024-09-15T22:30:23.521007+0000","last_active":"2024-09-15T22:31:11.032283+0000","last_peered":"2024-09-15T22:31:11.032283+0000","last_clean":"2024-09-15T22:31:11.032283+0000","last_became_active":"2024-09-15T22:30:23.520678+0000","last_became_peered":"2024-09-15T22:30:23.520678+0000","last_unstale":"2024-09-15T22:31:11.032283+0000","last_undegraded":"2024-09-15T22:31:11.032283+0000","last_fullsized":"2024-09-15T22:31:11.032283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:44.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030415+0000","last_change":"2024-09-15T22:30:23.528280+0000","last_active":"2024-09-15T22:31:11.030415+0000","last_peered":"2024-09-15T22:31:11.030415+0000","last_clean":"2024-09-15T22:31:11.030415+0000","last_became_active":"2024-09-15T22:30:23.527888+0000","last_became_peered":"2024-09-15T22:30:23.527888+0000","last_unstale":"2024-09-15T22:31:11.030415+0000","last_undegraded":"2024-09-15T22:31:11.030415+0000","last_fullsized":"2024-09-15T22:31:11.030415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:45.748437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031034+0000","last_change":"2024-09-15T22:30:23.525344+0000","last_active":"2024-09-15T22:31:11.031034+0000","last_peered":"2024-09-15T22:31:11.031034+0000","last_clean":"2024-09-15T22:31:11.031034+0000","last_became_active":"2024-09-15T22:30:23.525029+0000","last_became_peered":"2024-09-15T22:30:23.525029+0000","last_unstale":"2024-09-15T22:31:11.031034+0000","last_undegraded":"2024-09-15T22:31:11.031034+0000","last_fullsized":"2024-09-15T22:31:11.031034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:25.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027945+0000","last_change":"2024-09-15T22:30:23.530315+0000","last_active":"2024-09-15T22:31:11.027945+0000","last_peered":"2024-09-15T22:31:11.027945+0000","last_clean":"2024-09-15T22:31:11.027945+0000","last_became_active":"2024-09-15T22:30:23.529388+0000","last_became_peered":"2024-09-15T22:30:23.529388+0000","last_unstale":"2024-09-15T22:31:11.027945+0000","last_undegraded":"2024-09-15T22:31:11.027945+0000","last_fullsized":"2024-09-15T22:31:11.027945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:55.126701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034599+0000","last_change":"2024-09-15T22:30:23.530305+0000","last_active":"2024-09-15T22:31:11.034599+0000","last_peered":"2024-09-15T22:31:11.034599+0000","last_clean":"2024-09-15T22:31:11.034599+0000","last_became_active":"2024-09-15T22:30:23.529909+0000","last_became_peered":"2024-09-15T22:30:23.529909+0000","last_unstale":"2024-09-15T22:31:11.034599+0000","last_undegraded":"2024-09-15T22:31:11.034599+0000","last_fullsized":"2024-09-15T22:31:11.034599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:07.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030741+0000","last_change":"2024-09-15T22:30:23.524511+0000","last_active":"2024-09-15T22:31:11.030741+0000","last_peered":"2024-09-15T22:31:11.030741+0000","last_clean":"2024-09-15T22:31:11.030741+0000","last_became_active":"2024-09-15T22:30:23.524219+0000","last_became_peered":"2024-09-15T22:30:23.524219+0000","last_unstale":"2024-09-15T22:31:11.030741+0000","last_undegraded":"2024-09-15T22:31:11.030741+0000","last_fullsized":"2024-09-15T22:31:11.030741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:47.092184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028220+0000","last_change":"2024-09-15T22:30:23.531690+0000","last_active":"2024-09-15T22:31:11.028220+0000","last_peered":"2024-09-15T22:31:11.028220+0000","last_clean":"2024-09-15T22:31:11.028220+0000","last_became_active":"2024-09-15T22:30:23.531372+0000","last_became_peered":"2024-09-15T22:30:23.531372+0000","last_unstale":"2024-09-15T22:31:11.028220+0000","last_undegraded":"2024-09-15T22:31:11.028220+0000","last_fullsized":"2024-09-15T22:31:11.028220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:11.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031248+0000","last_change":"2024-09-15T22:30:23.538064+0000","last_active":"2024-09-15T22:31:11.031248+0000","last_peered":"2024-09-15T22:31:11.031248+0000","last_clean":"2024-09-15T22:31:11.031248+0000","last_became_active":"2024-09-15T22:30:23.537568+0000","last_became_peered":"2024-09-15T22:30:23.537568+0000","last_unstale":"2024-09-15T22:31:11.031248+0000","last_undegraded":"2024-09-15T22:31:11.031248+0000","last_fullsized":"2024-09-15T22:31:11.031248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:22.368267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030575+0000","last_change":"2024-09-15T22:30:23.528383+0000","last_active":"2024-09-15T22:31:11.030575+0000","last_peered":"2024-09-15T22:31:11.030575+0000","last_clean":"2024-09-15T22:31:11.030575+0000","last_became_active":"2024-09-15T22:30:23.527984+0000","last_became_peered":"2024-09-15T22:30:23.527984+0000","last_unstale":"2024-09-15T22:31:11.030575+0000","last_undegraded":"2024-09-15T22:31:11.030575+0000","last_fullsized":"2024-09-15T22:31:11.030575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:28.301070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036163+0000","last_change":"2024-09-15T22:31:11.036163+0000","last_active":"2024-09-15T22:31:11.036163+0000","last_peered":"2024-09-15T22:31:11.036163+0000","last_clean":"2024-09-15T22:31:11.036163+0000","last_became_active":"2024-09-15T22:31:11.035816+0000","last_became_peered":"2024-09-15T22:31:11.035816+0000","last_unstale":"2024-09-15T22:31:11.036163+0000","last_undegraded":"2024-09-15T22:31:11.036163+0000","last_fullsized":"2024-09-15T22:31:11.036163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:00.849092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.284956+0000","last_change":"2024-09-15T22:31:11.284956+0000","last_active":"2024-09-15T22:31:11.284956+0000","last_peered":"2024-09-15T22:31:11.284956+0000","last_clean":"2024-09-15T22:31:11.284956+0000","last_became_active":"2024-09-15T22:31:11.284466+0000","last_became_peered":"2024-09-15T22:31:11.284466+0000","last_unstale":"2024-09-15T22:31:11.284956+0000","last_undegraded":"2024-09-15T22:31:11.284956+0000","last_fullsized":"2024-09-15T22:31:11.284956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:49.840350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283535+0000","last_change":"2024-09-15T22:30:23.535074+0000","last_active":"2024-09-15T22:31:11.283535+0000","last_peered":"2024-09-15T22:31:11.283535+0000","last_clean":"2024-09-15T22:31:11.283535+0000","last_became_active":"2024-09-15T22:30:23.534810+0000","last_became_peered":"2024-09-15T22:30:23.534810+0000","last_unstale":"2024-09-15T22:31:11.283535+0000","last_undegraded":"2024-09-15T22:31:11.283535+0000","last_fullsized":"2024-09-15T22:31:11.283535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:28.085650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030371+0000","last_change":"2024-09-15T22:30:23.533870+0000","last_active":"2024-09-15T22:31:11.030371+0000","last_peered":"2024-09-15T22:31:11.030371+0000","last_clean":"2024-09-15T22:31:11.030371+0000","last_became_active":"2024-09-15T22:30:23.533377+0000","last_became_peered":"2024-09-15T22:30:23.533377+0000","last_unstale":"2024-09-15T22:31:11.030371+0000","last_undegraded":"2024-09-15T22:31:11.030371+0000","last_fullsized":"2024-09-15T22:31:11.030371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:50.466754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034411+0000","last_change":"2024-09-15T22:31:11.034411+0000","last_active":"2024-09-15T22:31:11.034411+0000","last_peered":"2024-09-15T22:31:11.034411+0000","last_clean":"2024-09-15T22:31:11.034411+0000","last_became_active":"2024-09-15T22:31:11.034063+0000","last_became_peered":"2024-09-15T22:31:11.034063+0000","last_unstale":"2024-09-15T22:31:11.034411+0000","last_undegraded":"2024-09-15T22:31:11.034411+0000","last_fullsized":"2024-09-15T22:31:11.034411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:26.615817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030657+0000","last_change":"2024-09-15T22:30:23.526096+0000","last_active":"2024-09-15T22:31:11.030657+0000","last_peered":"2024-09-15T22:31:11.030657+0000","last_clean":"2024-09-15T22:31:11.030657+0000","last_became_active":"2024-09-15T22:30:23.525746+0000","last_became_peered":"2024-09-15T22:30:23.525746+0000","last_unstale":"2024-09-15T22:31:11.030657+0000","last_undegraded":"2024-09-15T22:31:11.030657+0000","last_fullsized":"2024-09-15T22:31:11.030657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:57.303470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035532+0000","last_change":"2024-09-15T22:30:23.518856+0000","last_active":"2024-09-15T22:31:11.035532+0000","last_peered":"2024-09-15T22:31:11.035532+0000","last_clean":"2024-09-15T22:31:11.035532+0000","last_became_active":"2024-09-15T22:30:23.518385+0000","last_became_peered":"2024-09-15T22:30:23.518385+0000","last_unstale":"2024-09-15T22:31:11.035532+0000","last_undegraded":"2024-09-15T22:31:11.035532+0000","last_fullsized":"2024-09-15T22:31:11.035532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:19.783989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:33.732152+0000","last_change":"2024-09-15T22:30:21.083625+0000","last_active":"2024-09-15T22:31:33.732152+0000","last_peered":"2024-09-15T22:31:33.732152+0000","last_clean":"2024-09-15T22:31:33.732152+0000","last_became_active":"2024-09-15T22:30:21.083252+0000","last_became_peered":"2024-09-15T22:30:21.083252+0000","last_unstale":"2024-09-15T22:31:33.732152+0000","last_undegraded":"2024-09-15T22:31:33.732152+0000","last_fullsized":"2024-09-15T22:31:33.732152+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:34.596784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028368+0000","last_change":"2024-09-15T22:30:23.539472+0000","last_active":"2024-09-15T22:31:11.028368+0000","last_peered":"2024-09-15T22:31:11.028368+0000","last_clean":"2024-09-15T22:31:11.028368+0000","last_became_active":"2024-09-15T22:30:23.539138+0000","last_became_peered":"2024-09-15T22:30:23.539138+0000","last_unstale":"2024-09-15T22:31:11.028368+0000","last_undegraded":"2024-09-15T22:31:11.028368+0000","last_fullsized":"2024-09-15T22:31:11.028368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:18.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031376+0000","last_change":"2024-09-15T22:30:21.084153+0000","last_active":"2024-09-15T22:31:11.031376+0000","last_peered":"2024-09-15T22:31:11.031376+0000","last_clean":"2024-09-15T22:31:11.031376+0000","last_became_active":"2024-09-15T22:30:21.083772+0000","last_became_peered":"2024-09-15T22:30:21.083772+0000","last_unstale":"2024-09-15T22:31:11.031376+0000","last_undegraded":"2024-09-15T22:31:11.031376+0000","last_fullsized":"2024-09-15T22:31:11.031376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:42.435846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027613+0000","last_change":"2024-09-15T22:30:21.081395+0000","last_active":"2024-09-15T22:31:11.027613+0000","last_peered":"2024-09-15T22:31:11.027613+0000","last_clean":"2024-09-15T22:31:11.027613+0000","last_became_active":"2024-09-15T22:30:21.080785+0000","last_became_peered":"2024-09-15T22:30:21.080785+0000","last_unstale":"2024-09-15T22:31:11.027613+0000","last_undegraded":"2024-09-15T22:31:11.027613+0000","last_fullsized":"2024-09-15T22:31:11.027613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:58.908942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030742+0000","last_change":"2024-09-15T22:30:23.525123+0000","last_active":"2024-09-15T22:31:11.030742+0000","last_peered":"2024-09-15T22:31:11.030742+0000","last_clean":"2024-09-15T22:31:11.030742+0000","last_became_active":"2024-09-15T22:30:23.524772+0000","last_became_peered":"2024-09-15T22:30:23.524772+0000","last_unstale":"2024-09-15T22:31:11.030742+0000","last_undegraded":"2024-09-15T22:31:11.030742+0000","last_fullsized":"2024-09-15T22:31:11.030742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:32.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028451+0000","last_change":"2024-09-15T22:30:21.084218+0000","last_active":"2024-09-15T22:31:11.028451+0000","last_peered":"2024-09-15T22:31:11.028451+0000","last_clean":"2024-09-15T22:31:11.028451+0000","last_became_active":"2024-09-15T22:30:21.083853+0000","last_became_peered":"2024-09-15T22:30:21.083853+0000","last_unstale":"2024-09-15T22:31:11.028451+0000","last_undegraded":"2024-09-15T22:31:11.028451+0000","last_fullsized":"2024-09-15T22:31:11.028451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:56.947260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032337+0000","last_change":"2024-09-15T22:30:23.526667+0000","last_active":"2024-09-15T22:31:11.032337+0000","last_peered":"2024-09-15T22:31:11.032337+0000","last_clean":"2024-09-15T22:31:11.032337+0000","last_became_active":"2024-09-15T22:30:23.524872+0000","last_became_peered":"2024-09-15T22:30:23.524872+0000","last_unstale":"2024-09-15T22:31:11.032337+0000","last_undegraded":"2024-09-15T22:31:11.032337+0000","last_fullsized":"2024-09-15T22:31:11.032337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:11.222255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:34.732894+0000","last_change":"2024-09-15T22:30:21.081582+0000","last_active":"2024-09-15T22:31:34.732894+0000","last_peered":"2024-09-15T22:31:34.732894+0000","last_clean":"2024-09-15T22:31:34.732894+0000","last_became_active":"2024-09-15T22:30:21.081217+0000","last_became_peered":"2024-09-15T22:30:21.081217+0000","last_unstale":"2024-09-15T22:31:34.732894+0000","last_undegraded":"2024-09-15T22:31:34.732894+0000","last_fullsized":"2024-09-15T22:31:34.732894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:21.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035059+0000","last_change":"2024-09-15T22:30:23.523065+0000","last_active":"2024-09-15T22:31:11.035059+0000","last_peered":"2024-09-15T22:31:11.035059+0000","last_clean":"2024-09-15T22:31:11.035059+0000","last_became_active":"2024-09-15T22:30:23.522743+0000","last_became_peered":"2024-09-15T22:30:23.522743+0000","last_unstale":"2024-09-15T22:31:11.035059+0000","last_undegraded":"2024-09-15T22:31:11.035059+0000","last_fullsized":"2024-09-15T22:31:11.035059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:11.459699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028516+0000","last_change":"2024-09-15T22:30:21.082508+0000","last_active":"2024-09-15T22:31:11.028516+0000","last_peered":"2024-09-15T22:31:11.028516+0000","last_clean":"2024-09-15T22:31:11.028516+0000","last_became_active":"2024-09-15T22:30:21.082199+0000","last_became_peered":"2024-09-15T22:30:21.082199+0000","last_unstale":"2024-09-15T22:31:11.028516+0000","last_undegraded":"2024-09-15T22:31:11.028516+0000","last_fullsized":"2024-09-15T22:31:11.028516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283700+0000","last_change":"2024-09-15T22:30:23.537744+0000","last_active":"2024-09-15T22:31:11.283700+0000","last_peered":"2024-09-15T22:31:11.283700+0000","last_clean":"2024-09-15T22:31:11.283700+0000","last_became_active":"2024-09-15T22:30:23.537426+0000","last_became_peered":"2024-09-15T22:30:23.537426+0000","last_unstale":"2024-09-15T22:31:11.283700+0000","last_undegraded":"2024-09-15T22:31:11.283700+0000","last_fullsized":"2024-09-15T22:31:11.283700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.389998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028744+0000","last_change":"2024-09-15T22:30:21.091503+0000","last_active":"2024-09-15T22:31:11.028744+0000","last_peered":"2024-09-15T22:31:11.028744+0000","last_clean":"2024-09-15T22:31:11.028744+0000","last_became_active":"2024-09-15T22:30:21.090880+0000","last_became_peered":"2024-09-15T22:30:21.090880+0000","last_unstale":"2024-09-15T22:31:11.028744+0000","last_undegraded":"2024-09-15T22:31:11.028744+0000","last_fullsized":"2024-09-15T22:31:11.028744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.908033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034699+0000","last_change":"2024-09-15T22:30:23.531619+0000","last_active":"2024-09-15T22:31:11.034699+0000","last_peered":"2024-09-15T22:31:11.034699+0000","last_clean":"2024-09-15T22:31:11.034699+0000","last_became_active":"2024-09-15T22:30:23.531287+0000","last_became_peered":"2024-09-15T22:30:23.531287+0000","last_unstale":"2024-09-15T22:31:11.034699+0000","last_undegraded":"2024-09-15T22:31:11.034699+0000","last_fullsized":"2024-09-15T22:31:11.034699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:18.026268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'29","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:35.223986+0000","last_change":"2024-09-15T22:31:11.195282+0000","last_active":"2024-09-15T22:31:35.223986+0000","last_peered":"2024-09-15T22:31:35.223986+0000","last_clean":"2024-09-15T22:31:35.223986+0000","last_became_active":"2024-09-15T22:31:11.188628+0000","last_became_peered":"2024-09-15T22:31:11.188628+0000","last_unstale":"2024-09-15T22:31:35.223986+0000","last_undegraded":"2024-09-15T22:31:35.223986+0000","last_fullsized":"2024-09-15T22:31:35.223986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:42.688724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59764,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036129+0000","last_change":"2024-09-15T22:30:23.530641+0000","last_active":"2024-09-15T22:31:11.036129+0000","last_peered":"2024-09-15T22:31:11.036129+0000","last_clean":"2024-09-15T22:31:11.036129+0000","last_became_active":"2024-09-15T22:30:23.530349+0000","last_became_peered":"2024-09-15T22:30:23.530349+0000","last_unstale":"2024-09-15T22:31:11.036129+0000","last_undegraded":"2024-09-15T22:31:11.036129+0000","last_fullsized":"2024-09-15T22:31:11.036129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:44.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030735+0000","last_change":"2024-09-15T22:30:21.080522+0000","last_active":"2024-09-15T22:31:11.030735+0000","last_peered":"2024-09-15T22:31:11.030735+0000","last_clean":"2024-09-15T22:31:11.030735+0000","last_became_active":"2024-09-15T22:30:21.079288+0000","last_became_peered":"2024-09-15T22:30:21.079288+0000","last_unstale":"2024-09-15T22:31:11.030735+0000","last_undegraded":"2024-09-15T22:31:11.030735+0000","last_fullsized":"2024-09-15T22:31:11.030735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:31.106479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027814+0000","last_change":"2024-09-15T22:30:23.535095+0000","last_active":"2024-09-15T22:31:11.027814+0000","last_peered":"2024-09-15T22:31:11.027814+0000","last_clean":"2024-09-15T22:31:11.027814+0000","last_became_active":"2024-09-15T22:30:23.534768+0000","last_became_peered":"2024-09-15T22:30:23.534768+0000","last_unstale":"2024-09-15T22:31:11.027814+0000","last_undegraded":"2024-09-15T22:31:11.027814+0000","last_fullsized":"2024-09-15T22:31:11.027814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:16.410104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028969+0000","last_change":"2024-09-15T22:30:21.084422+0000","last_active":"2024-09-15T22:31:11.028969+0000","last_peered":"2024-09-15T22:31:11.028969+0000","last_clean":"2024-09-15T22:31:11.028969+0000","last_became_active":"2024-09-15T22:30:21.084006+0000","last_became_peered":"2024-09-15T22:30:21.084006+0000","last_unstale":"2024-09-15T22:31:11.028969+0000","last_undegraded":"2024-09-15T22:31:11.028969+0000","last_fullsized":"2024-09-15T22:31:11.028969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:28.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028293+0000","last_change":"2024-09-15T22:30:23.520511+0000","last_active":"2024-09-15T22:31:11.028293+0000","last_peered":"2024-09-15T22:31:11.028293+0000","last_clean":"2024-09-15T22:31:11.028293+0000","last_became_active":"2024-09-15T22:30:23.520176+0000","last_became_peered":"2024-09-15T22:30:23.520176+0000","last_unstale":"2024-09-15T22:31:11.028293+0000","last_undegraded":"2024-09-15T22:31:11.028293+0000","last_fullsized":"2024-09-15T22:31:11.028293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.195058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:34.733663+0000","last_change":"2024-09-15T22:30:21.082312+0000","last_active":"2024-09-15T22:31:34.733663+0000","last_peered":"2024-09-15T22:31:34.733663+0000","last_clean":"2024-09-15T22:31:34.733663+0000","last_became_active":"2024-09-15T22:30:21.081919+0000","last_became_peered":"2024-09-15T22:30:21.081919+0000","last_unstale":"2024-09-15T22:31:34.733663+0000","last_undegraded":"2024-09-15T22:31:34.733663+0000","last_fullsized":"2024-09-15T22:31:34.733663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:19.893695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028060+0000","last_change":"2024-09-15T22:30:23.528002+0000","last_active":"2024-09-15T22:31:11.028060+0000","last_peered":"2024-09-15T22:31:11.028060+0000","last_clean":"2024-09-15T22:31:11.028060+0000","last_became_active":"2024-09-15T22:30:23.527648+0000","last_became_peered":"2024-09-15T22:30:23.527648+0000","last_unstale":"2024-09-15T22:31:11.028060+0000","last_undegraded":"2024-09-15T22:31:11.028060+0000","last_fullsized":"2024-09-15T22:31:11.028060+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:17.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035314+0000","last_change":"2024-09-15T22:30:21.089063+0000","last_active":"2024-09-15T22:31:11.035314+0000","last_peered":"2024-09-15T22:31:11.035314+0000","last_clean":"2024-09-15T22:31:11.035314+0000","last_became_active":"2024-09-15T22:30:21.088697+0000","last_became_peered":"2024-09-15T22:30:21.088697+0000","last_unstale":"2024-09-15T22:31:11.035314+0000","last_undegraded":"2024-09-15T22:31:11.035314+0000","last_fullsized":"2024-09-15T22:31:11.035314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:23.325725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028267+0000","last_change":"2024-09-15T22:30:23.528039+0000","last_active":"2024-09-15T22:31:11.028267+0000","last_peered":"2024-09-15T22:31:11.028267+0000","last_clean":"2024-09-15T22:31:11.028267+0000","last_became_active":"2024-09-15T22:30:23.527724+0000","last_became_peered":"2024-09-15T22:30:23.527724+0000","last_unstale":"2024-09-15T22:31:11.028267+0000","last_undegraded":"2024-09-15T22:31:11.028267+0000","last_fullsized":"2024-09-15T22:31:11.028267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.935247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036264+0000","last_change":"2024-09-15T22:30:21.082669+0000","last_active":"2024-09-15T22:31:11.036264+0000","last_peered":"2024-09-15T22:31:11.036264+0000","last_clean":"2024-09-15T22:31:11.036264+0000","last_became_active":"2024-09-15T22:30:21.082320+0000","last_became_peered":"2024-09-15T22:30:21.082320+0000","last_unstale":"2024-09-15T22:31:11.036264+0000","last_undegraded":"2024-09-15T22:31:11.036264+0000","last_fullsized":"2024-09-15T22:31:11.036264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:57.546498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031307+0000","last_change":"2024-09-15T22:30:23.526039+0000","last_active":"2024-09-15T22:31:11.031307+0000","last_peered":"2024-09-15T22:31:11.031307+0000","last_clean":"2024-09-15T22:31:11.031307+0000","last_became_active":"2024-09-15T22:30:23.525643+0000","last_became_peered":"2024-09-15T22:30:23.525643+0000","last_unstale":"2024-09-15T22:31:11.031307+0000","last_undegraded":"2024-09-15T22:31:11.031307+0000","last_fullsized":"2024-09-15T22:31:11.031307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:21:18.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.039482+0000","last_change":"2024-09-15T22:31:11.039482+0000","last_active":"2024-09-15T22:31:11.039482+0000","last_peered":"2024-09-15T22:31:11.039482+0000","last_clean":"2024-09-15T22:31:11.039482+0000","last_became_active":"2024-09-15T22:31:11.036050+0000","last_became_peered":"2024-09-15T22:31:11.036050+0000","last_unstale":"2024-09-15T22:31:11.039482+0000","last_undegraded":"2024-09-15T22:31:11.039482+0000","last_fullsized":"2024-09-15T22:31:11.039482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:19.972086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028576+0000","last_change":"2024-09-15T22:30:23.525455+0000","last_active":"2024-09-15T22:31:11.028576+0000","last_peered":"2024-09-15T22:31:11.028576+0000","last_clean":"2024-09-15T22:31:11.028576+0000","last_became_active":"2024-09-15T22:30:23.525010+0000","last_became_peered":"2024-09-15T22:30:23.525010+0000","last_unstale":"2024-09-15T22:31:11.028576+0000","last_undegraded":"2024-09-15T22:31:11.028576+0000","last_fullsized":"2024-09-15T22:31:11.028576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.783445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028823+0000","last_change":"2024-09-15T22:30:21.081906+0000","last_active":"2024-09-15T22:31:11.028823+0000","last_peered":"2024-09-15T22:31:11.028823+0000","last_clean":"2024-09-15T22:31:11.028823+0000","last_became_active":"2024-09-15T22:30:21.081508+0000","last_became_peered":"2024-09-15T22:30:21.081508+0000","last_unstale":"2024-09-15T22:31:11.028823+0000","last_undegraded":"2024-09-15T22:31:11.028823+0000","last_fullsized":"2024-09-15T22:31:11.028823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:10.781416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028397+0000","last_change":"2024-09-15T22:30:23.534015+0000","last_active":"2024-09-15T22:31:11.028397+0000","last_peered":"2024-09-15T22:31:11.028397+0000","last_clean":"2024-09-15T22:31:11.028397+0000","last_became_active":"2024-09-15T22:30:23.533273+0000","last_became_peered":"2024-09-15T22:30:23.533273+0000","last_unstale":"2024-09-15T22:31:11.028397+0000","last_undegraded":"2024-09-15T22:31:11.028397+0000","last_fullsized":"2024-09-15T22:31:11.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.752276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031104+0000","last_change":"2024-09-15T22:30:21.099447+0000","last_active":"2024-09-15T22:31:11.031104+0000","last_peered":"2024-09-15T22:31:11.031104+0000","last_clean":"2024-09-15T22:31:11.031104+0000","last_became_active":"2024-09-15T22:30:21.099060+0000","last_became_peered":"2024-09-15T22:30:21.099060+0000","last_unstale":"2024-09-15T22:31:11.031104+0000","last_undegraded":"2024-09-15T22:31:11.031104+0000","last_fullsized":"2024-09-15T22:31:11.031104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:28.878596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028464+0000","last_change":"2024-09-15T22:30:23.528034+0000","last_active":"2024-09-15T22:31:11.028464+0000","last_peered":"2024-09-15T22:31:11.028464+0000","last_clean":"2024-09-15T22:31:11.028464+0000","last_became_active":"2024-09-15T22:30:23.527665+0000","last_became_peered":"2024-09-15T22:30:23.527665+0000","last_unstale":"2024-09-15T22:31:11.028464+0000","last_undegraded":"2024-09-15T22:31:11.028464+0000","last_fullsized":"2024-09-15T22:31:11.028464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:34.827296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028263+0000","last_change":"2024-09-15T22:29:04.533047+0000","last_active":"2024-09-15T22:31:11.028263+0000","last_peered":"2024-09-15T22:31:11.028263+0000","last_clean":"2024-09-15T22:31:11.028263+0000","last_became_active":"2024-09-15T22:29:04.532535+0000","last_became_peered":"2024-09-15T22:29:04.532535+0000","last_unstale":"2024-09-15T22:31:11.028263+0000","last_undegraded":"2024-09-15T22:31:11.028263+0000","last_fullsized":"2024-09-15T22:31:11.028263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_clean_scrub_stamp":"2024-09-15T22:25:32.270999+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:13.428305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.186837+0000","last_change":"2024-09-15T22:30:21.080635+0000","last_active":"2024-09-15T22:31:11.186837+0000","last_peered":"2024-09-15T22:31:11.186837+0000","last_clean":"2024-09-15T22:31:11.186837+0000","last_became_active":"2024-09-15T22:30:21.080297+0000","last_became_peered":"2024-09-15T22:30:21.080297+0000","last_unstale":"2024-09-15T22:31:11.186837+0000","last_undegraded":"2024-09-15T22:31:11.186837+0000","last_fullsized":"2024-09-15T22:31:11.186837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:37.358138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031118+0000","last_change":"2024-09-15T22:30:23.529660+0000","last_active":"2024-09-15T22:31:11.031118+0000","last_peered":"2024-09-15T22:31:11.031118+0000","last_clean":"2024-09-15T22:31:11.031118+0000","last_became_active":"2024-09-15T22:30:23.529363+0000","last_became_peered":"2024-09-15T22:30:23.529363+0000","last_unstale":"2024-09-15T22:31:11.031118+0000","last_undegraded":"2024-09-15T22:31:11.031118+0000","last_fullsized":"2024-09-15T22:31:11.031118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:20.301523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028340+0000","last_change":"2024-09-15T22:30:21.083261+0000","last_active":"2024-09-15T22:31:11.028340+0000","last_peered":"2024-09-15T22:31:11.028340+0000","last_clean":"2024-09-15T22:31:11.028340+0000","last_became_active":"2024-09-15T22:30:21.082517+0000","last_became_peered":"2024-09-15T22:30:21.082517+0000","last_unstale":"2024-09-15T22:31:11.028340+0000","last_undegraded":"2024-09-15T22:31:11.028340+0000","last_fullsized":"2024-09-15T22:31:11.028340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:32.825877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027600+0000","last_change":"2024-09-15T22:30:23.535666+0000","last_active":"2024-09-15T22:31:11.027600+0000","last_peered":"2024-09-15T22:31:11.027600+0000","last_clean":"2024-09-15T22:31:11.027600+0000","last_became_active":"2024-09-15T22:30:23.532795+0000","last_became_peered":"2024-09-15T22:30:23.532795+0000","last_unstale":"2024-09-15T22:31:11.027600+0000","last_undegraded":"2024-09-15T22:31:11.027600+0000","last_fullsized":"2024-09-15T22:31:11.027600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:46.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:37.737358+0000","last_change":"2024-09-15T22:30:21.089614+0000","last_active":"2024-09-15T22:31:37.737358+0000","last_peered":"2024-09-15T22:31:37.737358+0000","last_clean":"2024-09-15T22:31:37.737358+0000","last_became_active":"2024-09-15T22:30:21.089252+0000","last_became_peered":"2024-09-15T22:30:21.089252+0000","last_unstale":"2024-09-15T22:31:37.737358+0000","last_undegraded":"2024-09-15T22:31:37.737358+0000","last_fullsized":"2024-09-15T22:31:37.737358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:48.491093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.037727+0000","last_change":"2024-09-15T22:31:11.037727+0000","last_active":"2024-09-15T22:31:11.037727+0000","last_peered":"2024-09-15T22:31:11.037727+0000","last_clean":"2024-09-15T22:31:11.037727+0000","last_became_active":"2024-09-15T22:31:11.037005+0000","last_became_peered":"2024-09-15T22:31:11.037005+0000","last_unstale":"2024-09-15T22:31:11.037727+0000","last_undegraded":"2024-09-15T22:31:11.037727+0000","last_fullsized":"2024-09-15T22:31:11.037727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:04.686566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028472+0000","last_change":"2024-09-15T22:30:21.084749+0000","last_active":"2024-09-15T22:31:11.028472+0000","last_peered":"2024-09-15T22:31:11.028472+0000","last_clean":"2024-09-15T22:31:11.028472+0000","last_became_active":"2024-09-15T22:30:21.083677+0000","last_became_peered":"2024-09-15T22:30:21.083677+0000","last_unstale":"2024-09-15T22:31:11.028472+0000","last_undegraded":"2024-09-15T22:31:11.028472+0000","last_fullsized":"2024-09-15T22:31:11.028472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:56.534120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031371+0000","last_change":"2024-09-15T22:30:23.525625+0000","last_active":"2024-09-15T22:31:11.031371+0000","last_peered":"2024-09-15T22:31:11.031371+0000","last_clean":"2024-09-15T22:31:11.031371+0000","last_became_active":"2024-09-15T22:30:23.525314+0000","last_became_peered":"2024-09-15T22:30:23.525314+0000","last_unstale":"2024-09-15T22:31:11.031371+0000","last_undegraded":"2024-09-15T22:31:11.031371+0000","last_fullsized":"2024-09-15T22:31:11.031371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:37.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032086+0000","last_change":"2024-09-15T22:30:21.089819+0000","last_active":"2024-09-15T22:31:11.032086+0000","last_peered":"2024-09-15T22:31:11.032086+0000","last_clean":"2024-09-15T22:31:11.032086+0000","last_became_active":"2024-09-15T22:30:21.089432+0000","last_became_peered":"2024-09-15T22:30:21.089432+0000","last_unstale":"2024-09-15T22:31:11.032086+0000","last_undegraded":"2024-09-15T22:31:11.032086+0000","last_fullsized":"2024-09-15T22:31:11.032086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:18.317959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031395+0000","last_change":"2024-09-15T22:30:23.532949+0000","last_active":"2024-09-15T22:31:11.031395+0000","last_peered":"2024-09-15T22:31:11.031395+0000","last_clean":"2024-09-15T22:31:11.031395+0000","last_became_active":"2024-09-15T22:30:23.532622+0000","last_became_peered":"2024-09-15T22:30:23.532622+0000","last_unstale":"2024-09-15T22:31:11.031395+0000","last_undegraded":"2024-09-15T22:31:11.031395+0000","last_fullsized":"2024-09-15T22:31:11.031395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:57.296048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036238+0000","last_change":"2024-09-15T22:30:21.091151+0000","last_active":"2024-09-15T22:31:11.036238+0000","last_peered":"2024-09-15T22:31:11.036238+0000","last_clean":"2024-09-15T22:31:11.036238+0000","last_became_active":"2024-09-15T22:30:21.090776+0000","last_became_peered":"2024-09-15T22:30:21.090776+0000","last_unstale":"2024-09-15T22:31:11.036238+0000","last_undegraded":"2024-09-15T22:31:11.036238+0000","last_fullsized":"2024-09-15T22:31:11.036238+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:16.882946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028009+0000","last_change":"2024-09-15T22:30:23.522118+0000","last_active":"2024-09-15T22:31:11.028009+0000","last_peered":"2024-09-15T22:31:11.028009+0000","last_clean":"2024-09-15T22:31:11.028009+0000","last_became_active":"2024-09-15T22:30:23.521592+0000","last_became_peered":"2024-09-15T22:30:23.521592+0000","last_unstale":"2024-09-15T22:31:11.028009+0000","last_undegraded":"2024-09-15T22:31:11.028009+0000","last_fullsized":"2024-09-15T22:31:11.028009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:31.331703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032392+0000","last_change":"2024-09-15T22:30:21.083399+0000","last_active":"2024-09-15T22:31:11.032392+0000","last_peered":"2024-09-15T22:31:11.032392+0000","last_clean":"2024-09-15T22:31:11.032392+0000","last_became_active":"2024-09-15T22:30:21.082863+0000","last_became_peered":"2024-09-15T22:30:21.082863+0000","last_unstale":"2024-09-15T22:31:11.032392+0000","last_undegraded":"2024-09-15T22:31:11.032392+0000","last_fullsized":"2024-09-15T22:31:11.032392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:51.895900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035419+0000","last_change":"2024-09-15T22:31:11.034224+0000","last_active":"2024-09-15T22:31:11.035419+0000","last_peered":"2024-09-15T22:31:11.035419+0000","last_clean":"2024-09-15T22:31:11.035419+0000","last_became_active":"2024-09-15T22:31:11.033850+0000","last_became_peered":"2024-09-15T22:31:11.033850+0000","last_unstale":"2024-09-15T22:31:11.035419+0000","last_undegraded":"2024-09-15T22:31:11.035419+0000","last_fullsized":"2024-09-15T22:31:11.035419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:12.420115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.187330+0000","last_change":"2024-09-15T22:30:21.099112+0000","last_active":"2024-09-15T22:31:11.187330+0000","last_peered":"2024-09-15T22:31:11.187330+0000","last_clean":"2024-09-15T22:31:11.187330+0000","last_became_active":"2024-09-15T22:30:21.098814+0000","last_became_peered":"2024-09-15T22:30:21.098814+0000","last_unstale":"2024-09-15T22:31:11.187330+0000","last_undegraded":"2024-09-15T22:31:11.187330+0000","last_fullsized":"2024-09-15T22:31:11.187330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:52.202768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283542+0000","last_change":"2024-09-15T22:30:23.540456+0000","last_active":"2024-09-15T22:31:11.283542+0000","last_peered":"2024-09-15T22:31:11.283542+0000","last_clean":"2024-09-15T22:31:11.283542+0000","last_became_active":"2024-09-15T22:30:23.538273+0000","last_became_peered":"2024-09-15T22:30:23.538273+0000","last_unstale":"2024-09-15T22:31:11.283542+0000","last_undegraded":"2024-09-15T22:31:11.283542+0000","last_fullsized":"2024-09-15T22:31:11.283542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:21.507592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034423+0000","last_change":"2024-09-15T22:30:21.088934+0000","last_active":"2024-09-15T22:31:11.034423+0000","last_peered":"2024-09-15T22:31:11.034423+0000","last_clean":"2024-09-15T22:31:11.034423+0000","last_became_active":"2024-09-15T22:30:21.088629+0000","last_became_peered":"2024-09-15T22:30:21.088629+0000","last_unstale":"2024-09-15T22:31:11.034423+0000","last_undegraded":"2024-09-15T22:31:11.034423+0000","last_fullsized":"2024-09-15T22:31:11.034423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:12.430279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035360+0000","last_change":"2024-09-15T22:30:23.523023+0000","last_active":"2024-09-15T22:31:11.035360+0000","last_peered":"2024-09-15T22:31:11.035360+0000","last_clean":"2024-09-15T22:31:11.035360+0000","last_became_active":"2024-09-15T22:30:23.522674+0000","last_became_peered":"2024-09-15T22:30:23.522674+0000","last_unstale":"2024-09-15T22:31:11.035360+0000","last_undegraded":"2024-09-15T22:31:11.035360+0000","last_fullsized":"2024-09-15T22:31:11.035360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:34.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030866+0000","last_change":"2024-09-15T22:30:21.084287+0000","last_active":"2024-09-15T22:31:11.030866+0000","last_peered":"2024-09-15T22:31:11.030866+0000","last_clean":"2024-09-15T22:31:11.030866+0000","last_became_active":"2024-09-15T22:30:21.083686+0000","last_became_peered":"2024-09-15T22:30:21.083686+0000","last_unstale":"2024-09-15T22:31:11.030866+0000","last_undegraded":"2024-09-15T22:31:11.030866+0000","last_fullsized":"2024-09-15T22:31:11.030866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:18.737268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030758+0000","last_change":"2024-09-15T22:30:23.529327+0000","last_active":"2024-09-15T22:31:11.030758+0000","last_peered":"2024-09-15T22:31:11.030758+0000","last_clean":"2024-09-15T22:31:11.030758+0000","last_became_active":"2024-09-15T22:30:23.529013+0000","last_became_peered":"2024-09-15T22:30:23.529013+0000","last_unstale":"2024-09-15T22:31:11.030758+0000","last_undegraded":"2024-09-15T22:31:11.030758+0000","last_fullsized":"2024-09-15T22:31:11.030758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:39.722197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030490+0000","last_change":"2024-09-15T22:30:21.081443+0000","last_active":"2024-09-15T22:31:11.030490+0000","last_peered":"2024-09-15T22:31:11.030490+0000","last_clean":"2024-09-15T22:31:11.030490+0000","last_became_active":"2024-09-15T22:30:21.081105+0000","last_became_peered":"2024-09-15T22:30:21.081105+0000","last_unstale":"2024-09-15T22:31:11.030490+0000","last_undegraded":"2024-09-15T22:31:11.030490+0000","last_fullsized":"2024-09-15T22:31:11.030490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:56.796153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030971+0000","last_change":"2024-09-15T22:30:23.533866+0000","last_active":"2024-09-15T22:31:11.030971+0000","last_peered":"2024-09-15T22:31:11.030971+0000","last_clean":"2024-09-15T22:31:11.030971+0000","last_became_active":"2024-09-15T22:30:23.533541+0000","last_became_peered":"2024-09-15T22:30:23.533541+0000","last_unstale":"2024-09-15T22:31:11.030971+0000","last_undegraded":"2024-09-15T22:31:11.030971+0000","last_fullsized":"2024-09-15T22:31:11.030971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:26.923241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035954+0000","last_change":"2024-09-15T22:30:21.084794+0000","last_active":"2024-09-15T22:31:11.035954+0000","last_peered":"2024-09-15T22:31:11.035954+0000","last_clean":"2024-09-15T22:31:11.035954+0000","last_became_active":"2024-09-15T22:30:21.083415+0000","last_became_peered":"2024-09-15T22:30:21.083415+0000","last_unstale":"2024-09-15T22:31:11.035954+0000","last_undegraded":"2024-09-15T22:31:11.035954+0000","last_fullsized":"2024-09-15T22:31:11.035954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:13.689217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028245+0000","last_change":"2024-09-15T22:30:23.527870+0000","last_active":"2024-09-15T22:31:11.028245+0000","last_peered":"2024-09-15T22:31:11.028245+0000","last_clean":"2024-09-15T22:31:11.028245+0000","last_became_active":"2024-09-15T22:30:23.527529+0000","last_became_peered":"2024-09-15T22:30:23.527529+0000","last_unstale":"2024-09-15T22:31:11.028245+0000","last_undegraded":"2024-09-15T22:31:11.028245+0000","last_fullsized":"2024-09-15T22:31:11.028245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:30.086127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028468+0000","last_change":"2024-09-15T22:30:23.528943+0000","last_active":"2024-09-15T22:31:11.028468+0000","last_peered":"2024-09-15T22:31:11.028468+0000","last_clean":"2024-09-15T22:31:11.028468+0000","last_became_active":"2024-09-15T22:30:23.528578+0000","last_became_peered":"2024-09-15T22:30:23.528578+0000","last_unstale":"2024-09-15T22:31:11.028468+0000","last_undegraded":"2024-09-15T22:31:11.028468+0000","last_fullsized":"2024-09-15T22:31:11.028468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:37.832903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035773+0000","last_change":"2024-09-15T22:30:21.085166+0000","last_active":"2024-09-15T22:31:11.035773+0000","last_peered":"2024-09-15T22:31:11.035773+0000","last_clean":"2024-09-15T22:31:11.035773+0000","last_became_active":"2024-09-15T22:30:21.083482+0000","last_became_peered":"2024-09-15T22:30:21.083482+0000","last_unstale":"2024-09-15T22:31:11.035773+0000","last_undegraded":"2024-09-15T22:31:11.035773+0000","last_fullsized":"2024-09-15T22:31:11.035773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:47.430411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034587+0000","last_change":"2024-09-15T22:30:23.523096+0000","last_active":"2024-09-15T22:31:11.034587+0000","last_peered":"2024-09-15T22:31:11.034587+0000","last_clean":"2024-09-15T22:31:11.034587+0000","last_became_active":"2024-09-15T22:30:23.522736+0000","last_became_peered":"2024-09-15T22:30:23.522736+0000","last_unstale":"2024-09-15T22:31:11.034587+0000","last_undegraded":"2024-09-15T22:31:11.034587+0000","last_fullsized":"2024-09-15T22:31:11.034587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:06.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.042273+0000","last_change":"2024-09-15T22:31:11.041784+0000","last_active":"2024-09-15T22:31:11.042273+0000","last_peered":"2024-09-15T22:31:11.042273+0000","last_clean":"2024-09-15T22:31:11.042273+0000","last_became_active":"2024-09-15T22:31:11.035691+0000","last_became_peered":"2024-09-15T22:31:11.035691+0000","last_unstale":"2024-09-15T22:31:11.042273+0000","last_undegraded":"2024-09-15T22:31:11.042273+0000","last_fullsized":"2024-09-15T22:31:11.042273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:40.558924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283677+0000","last_change":"2024-09-15T22:30:23.533926+0000","last_active":"2024-09-15T22:31:11.283677+0000","last_peered":"2024-09-15T22:31:11.283677+0000","last_clean":"2024-09-15T22:31:11.283677+0000","last_became_active":"2024-09-15T22:30:23.533640+0000","last_became_peered":"2024-09-15T22:30:23.533640+0000","last_unstale":"2024-09-15T22:31:11.283677+0000","last_undegraded":"2024-09-15T22:31:11.283677+0000","last_fullsized":"2024-09-15T22:31:11.283677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:07.684910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031757+0000","last_change":"2024-09-15T22:30:21.090319+0000","last_active":"2024-09-15T22:31:11.031757+0000","last_peered":"2024-09-15T22:31:11.031757+0000","last_clean":"2024-09-15T22:31:11.031757+0000","last_became_active":"2024-09-15T22:30:21.089301+0000","last_became_peered":"2024-09-15T22:30:21.089301+0000","last_unstale":"2024-09-15T22:31:11.031757+0000","last_undegraded":"2024-09-15T22:31:11.031757+0000","last_fullsized":"2024-09-15T22:31:11.031757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:16.501805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031520+0000","last_change":"2024-09-15T22:30:23.531710+0000","last_active":"2024-09-15T22:31:11.031520+0000","last_peered":"2024-09-15T22:31:11.031520+0000","last_clean":"2024-09-15T22:31:11.031520+0000","last_became_active":"2024-09-15T22:30:23.531400+0000","last_became_peered":"2024-09-15T22:30:23.531400+0000","last_unstale":"2024-09-15T22:31:11.031520+0000","last_undegraded":"2024-09-15T22:31:11.031520+0000","last_fullsized":"2024-09-15T22:31:11.031520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:11.865981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.044526+0000","last_change":"2024-09-15T22:31:11.044526+0000","last_active":"2024-09-15T22:31:11.044526+0000","last_peered":"2024-09-15T22:31:11.044526+0000","last_clean":"2024-09-15T22:31:11.044526+0000","last_became_active":"2024-09-15T22:31:11.035686+0000","last_became_peered":"2024-09-15T22:31:11.035686+0000","last_unstale":"2024-09-15T22:31:11.044526+0000","last_undegraded":"2024-09-15T22:31:11.044526+0000","last_fullsized":"2024-09-15T22:31:11.044526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:00.447208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":379,"num_read_kb":259,"num_write":163,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":60346,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":434022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874273,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41060,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704092,"statfs":{"total":95995035648,"available":95952990208,"internally_reserved":0,"allocated":1585152,"data_stored":1085078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005095,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":905216,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234029,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462962,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40968,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704184,"statfs":{"total":95995035648,"available":95953084416,"internally_reserved":0,"allocated":1495040,"data_stored":1024946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":892928,"data_stored":433065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855420,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1511424,"data_stored":1024819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":493659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":433376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":434208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":954368,"data_stored":492622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":913408,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:31:41.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:31:41.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:41 smithi112 ceph-mon[35032]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-15T22:31:41.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:41 smithi110 ceph-mon[35282]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-15T22:31:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:41.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:41 smithi022 ceph-mon[30634]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-15T22:31:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 -- 172.21.15.22:0/996460260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 msgr2=0x7f7a801043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 --2- 172.21.15.22:0/996460260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a801043d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009900 tx=0x7f7a7002a410 comp rx=0 tx=0).stop 2024-09-15T22:31:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 -- 172.21.15.22:0/996460260 shutdown_connections 2024-09-15T22:31:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 --2- 172.21.15.22:0/996460260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a80109120 0x7f7a80110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 --2- 172.21.15.22:0/996460260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a801049a0 0x7f7a801089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 --2- 172.21.15.22:0/996460260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a801043d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 -- 172.21.15.22:0/996460260 >> 172.21.15.22:0/996460260 conn(0x7f7a800ffa90 msgr2=0x7f7a80101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 -- 172.21.15.22:0/996460260 shutdown_connections 2024-09-15T22:31:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.309+0000 7f7a85800640 1 -- 172.21.15.22:0/996460260 wait complete. 2024-09-15T22:31:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.310+0000 7f7a85800640 1 Processor -- start 2024-09-15T22:31:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.310+0000 7f7a85800640 1 -- start start 2024-09-15T22:31:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a85800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a8019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a85800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a801049a0 0x7f7a8019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a85800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a80109120 0x7f7a8019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a85800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80114120 con 0x7f7a80103ff0 2024-09-15T22:31:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a85800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80113fa0 con 0x7f7a80109120 2024-09-15T22:31:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a85800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801142a0 con 0x7f7a801049a0 2024-09-15T22:31:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a8019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a8019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55802/0 (socket says 172.21.15.22:55802) 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7ea00640 1 -- 172.21.15.22:0/2744945064 learned_addr learned my addr 172.21.15.22:0/2744945064 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7f400640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a80109120 0x7f7a8019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7e000640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a801049a0 0x7f7a8019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7ea00640 1 -- 172.21.15.22:0/2744945064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a801049a0 msgr2=0x7f7a8019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.311+0000 7f7a7ea00640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a801049a0 0x7f7a8019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a7ea00640 1 -- 172.21.15.22:0/2744945064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a80109120 msgr2=0x7f7a8019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a7ea00640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a80109120 0x7f7a8019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a7ea00640 1 -- 172.21.15.22:0/2744945064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8019f5d0 con 0x7f7a80103ff0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a7ea00640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a8019a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006010 tx=0x7f7a700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7003f030 con 0x7f7a80103ff0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8019f860 con 0x7f7a80103ff0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a70003ce0 con 0x7f7a80103ff0 2024-09-15T22:31:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.312+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70035070 con 0x7f7a80103ff0 2024-09-15T22:31:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.313+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a801a71a0 con 0x7f7a80103ff0 2024-09-15T22:31:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.314+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a801054d0 con 0x7f7a80103ff0 2024-09-15T22:31:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.316+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7a70042030 con 0x7f7a80103ff0 2024-09-15T22:31:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.317+0000 7f7a77400640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f7a640a32d0 0x7f7a640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.317+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f7a700efb40 con 0x7f7a80103ff0 2024-09-15T22:31:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.317+0000 7f7a7e000640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f7a640a32d0 0x7f7a640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.318+0000 7f7a7e000640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f7a640a32d0 0x7f7a640a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a800ffeb0 tx=0x7f7a6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.321+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a700bc130 con 0x7f7a80103ff0 2024-09-15T22:31:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.507+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a80062630 con 0x7f7a640a32d0 2024-09-15T22:31:42.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:42 smithi022 ceph-mon[30634]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.517+0000 7f7a77400640 1 -- 172.21.15.22:0/2744945064 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258724 (secure 0 0 0) 0x7f7a80062630 con 0x7f7a640a32d0 2024-09-15T22:31:42.522 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f7a640a32d0 msgr2=0x7f7a640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f7a640a32d0 0x7f7a640a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a800ffeb0 tx=0x7f7a6c005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 msgr2=0x7f7a8019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a8019a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006010 tx=0x7f7a700042f0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 shutdown_connections 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a801049a0 0x7f7a8019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f7a640a32d0 0x7f7a640a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a80109120 0x7f7a8019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 --2- 172.21.15.22:0/2744945064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a80103ff0 0x7f7a8019a620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 >> 172.21.15.22:0/2744945064 conn(0x7f7a800ffa90 msgr2=0x7f7a80100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 shutdown_connections 2024-09-15T22:31:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:42.522+0000 7f7a85800640 1 -- 172.21.15.22:0/2744945064 wait complete. 2024-09-15T22:31:42.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:42 smithi110 ceph-mon[35282]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:42.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:42 smithi112 ceph-mon[35032]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:43.322 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-15T22:31:41.564247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":530,"num_read_kb":378,"num_write":346,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1241082,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":428424,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":415597,"kb_avail":1124513400,"statfs":{"total":1151940427776,"available":1151501721600,"internally_reserved":0,"allocated":12840960,"data_stored":7157403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":425571642},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":39,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002763"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031717+0000","last_change":"2024-09-15T22:30:23.540766+0000","last_active":"2024-09-15T22:31:11.031717+0000","last_peered":"2024-09-15T22:31:11.031717+0000","last_clean":"2024-09-15T22:31:11.031717+0000","last_became_active":"2024-09-15T22:30:23.540425+0000","last_became_peered":"2024-09-15T22:30:23.540425+0000","last_unstale":"2024-09-15T22:31:11.031717+0000","last_undegraded":"2024-09-15T22:31:11.031717+0000","last_fullsized":"2024-09-15T22:31:11.031717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:50.650220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283500+0000","last_change":"2024-09-15T22:30:23.533484+0000","last_active":"2024-09-15T22:31:11.283500+0000","last_peered":"2024-09-15T22:31:11.283500+0000","last_clean":"2024-09-15T22:31:11.283500+0000","last_became_active":"2024-09-15T22:30:23.532995+0000","last_became_peered":"2024-09-15T22:30:23.532995+0000","last_unstale":"2024-09-15T22:31:11.283500+0000","last_undegraded":"2024-09-15T22:31:11.283500+0000","last_fullsized":"2024-09-15T22:31:11.283500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:42.108789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283410+0000","last_change":"2024-09-15T22:30:23.529206+0000","last_active":"2024-09-15T22:31:11.283410+0000","last_peered":"2024-09-15T22:31:11.283410+0000","last_clean":"2024-09-15T22:31:11.283410+0000","last_became_active":"2024-09-15T22:30:23.528894+0000","last_became_peered":"2024-09-15T22:30:23.528894+0000","last_unstale":"2024-09-15T22:31:11.283410+0000","last_undegraded":"2024-09-15T22:31:11.283410+0000","last_fullsized":"2024-09-15T22:31:11.283410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:53.130553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.187248+0000","last_change":"2024-09-15T22:30:23.529406+0000","last_active":"2024-09-15T22:31:11.187248+0000","last_peered":"2024-09-15T22:31:11.187248+0000","last_clean":"2024-09-15T22:31:11.187248+0000","last_became_active":"2024-09-15T22:30:23.529074+0000","last_became_peered":"2024-09-15T22:30:23.529074+0000","last_unstale":"2024-09-15T22:31:11.187248+0000","last_undegraded":"2024-09-15T22:31:11.187248+0000","last_fullsized":"2024-09-15T22:31:11.187248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:55.848853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035905+0000","last_change":"2024-09-15T22:30:23.525342+0000","last_active":"2024-09-15T22:31:11.035905+0000","last_peered":"2024-09-15T22:31:11.035905+0000","last_clean":"2024-09-15T22:31:11.035905+0000","last_became_active":"2024-09-15T22:30:23.524983+0000","last_became_peered":"2024-09-15T22:30:23.524983+0000","last_unstale":"2024-09-15T22:31:11.035905+0000","last_undegraded":"2024-09-15T22:31:11.035905+0000","last_fullsized":"2024-09-15T22:31:11.035905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:57.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031225+0000","last_change":"2024-09-15T22:30:23.522364+0000","last_active":"2024-09-15T22:31:11.031225+0000","last_peered":"2024-09-15T22:31:11.031225+0000","last_clean":"2024-09-15T22:31:11.031225+0000","last_became_active":"2024-09-15T22:30:23.522018+0000","last_became_peered":"2024-09-15T22:30:23.522018+0000","last_unstale":"2024-09-15T22:31:11.031225+0000","last_undegraded":"2024-09-15T22:31:11.031225+0000","last_fullsized":"2024-09-15T22:31:11.031225+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:24.373042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028110+0000","last_change":"2024-09-15T22:30:23.531767+0000","last_active":"2024-09-15T22:31:11.028110+0000","last_peered":"2024-09-15T22:31:11.028110+0000","last_clean":"2024-09-15T22:31:11.028110+0000","last_became_active":"2024-09-15T22:30:23.530522+0000","last_became_peered":"2024-09-15T22:30:23.530522+0000","last_unstale":"2024-09-15T22:31:11.028110+0000","last_undegraded":"2024-09-15T22:31:11.028110+0000","last_fullsized":"2024-09-15T22:31:11.028110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:16.225467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031696+0000","last_change":"2024-09-15T22:30:23.528714+0000","last_active":"2024-09-15T22:31:11.031696+0000","last_peered":"2024-09-15T22:31:11.031696+0000","last_clean":"2024-09-15T22:31:11.031696+0000","last_became_active":"2024-09-15T22:30:23.528412+0000","last_became_peered":"2024-09-15T22:30:23.528412+0000","last_unstale":"2024-09-15T22:31:11.031696+0000","last_undegraded":"2024-09-15T22:31:11.031696+0000","last_fullsized":"2024-09-15T22:31:11.031696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:25.020500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034856+0000","last_change":"2024-09-15T22:30:23.523940+0000","last_active":"2024-09-15T22:31:11.034856+0000","last_peered":"2024-09-15T22:31:11.034856+0000","last_clean":"2024-09-15T22:31:11.034856+0000","last_became_active":"2024-09-15T22:30:23.522682+0000","last_became_peered":"2024-09-15T22:30:23.522682+0000","last_unstale":"2024-09-15T22:31:11.034856+0000","last_undegraded":"2024-09-15T22:31:11.034856+0000","last_fullsized":"2024-09-15T22:31:11.034856+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:48.164040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031675+0000","last_change":"2024-09-15T22:30:23.524927+0000","last_active":"2024-09-15T22:31:11.031675+0000","last_peered":"2024-09-15T22:31:11.031675+0000","last_clean":"2024-09-15T22:31:11.031675+0000","last_became_active":"2024-09-15T22:30:23.524578+0000","last_became_peered":"2024-09-15T22:30:23.524578+0000","last_unstale":"2024-09-15T22:31:11.031675+0000","last_undegraded":"2024-09-15T22:31:11.031675+0000","last_fullsized":"2024-09-15T22:31:11.031675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:15.093534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028421+0000","last_change":"2024-09-15T22:30:23.527258+0000","last_active":"2024-09-15T22:31:11.028421+0000","last_peered":"2024-09-15T22:31:11.028421+0000","last_clean":"2024-09-15T22:31:11.028421+0000","last_became_active":"2024-09-15T22:30:23.526842+0000","last_became_peered":"2024-09-15T22:30:23.526842+0000","last_unstale":"2024-09-15T22:31:11.028421+0000","last_undegraded":"2024-09-15T22:31:11.028421+0000","last_fullsized":"2024-09-15T22:31:11.028421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:45.861445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.187371+0000","last_change":"2024-09-15T22:30:23.524525+0000","last_active":"2024-09-15T22:31:11.187371+0000","last_peered":"2024-09-15T22:31:11.187371+0000","last_clean":"2024-09-15T22:31:11.187371+0000","last_became_active":"2024-09-15T22:30:23.523915+0000","last_became_peered":"2024-09-15T22:30:23.523915+0000","last_unstale":"2024-09-15T22:31:11.187371+0000","last_undegraded":"2024-09-15T22:31:11.187371+0000","last_fullsized":"2024-09-15T22:31:11.187371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:24.954632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027843+0000","last_change":"2024-09-15T22:30:23.522262+0000","last_active":"2024-09-15T22:31:11.027843+0000","last_peered":"2024-09-15T22:31:11.027843+0000","last_clean":"2024-09-15T22:31:11.027843+0000","last_became_active":"2024-09-15T22:30:23.521919+0000","last_became_peered":"2024-09-15T22:30:23.521919+0000","last_unstale":"2024-09-15T22:31:11.027843+0000","last_undegraded":"2024-09-15T22:31:11.027843+0000","last_fullsized":"2024-09-15T22:31:11.027843+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:48.362426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283418+0000","last_change":"2024-09-15T22:30:23.526652+0000","last_active":"2024-09-15T22:31:11.283418+0000","last_peered":"2024-09-15T22:31:11.283418+0000","last_clean":"2024-09-15T22:31:11.283418+0000","last_became_active":"2024-09-15T22:30:23.526204+0000","last_became_peered":"2024-09-15T22:30:23.526204+0000","last_unstale":"2024-09-15T22:31:11.283418+0000","last_undegraded":"2024-09-15T22:31:11.283418+0000","last_fullsized":"2024-09-15T22:31:11.283418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:40.914567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283253+0000","last_change":"2024-09-15T22:30:23.528996+0000","last_active":"2024-09-15T22:31:11.283253+0000","last_peered":"2024-09-15T22:31:11.283253+0000","last_clean":"2024-09-15T22:31:11.283253+0000","last_became_active":"2024-09-15T22:30:23.528666+0000","last_became_peered":"2024-09-15T22:30:23.528666+0000","last_unstale":"2024-09-15T22:31:11.283253+0000","last_undegraded":"2024-09-15T22:31:11.283253+0000","last_fullsized":"2024-09-15T22:31:11.283253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:10.895994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034223+0000","last_change":"2024-09-15T22:30:23.525288+0000","last_active":"2024-09-15T22:31:11.034223+0000","last_peered":"2024-09-15T22:31:11.034223+0000","last_clean":"2024-09-15T22:31:11.034223+0000","last_became_active":"2024-09-15T22:30:23.524956+0000","last_became_peered":"2024-09-15T22:30:23.524956+0000","last_unstale":"2024-09-15T22:31:11.034223+0000","last_undegraded":"2024-09-15T22:31:11.034223+0000","last_fullsized":"2024-09-15T22:31:11.034223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:06.837680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031822+0000","last_change":"2024-09-15T22:30:23.540709+0000","last_active":"2024-09-15T22:31:11.031822+0000","last_peered":"2024-09-15T22:31:11.031822+0000","last_clean":"2024-09-15T22:31:11.031822+0000","last_became_active":"2024-09-15T22:30:23.540332+0000","last_became_peered":"2024-09-15T22:30:23.540332+0000","last_unstale":"2024-09-15T22:31:11.031822+0000","last_undegraded":"2024-09-15T22:31:11.031822+0000","last_fullsized":"2024-09-15T22:31:11.031822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:46.817361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032283+0000","last_change":"2024-09-15T22:30:23.521007+0000","last_active":"2024-09-15T22:31:11.032283+0000","last_peered":"2024-09-15T22:31:11.032283+0000","last_clean":"2024-09-15T22:31:11.032283+0000","last_became_active":"2024-09-15T22:30:23.520678+0000","last_became_peered":"2024-09-15T22:30:23.520678+0000","last_unstale":"2024-09-15T22:31:11.032283+0000","last_undegraded":"2024-09-15T22:31:11.032283+0000","last_fullsized":"2024-09-15T22:31:11.032283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:44.404729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030415+0000","last_change":"2024-09-15T22:30:23.528280+0000","last_active":"2024-09-15T22:31:11.030415+0000","last_peered":"2024-09-15T22:31:11.030415+0000","last_clean":"2024-09-15T22:31:11.030415+0000","last_became_active":"2024-09-15T22:30:23.527888+0000","last_became_peered":"2024-09-15T22:30:23.527888+0000","last_unstale":"2024-09-15T22:31:11.030415+0000","last_undegraded":"2024-09-15T22:31:11.030415+0000","last_fullsized":"2024-09-15T22:31:11.030415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:45.748437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031034+0000","last_change":"2024-09-15T22:30:23.525344+0000","last_active":"2024-09-15T22:31:11.031034+0000","last_peered":"2024-09-15T22:31:11.031034+0000","last_clean":"2024-09-15T22:31:11.031034+0000","last_became_active":"2024-09-15T22:30:23.525029+0000","last_became_peered":"2024-09-15T22:30:23.525029+0000","last_unstale":"2024-09-15T22:31:11.031034+0000","last_undegraded":"2024-09-15T22:31:11.031034+0000","last_fullsized":"2024-09-15T22:31:11.031034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:25.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027945+0000","last_change":"2024-09-15T22:30:23.530315+0000","last_active":"2024-09-15T22:31:11.027945+0000","last_peered":"2024-09-15T22:31:11.027945+0000","last_clean":"2024-09-15T22:31:11.027945+0000","last_became_active":"2024-09-15T22:30:23.529388+0000","last_became_peered":"2024-09-15T22:30:23.529388+0000","last_unstale":"2024-09-15T22:31:11.027945+0000","last_undegraded":"2024-09-15T22:31:11.027945+0000","last_fullsized":"2024-09-15T22:31:11.027945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:55.126701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034599+0000","last_change":"2024-09-15T22:30:23.530305+0000","last_active":"2024-09-15T22:31:11.034599+0000","last_peered":"2024-09-15T22:31:11.034599+0000","last_clean":"2024-09-15T22:31:11.034599+0000","last_became_active":"2024-09-15T22:30:23.529909+0000","last_became_peered":"2024-09-15T22:30:23.529909+0000","last_unstale":"2024-09-15T22:31:11.034599+0000","last_undegraded":"2024-09-15T22:31:11.034599+0000","last_fullsized":"2024-09-15T22:31:11.034599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:07.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030741+0000","last_change":"2024-09-15T22:30:23.524511+0000","last_active":"2024-09-15T22:31:11.030741+0000","last_peered":"2024-09-15T22:31:11.030741+0000","last_clean":"2024-09-15T22:31:11.030741+0000","last_became_active":"2024-09-15T22:30:23.524219+0000","last_became_peered":"2024-09-15T22:30:23.524219+0000","last_unstale":"2024-09-15T22:31:11.030741+0000","last_undegraded":"2024-09-15T22:31:11.030741+0000","last_fullsized":"2024-09-15T22:31:11.030741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:47.092184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028220+0000","last_change":"2024-09-15T22:30:23.531690+0000","last_active":"2024-09-15T22:31:11.028220+0000","last_peered":"2024-09-15T22:31:11.028220+0000","last_clean":"2024-09-15T22:31:11.028220+0000","last_became_active":"2024-09-15T22:30:23.531372+0000","last_became_peered":"2024-09-15T22:30:23.531372+0000","last_unstale":"2024-09-15T22:31:11.028220+0000","last_undegraded":"2024-09-15T22:31:11.028220+0000","last_fullsized":"2024-09-15T22:31:11.028220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:11.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031248+0000","last_change":"2024-09-15T22:30:23.538064+0000","last_active":"2024-09-15T22:31:11.031248+0000","last_peered":"2024-09-15T22:31:11.031248+0000","last_clean":"2024-09-15T22:31:11.031248+0000","last_became_active":"2024-09-15T22:30:23.537568+0000","last_became_peered":"2024-09-15T22:30:23.537568+0000","last_unstale":"2024-09-15T22:31:11.031248+0000","last_undegraded":"2024-09-15T22:31:11.031248+0000","last_fullsized":"2024-09-15T22:31:11.031248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:22.368267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030575+0000","last_change":"2024-09-15T22:30:23.528383+0000","last_active":"2024-09-15T22:31:11.030575+0000","last_peered":"2024-09-15T22:31:11.030575+0000","last_clean":"2024-09-15T22:31:11.030575+0000","last_became_active":"2024-09-15T22:30:23.527984+0000","last_became_peered":"2024-09-15T22:30:23.527984+0000","last_unstale":"2024-09-15T22:31:11.030575+0000","last_undegraded":"2024-09-15T22:31:11.030575+0000","last_fullsized":"2024-09-15T22:31:11.030575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:28.301070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036163+0000","last_change":"2024-09-15T22:31:11.036163+0000","last_active":"2024-09-15T22:31:11.036163+0000","last_peered":"2024-09-15T22:31:11.036163+0000","last_clean":"2024-09-15T22:31:11.036163+0000","last_became_active":"2024-09-15T22:31:11.035816+0000","last_became_peered":"2024-09-15T22:31:11.035816+0000","last_unstale":"2024-09-15T22:31:11.036163+0000","last_undegraded":"2024-09-15T22:31:11.036163+0000","last_fullsized":"2024-09-15T22:31:11.036163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:00.849092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.284956+0000","last_change":"2024-09-15T22:31:11.284956+0000","last_active":"2024-09-15T22:31:11.284956+0000","last_peered":"2024-09-15T22:31:11.284956+0000","last_clean":"2024-09-15T22:31:11.284956+0000","last_became_active":"2024-09-15T22:31:11.284466+0000","last_became_peered":"2024-09-15T22:31:11.284466+0000","last_unstale":"2024-09-15T22:31:11.284956+0000","last_undegraded":"2024-09-15T22:31:11.284956+0000","last_fullsized":"2024-09-15T22:31:11.284956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:49.840350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283535+0000","last_change":"2024-09-15T22:30:23.535074+0000","last_active":"2024-09-15T22:31:11.283535+0000","last_peered":"2024-09-15T22:31:11.283535+0000","last_clean":"2024-09-15T22:31:11.283535+0000","last_became_active":"2024-09-15T22:30:23.534810+0000","last_became_peered":"2024-09-15T22:30:23.534810+0000","last_unstale":"2024-09-15T22:31:11.283535+0000","last_undegraded":"2024-09-15T22:31:11.283535+0000","last_fullsized":"2024-09-15T22:31:11.283535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:28.085650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030371+0000","last_change":"2024-09-15T22:30:23.533870+0000","last_active":"2024-09-15T22:31:11.030371+0000","last_peered":"2024-09-15T22:31:11.030371+0000","last_clean":"2024-09-15T22:31:11.030371+0000","last_became_active":"2024-09-15T22:30:23.533377+0000","last_became_peered":"2024-09-15T22:30:23.533377+0000","last_unstale":"2024-09-15T22:31:11.030371+0000","last_undegraded":"2024-09-15T22:31:11.030371+0000","last_fullsized":"2024-09-15T22:31:11.030371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:50.466754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034411+0000","last_change":"2024-09-15T22:31:11.034411+0000","last_active":"2024-09-15T22:31:11.034411+0000","last_peered":"2024-09-15T22:31:11.034411+0000","last_clean":"2024-09-15T22:31:11.034411+0000","last_became_active":"2024-09-15T22:31:11.034063+0000","last_became_peered":"2024-09-15T22:31:11.034063+0000","last_unstale":"2024-09-15T22:31:11.034411+0000","last_undegraded":"2024-09-15T22:31:11.034411+0000","last_fullsized":"2024-09-15T22:31:11.034411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:26.615817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030657+0000","last_change":"2024-09-15T22:30:23.526096+0000","last_active":"2024-09-15T22:31:11.030657+0000","last_peered":"2024-09-15T22:31:11.030657+0000","last_clean":"2024-09-15T22:31:11.030657+0000","last_became_active":"2024-09-15T22:30:23.525746+0000","last_became_peered":"2024-09-15T22:30:23.525746+0000","last_unstale":"2024-09-15T22:31:11.030657+0000","last_undegraded":"2024-09-15T22:31:11.030657+0000","last_fullsized":"2024-09-15T22:31:11.030657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:57.303470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035532+0000","last_change":"2024-09-15T22:30:23.518856+0000","last_active":"2024-09-15T22:31:11.035532+0000","last_peered":"2024-09-15T22:31:11.035532+0000","last_clean":"2024-09-15T22:31:11.035532+0000","last_became_active":"2024-09-15T22:30:23.518385+0000","last_became_peered":"2024-09-15T22:30:23.518385+0000","last_unstale":"2024-09-15T22:31:11.035532+0000","last_undegraded":"2024-09-15T22:31:11.035532+0000","last_fullsized":"2024-09-15T22:31:11.035532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:19.783989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:38.739381+0000","last_change":"2024-09-15T22:30:21.083625+0000","last_active":"2024-09-15T22:31:38.739381+0000","last_peered":"2024-09-15T22:31:38.739381+0000","last_clean":"2024-09-15T22:31:38.739381+0000","last_became_active":"2024-09-15T22:30:21.083252+0000","last_became_peered":"2024-09-15T22:30:21.083252+0000","last_unstale":"2024-09-15T22:31:38.739381+0000","last_undegraded":"2024-09-15T22:31:38.739381+0000","last_fullsized":"2024-09-15T22:31:38.739381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:34.596784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028368+0000","last_change":"2024-09-15T22:30:23.539472+0000","last_active":"2024-09-15T22:31:11.028368+0000","last_peered":"2024-09-15T22:31:11.028368+0000","last_clean":"2024-09-15T22:31:11.028368+0000","last_became_active":"2024-09-15T22:30:23.539138+0000","last_became_peered":"2024-09-15T22:30:23.539138+0000","last_unstale":"2024-09-15T22:31:11.028368+0000","last_undegraded":"2024-09-15T22:31:11.028368+0000","last_fullsized":"2024-09-15T22:31:11.028368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:18.956428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031376+0000","last_change":"2024-09-15T22:30:21.084153+0000","last_active":"2024-09-15T22:31:11.031376+0000","last_peered":"2024-09-15T22:31:11.031376+0000","last_clean":"2024-09-15T22:31:11.031376+0000","last_became_active":"2024-09-15T22:30:21.083772+0000","last_became_peered":"2024-09-15T22:30:21.083772+0000","last_unstale":"2024-09-15T22:31:11.031376+0000","last_undegraded":"2024-09-15T22:31:11.031376+0000","last_fullsized":"2024-09-15T22:31:11.031376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:42.435846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027613+0000","last_change":"2024-09-15T22:30:21.081395+0000","last_active":"2024-09-15T22:31:11.027613+0000","last_peered":"2024-09-15T22:31:11.027613+0000","last_clean":"2024-09-15T22:31:11.027613+0000","last_became_active":"2024-09-15T22:30:21.080785+0000","last_became_peered":"2024-09-15T22:30:21.080785+0000","last_unstale":"2024-09-15T22:31:11.027613+0000","last_undegraded":"2024-09-15T22:31:11.027613+0000","last_fullsized":"2024-09-15T22:31:11.027613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:58.908942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030742+0000","last_change":"2024-09-15T22:30:23.525123+0000","last_active":"2024-09-15T22:31:11.030742+0000","last_peered":"2024-09-15T22:31:11.030742+0000","last_clean":"2024-09-15T22:31:11.030742+0000","last_became_active":"2024-09-15T22:30:23.524772+0000","last_became_peered":"2024-09-15T22:30:23.524772+0000","last_unstale":"2024-09-15T22:31:11.030742+0000","last_undegraded":"2024-09-15T22:31:11.030742+0000","last_fullsized":"2024-09-15T22:31:11.030742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:32.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028451+0000","last_change":"2024-09-15T22:30:21.084218+0000","last_active":"2024-09-15T22:31:11.028451+0000","last_peered":"2024-09-15T22:31:11.028451+0000","last_clean":"2024-09-15T22:31:11.028451+0000","last_became_active":"2024-09-15T22:30:21.083853+0000","last_became_peered":"2024-09-15T22:30:21.083853+0000","last_unstale":"2024-09-15T22:31:11.028451+0000","last_undegraded":"2024-09-15T22:31:11.028451+0000","last_fullsized":"2024-09-15T22:31:11.028451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:56.947260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032337+0000","last_change":"2024-09-15T22:30:23.526667+0000","last_active":"2024-09-15T22:31:11.032337+0000","last_peered":"2024-09-15T22:31:11.032337+0000","last_clean":"2024-09-15T22:31:11.032337+0000","last_became_active":"2024-09-15T22:30:23.524872+0000","last_became_peered":"2024-09-15T22:30:23.524872+0000","last_unstale":"2024-09-15T22:31:11.032337+0000","last_undegraded":"2024-09-15T22:31:11.032337+0000","last_fullsized":"2024-09-15T22:31:11.032337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:11.222255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:39.740338+0000","last_change":"2024-09-15T22:30:21.081582+0000","last_active":"2024-09-15T22:31:39.740338+0000","last_peered":"2024-09-15T22:31:39.740338+0000","last_clean":"2024-09-15T22:31:39.740338+0000","last_became_active":"2024-09-15T22:30:21.081217+0000","last_became_peered":"2024-09-15T22:30:21.081217+0000","last_unstale":"2024-09-15T22:31:39.740338+0000","last_undegraded":"2024-09-15T22:31:39.740338+0000","last_fullsized":"2024-09-15T22:31:39.740338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:21.877645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035059+0000","last_change":"2024-09-15T22:30:23.523065+0000","last_active":"2024-09-15T22:31:11.035059+0000","last_peered":"2024-09-15T22:31:11.035059+0000","last_clean":"2024-09-15T22:31:11.035059+0000","last_became_active":"2024-09-15T22:30:23.522743+0000","last_became_peered":"2024-09-15T22:30:23.522743+0000","last_unstale":"2024-09-15T22:31:11.035059+0000","last_undegraded":"2024-09-15T22:31:11.035059+0000","last_fullsized":"2024-09-15T22:31:11.035059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:11.459699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028516+0000","last_change":"2024-09-15T22:30:21.082508+0000","last_active":"2024-09-15T22:31:11.028516+0000","last_peered":"2024-09-15T22:31:11.028516+0000","last_clean":"2024-09-15T22:31:11.028516+0000","last_became_active":"2024-09-15T22:30:21.082199+0000","last_became_peered":"2024-09-15T22:30:21.082199+0000","last_unstale":"2024-09-15T22:31:11.028516+0000","last_undegraded":"2024-09-15T22:31:11.028516+0000","last_fullsized":"2024-09-15T22:31:11.028516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283700+0000","last_change":"2024-09-15T22:30:23.537744+0000","last_active":"2024-09-15T22:31:11.283700+0000","last_peered":"2024-09-15T22:31:11.283700+0000","last_clean":"2024-09-15T22:31:11.283700+0000","last_became_active":"2024-09-15T22:30:23.537426+0000","last_became_peered":"2024-09-15T22:30:23.537426+0000","last_unstale":"2024-09-15T22:31:11.283700+0000","last_undegraded":"2024-09-15T22:31:11.283700+0000","last_fullsized":"2024-09-15T22:31:11.283700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.389998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028744+0000","last_change":"2024-09-15T22:30:21.091503+0000","last_active":"2024-09-15T22:31:11.028744+0000","last_peered":"2024-09-15T22:31:11.028744+0000","last_clean":"2024-09-15T22:31:11.028744+0000","last_became_active":"2024-09-15T22:30:21.090880+0000","last_became_peered":"2024-09-15T22:30:21.090880+0000","last_unstale":"2024-09-15T22:31:11.028744+0000","last_undegraded":"2024-09-15T22:31:11.028744+0000","last_fullsized":"2024-09-15T22:31:11.028744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.908033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034699+0000","last_change":"2024-09-15T22:30:23.531619+0000","last_active":"2024-09-15T22:31:11.034699+0000","last_peered":"2024-09-15T22:31:11.034699+0000","last_clean":"2024-09-15T22:31:11.034699+0000","last_became_active":"2024-09-15T22:30:23.531287+0000","last_became_peered":"2024-09-15T22:30:23.531287+0000","last_unstale":"2024-09-15T22:31:11.034699+0000","last_undegraded":"2024-09-15T22:31:11.034699+0000","last_fullsized":"2024-09-15T22:31:11.034699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:18.026268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'29","reported_seq":205,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:40.231302+0000","last_change":"2024-09-15T22:31:11.195282+0000","last_active":"2024-09-15T22:31:40.231302+0000","last_peered":"2024-09-15T22:31:40.231302+0000","last_clean":"2024-09-15T22:31:40.231302+0000","last_became_active":"2024-09-15T22:31:11.188628+0000","last_became_peered":"2024-09-15T22:31:11.188628+0000","last_unstale":"2024-09-15T22:31:40.231302+0000","last_undegraded":"2024-09-15T22:31:40.231302+0000","last_fullsized":"2024-09-15T22:31:40.231302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:42.688724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":59764,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036129+0000","last_change":"2024-09-15T22:30:23.530641+0000","last_active":"2024-09-15T22:31:11.036129+0000","last_peered":"2024-09-15T22:31:11.036129+0000","last_clean":"2024-09-15T22:31:11.036129+0000","last_became_active":"2024-09-15T22:30:23.530349+0000","last_became_peered":"2024-09-15T22:30:23.530349+0000","last_unstale":"2024-09-15T22:31:11.036129+0000","last_undegraded":"2024-09-15T22:31:11.036129+0000","last_fullsized":"2024-09-15T22:31:11.036129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:44.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030735+0000","last_change":"2024-09-15T22:30:21.080522+0000","last_active":"2024-09-15T22:31:11.030735+0000","last_peered":"2024-09-15T22:31:11.030735+0000","last_clean":"2024-09-15T22:31:11.030735+0000","last_became_active":"2024-09-15T22:30:21.079288+0000","last_became_peered":"2024-09-15T22:30:21.079288+0000","last_unstale":"2024-09-15T22:31:11.030735+0000","last_undegraded":"2024-09-15T22:31:11.030735+0000","last_fullsized":"2024-09-15T22:31:11.030735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:31.106479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027814+0000","last_change":"2024-09-15T22:30:23.535095+0000","last_active":"2024-09-15T22:31:11.027814+0000","last_peered":"2024-09-15T22:31:11.027814+0000","last_clean":"2024-09-15T22:31:11.027814+0000","last_became_active":"2024-09-15T22:30:23.534768+0000","last_became_peered":"2024-09-15T22:30:23.534768+0000","last_unstale":"2024-09-15T22:31:11.027814+0000","last_undegraded":"2024-09-15T22:31:11.027814+0000","last_fullsized":"2024-09-15T22:31:11.027814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:16.410104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028969+0000","last_change":"2024-09-15T22:30:21.084422+0000","last_active":"2024-09-15T22:31:11.028969+0000","last_peered":"2024-09-15T22:31:11.028969+0000","last_clean":"2024-09-15T22:31:11.028969+0000","last_became_active":"2024-09-15T22:30:21.084006+0000","last_became_peered":"2024-09-15T22:30:21.084006+0000","last_unstale":"2024-09-15T22:31:11.028969+0000","last_undegraded":"2024-09-15T22:31:11.028969+0000","last_fullsized":"2024-09-15T22:31:11.028969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:28.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028293+0000","last_change":"2024-09-15T22:30:23.520511+0000","last_active":"2024-09-15T22:31:11.028293+0000","last_peered":"2024-09-15T22:31:11.028293+0000","last_clean":"2024-09-15T22:31:11.028293+0000","last_became_active":"2024-09-15T22:30:23.520176+0000","last_became_peered":"2024-09-15T22:30:23.520176+0000","last_unstale":"2024-09-15T22:31:11.028293+0000","last_undegraded":"2024-09-15T22:31:11.028293+0000","last_fullsized":"2024-09-15T22:31:11.028293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.195058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:39.740943+0000","last_change":"2024-09-15T22:30:21.082312+0000","last_active":"2024-09-15T22:31:39.740943+0000","last_peered":"2024-09-15T22:31:39.740943+0000","last_clean":"2024-09-15T22:31:39.740943+0000","last_became_active":"2024-09-15T22:30:21.081919+0000","last_became_peered":"2024-09-15T22:30:21.081919+0000","last_unstale":"2024-09-15T22:31:39.740943+0000","last_undegraded":"2024-09-15T22:31:39.740943+0000","last_fullsized":"2024-09-15T22:31:39.740943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:19.893695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028060+0000","last_change":"2024-09-15T22:30:23.528002+0000","last_active":"2024-09-15T22:31:11.028060+0000","last_peered":"2024-09-15T22:31:11.028060+0000","last_clean":"2024-09-15T22:31:11.028060+0000","last_became_active":"2024-09-15T22:30:23.527648+0000","last_became_peered":"2024-09-15T22:30:23.527648+0000","last_unstale":"2024-09-15T22:31:11.028060+0000","last_undegraded":"2024-09-15T22:31:11.028060+0000","last_fullsized":"2024-09-15T22:31:11.028060+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:17.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035314+0000","last_change":"2024-09-15T22:30:21.089063+0000","last_active":"2024-09-15T22:31:11.035314+0000","last_peered":"2024-09-15T22:31:11.035314+0000","last_clean":"2024-09-15T22:31:11.035314+0000","last_became_active":"2024-09-15T22:30:21.088697+0000","last_became_peered":"2024-09-15T22:30:21.088697+0000","last_unstale":"2024-09-15T22:31:11.035314+0000","last_undegraded":"2024-09-15T22:31:11.035314+0000","last_fullsized":"2024-09-15T22:31:11.035314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:23.325725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028267+0000","last_change":"2024-09-15T22:30:23.528039+0000","last_active":"2024-09-15T22:31:11.028267+0000","last_peered":"2024-09-15T22:31:11.028267+0000","last_clean":"2024-09-15T22:31:11.028267+0000","last_became_active":"2024-09-15T22:30:23.527724+0000","last_became_peered":"2024-09-15T22:30:23.527724+0000","last_unstale":"2024-09-15T22:31:11.028267+0000","last_undegraded":"2024-09-15T22:31:11.028267+0000","last_fullsized":"2024-09-15T22:31:11.028267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.935247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036264+0000","last_change":"2024-09-15T22:30:21.082669+0000","last_active":"2024-09-15T22:31:11.036264+0000","last_peered":"2024-09-15T22:31:11.036264+0000","last_clean":"2024-09-15T22:31:11.036264+0000","last_became_active":"2024-09-15T22:30:21.082320+0000","last_became_peered":"2024-09-15T22:30:21.082320+0000","last_unstale":"2024-09-15T22:31:11.036264+0000","last_undegraded":"2024-09-15T22:31:11.036264+0000","last_fullsized":"2024-09-15T22:31:11.036264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:57.546498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031307+0000","last_change":"2024-09-15T22:30:23.526039+0000","last_active":"2024-09-15T22:31:11.031307+0000","last_peered":"2024-09-15T22:31:11.031307+0000","last_clean":"2024-09-15T22:31:11.031307+0000","last_became_active":"2024-09-15T22:30:23.525643+0000","last_became_peered":"2024-09-15T22:30:23.525643+0000","last_unstale":"2024-09-15T22:31:11.031307+0000","last_undegraded":"2024-09-15T22:31:11.031307+0000","last_fullsized":"2024-09-15T22:31:11.031307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:21:18.891328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.039482+0000","last_change":"2024-09-15T22:31:11.039482+0000","last_active":"2024-09-15T22:31:11.039482+0000","last_peered":"2024-09-15T22:31:11.039482+0000","last_clean":"2024-09-15T22:31:11.039482+0000","last_became_active":"2024-09-15T22:31:11.036050+0000","last_became_peered":"2024-09-15T22:31:11.036050+0000","last_unstale":"2024-09-15T22:31:11.039482+0000","last_undegraded":"2024-09-15T22:31:11.039482+0000","last_fullsized":"2024-09-15T22:31:11.039482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:19.972086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028576+0000","last_change":"2024-09-15T22:30:23.525455+0000","last_active":"2024-09-15T22:31:11.028576+0000","last_peered":"2024-09-15T22:31:11.028576+0000","last_clean":"2024-09-15T22:31:11.028576+0000","last_became_active":"2024-09-15T22:30:23.525010+0000","last_became_peered":"2024-09-15T22:30:23.525010+0000","last_unstale":"2024-09-15T22:31:11.028576+0000","last_undegraded":"2024-09-15T22:31:11.028576+0000","last_fullsized":"2024-09-15T22:31:11.028576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.783445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028823+0000","last_change":"2024-09-15T22:30:21.081906+0000","last_active":"2024-09-15T22:31:11.028823+0000","last_peered":"2024-09-15T22:31:11.028823+0000","last_clean":"2024-09-15T22:31:11.028823+0000","last_became_active":"2024-09-15T22:30:21.081508+0000","last_became_peered":"2024-09-15T22:30:21.081508+0000","last_unstale":"2024-09-15T22:31:11.028823+0000","last_undegraded":"2024-09-15T22:31:11.028823+0000","last_fullsized":"2024-09-15T22:31:11.028823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:10.781416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028397+0000","last_change":"2024-09-15T22:30:23.534015+0000","last_active":"2024-09-15T22:31:11.028397+0000","last_peered":"2024-09-15T22:31:11.028397+0000","last_clean":"2024-09-15T22:31:11.028397+0000","last_became_active":"2024-09-15T22:30:23.533273+0000","last_became_peered":"2024-09-15T22:30:23.533273+0000","last_unstale":"2024-09-15T22:31:11.028397+0000","last_undegraded":"2024-09-15T22:31:11.028397+0000","last_fullsized":"2024-09-15T22:31:11.028397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.752276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031104+0000","last_change":"2024-09-15T22:30:21.099447+0000","last_active":"2024-09-15T22:31:11.031104+0000","last_peered":"2024-09-15T22:31:11.031104+0000","last_clean":"2024-09-15T22:31:11.031104+0000","last_became_active":"2024-09-15T22:30:21.099060+0000","last_became_peered":"2024-09-15T22:30:21.099060+0000","last_unstale":"2024-09-15T22:31:11.031104+0000","last_undegraded":"2024-09-15T22:31:11.031104+0000","last_fullsized":"2024-09-15T22:31:11.031104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:28.878596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028464+0000","last_change":"2024-09-15T22:30:23.528034+0000","last_active":"2024-09-15T22:31:11.028464+0000","last_peered":"2024-09-15T22:31:11.028464+0000","last_clean":"2024-09-15T22:31:11.028464+0000","last_became_active":"2024-09-15T22:30:23.527665+0000","last_became_peered":"2024-09-15T22:30:23.527665+0000","last_unstale":"2024-09-15T22:31:11.028464+0000","last_undegraded":"2024-09-15T22:31:11.028464+0000","last_fullsized":"2024-09-15T22:31:11.028464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:34.827296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028263+0000","last_change":"2024-09-15T22:29:04.533047+0000","last_active":"2024-09-15T22:31:11.028263+0000","last_peered":"2024-09-15T22:31:11.028263+0000","last_clean":"2024-09-15T22:31:11.028263+0000","last_became_active":"2024-09-15T22:29:04.532535+0000","last_became_peered":"2024-09-15T22:29:04.532535+0000","last_unstale":"2024-09-15T22:31:11.028263+0000","last_undegraded":"2024-09-15T22:31:11.028263+0000","last_fullsized":"2024-09-15T22:31:11.028263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:25:32.270999+0000","last_clean_scrub_stamp":"2024-09-15T22:25:32.270999+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:13.428305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.186837+0000","last_change":"2024-09-15T22:30:21.080635+0000","last_active":"2024-09-15T22:31:11.186837+0000","last_peered":"2024-09-15T22:31:11.186837+0000","last_clean":"2024-09-15T22:31:11.186837+0000","last_became_active":"2024-09-15T22:30:21.080297+0000","last_became_peered":"2024-09-15T22:30:21.080297+0000","last_unstale":"2024-09-15T22:31:11.186837+0000","last_undegraded":"2024-09-15T22:31:11.186837+0000","last_fullsized":"2024-09-15T22:31:11.186837+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:37.358138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031118+0000","last_change":"2024-09-15T22:30:23.529660+0000","last_active":"2024-09-15T22:31:11.031118+0000","last_peered":"2024-09-15T22:31:11.031118+0000","last_clean":"2024-09-15T22:31:11.031118+0000","last_became_active":"2024-09-15T22:30:23.529363+0000","last_became_peered":"2024-09-15T22:30:23.529363+0000","last_unstale":"2024-09-15T22:31:11.031118+0000","last_undegraded":"2024-09-15T22:31:11.031118+0000","last_fullsized":"2024-09-15T22:31:11.031118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:20.301523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028340+0000","last_change":"2024-09-15T22:30:21.083261+0000","last_active":"2024-09-15T22:31:11.028340+0000","last_peered":"2024-09-15T22:31:11.028340+0000","last_clean":"2024-09-15T22:31:11.028340+0000","last_became_active":"2024-09-15T22:30:21.082517+0000","last_became_peered":"2024-09-15T22:30:21.082517+0000","last_unstale":"2024-09-15T22:31:11.028340+0000","last_undegraded":"2024-09-15T22:31:11.028340+0000","last_fullsized":"2024-09-15T22:31:11.028340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:32.825877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.027600+0000","last_change":"2024-09-15T22:30:23.535666+0000","last_active":"2024-09-15T22:31:11.027600+0000","last_peered":"2024-09-15T22:31:11.027600+0000","last_clean":"2024-09-15T22:31:11.027600+0000","last_became_active":"2024-09-15T22:30:23.532795+0000","last_became_peered":"2024-09-15T22:30:23.532795+0000","last_unstale":"2024-09-15T22:31:11.027600+0000","last_undegraded":"2024-09-15T22:31:11.027600+0000","last_fullsized":"2024-09-15T22:31:11.027600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:46.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:37.737358+0000","last_change":"2024-09-15T22:30:21.089614+0000","last_active":"2024-09-15T22:31:37.737358+0000","last_peered":"2024-09-15T22:31:37.737358+0000","last_clean":"2024-09-15T22:31:37.737358+0000","last_became_active":"2024-09-15T22:30:21.089252+0000","last_became_peered":"2024-09-15T22:30:21.089252+0000","last_unstale":"2024-09-15T22:31:37.737358+0000","last_undegraded":"2024-09-15T22:31:37.737358+0000","last_fullsized":"2024-09-15T22:31:37.737358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:48.491093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.037727+0000","last_change":"2024-09-15T22:31:11.037727+0000","last_active":"2024-09-15T22:31:11.037727+0000","last_peered":"2024-09-15T22:31:11.037727+0000","last_clean":"2024-09-15T22:31:11.037727+0000","last_became_active":"2024-09-15T22:31:11.037005+0000","last_became_peered":"2024-09-15T22:31:11.037005+0000","last_unstale":"2024-09-15T22:31:11.037727+0000","last_undegraded":"2024-09-15T22:31:11.037727+0000","last_fullsized":"2024-09-15T22:31:11.037727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:04.686566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028472+0000","last_change":"2024-09-15T22:30:21.084749+0000","last_active":"2024-09-15T22:31:11.028472+0000","last_peered":"2024-09-15T22:31:11.028472+0000","last_clean":"2024-09-15T22:31:11.028472+0000","last_became_active":"2024-09-15T22:30:21.083677+0000","last_became_peered":"2024-09-15T22:30:21.083677+0000","last_unstale":"2024-09-15T22:31:11.028472+0000","last_undegraded":"2024-09-15T22:31:11.028472+0000","last_fullsized":"2024-09-15T22:31:11.028472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:56.534120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031371+0000","last_change":"2024-09-15T22:30:23.525625+0000","last_active":"2024-09-15T22:31:11.031371+0000","last_peered":"2024-09-15T22:31:11.031371+0000","last_clean":"2024-09-15T22:31:11.031371+0000","last_became_active":"2024-09-15T22:30:23.525314+0000","last_became_peered":"2024-09-15T22:30:23.525314+0000","last_unstale":"2024-09-15T22:31:11.031371+0000","last_undegraded":"2024-09-15T22:31:11.031371+0000","last_fullsized":"2024-09-15T22:31:11.031371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:37.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032086+0000","last_change":"2024-09-15T22:30:21.089819+0000","last_active":"2024-09-15T22:31:11.032086+0000","last_peered":"2024-09-15T22:31:11.032086+0000","last_clean":"2024-09-15T22:31:11.032086+0000","last_became_active":"2024-09-15T22:30:21.089432+0000","last_became_peered":"2024-09-15T22:30:21.089432+0000","last_unstale":"2024-09-15T22:31:11.032086+0000","last_undegraded":"2024-09-15T22:31:11.032086+0000","last_fullsized":"2024-09-15T22:31:11.032086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:18.317959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031395+0000","last_change":"2024-09-15T22:30:23.532949+0000","last_active":"2024-09-15T22:31:11.031395+0000","last_peered":"2024-09-15T22:31:11.031395+0000","last_clean":"2024-09-15T22:31:11.031395+0000","last_became_active":"2024-09-15T22:30:23.532622+0000","last_became_peered":"2024-09-15T22:30:23.532622+0000","last_unstale":"2024-09-15T22:31:11.031395+0000","last_undegraded":"2024-09-15T22:31:11.031395+0000","last_fullsized":"2024-09-15T22:31:11.031395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:57.296048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.036238+0000","last_change":"2024-09-15T22:30:21.091151+0000","last_active":"2024-09-15T22:31:11.036238+0000","last_peered":"2024-09-15T22:31:11.036238+0000","last_clean":"2024-09-15T22:31:11.036238+0000","last_became_active":"2024-09-15T22:30:21.090776+0000","last_became_peered":"2024-09-15T22:30:21.090776+0000","last_unstale":"2024-09-15T22:31:11.036238+0000","last_undegraded":"2024-09-15T22:31:11.036238+0000","last_fullsized":"2024-09-15T22:31:11.036238+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:16.882946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028009+0000","last_change":"2024-09-15T22:30:23.522118+0000","last_active":"2024-09-15T22:31:11.028009+0000","last_peered":"2024-09-15T22:31:11.028009+0000","last_clean":"2024-09-15T22:31:11.028009+0000","last_became_active":"2024-09-15T22:30:23.521592+0000","last_became_peered":"2024-09-15T22:30:23.521592+0000","last_unstale":"2024-09-15T22:31:11.028009+0000","last_undegraded":"2024-09-15T22:31:11.028009+0000","last_fullsized":"2024-09-15T22:31:11.028009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:31.331703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.032392+0000","last_change":"2024-09-15T22:30:21.083399+0000","last_active":"2024-09-15T22:31:11.032392+0000","last_peered":"2024-09-15T22:31:11.032392+0000","last_clean":"2024-09-15T22:31:11.032392+0000","last_became_active":"2024-09-15T22:30:21.082863+0000","last_became_peered":"2024-09-15T22:30:21.082863+0000","last_unstale":"2024-09-15T22:31:11.032392+0000","last_undegraded":"2024-09-15T22:31:11.032392+0000","last_fullsized":"2024-09-15T22:31:11.032392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:39:51.895900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035419+0000","last_change":"2024-09-15T22:31:11.034224+0000","last_active":"2024-09-15T22:31:11.035419+0000","last_peered":"2024-09-15T22:31:11.035419+0000","last_clean":"2024-09-15T22:31:11.035419+0000","last_became_active":"2024-09-15T22:31:11.033850+0000","last_became_peered":"2024-09-15T22:31:11.033850+0000","last_unstale":"2024-09-15T22:31:11.035419+0000","last_undegraded":"2024-09-15T22:31:11.035419+0000","last_fullsized":"2024-09-15T22:31:11.035419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:12.420115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.187330+0000","last_change":"2024-09-15T22:30:21.099112+0000","last_active":"2024-09-15T22:31:11.187330+0000","last_peered":"2024-09-15T22:31:11.187330+0000","last_clean":"2024-09-15T22:31:11.187330+0000","last_became_active":"2024-09-15T22:30:21.098814+0000","last_became_peered":"2024-09-15T22:30:21.098814+0000","last_unstale":"2024-09-15T22:31:11.187330+0000","last_undegraded":"2024-09-15T22:31:11.187330+0000","last_fullsized":"2024-09-15T22:31:11.187330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:52.202768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283542+0000","last_change":"2024-09-15T22:30:23.540456+0000","last_active":"2024-09-15T22:31:11.283542+0000","last_peered":"2024-09-15T22:31:11.283542+0000","last_clean":"2024-09-15T22:31:11.283542+0000","last_became_active":"2024-09-15T22:30:23.538273+0000","last_became_peered":"2024-09-15T22:30:23.538273+0000","last_unstale":"2024-09-15T22:31:11.283542+0000","last_undegraded":"2024-09-15T22:31:11.283542+0000","last_fullsized":"2024-09-15T22:31:11.283542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:21.507592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034423+0000","last_change":"2024-09-15T22:30:21.088934+0000","last_active":"2024-09-15T22:31:11.034423+0000","last_peered":"2024-09-15T22:31:11.034423+0000","last_clean":"2024-09-15T22:31:11.034423+0000","last_became_active":"2024-09-15T22:30:21.088629+0000","last_became_peered":"2024-09-15T22:30:21.088629+0000","last_unstale":"2024-09-15T22:31:11.034423+0000","last_undegraded":"2024-09-15T22:31:11.034423+0000","last_fullsized":"2024-09-15T22:31:11.034423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:12.430279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035360+0000","last_change":"2024-09-15T22:30:23.523023+0000","last_active":"2024-09-15T22:31:11.035360+0000","last_peered":"2024-09-15T22:31:11.035360+0000","last_clean":"2024-09-15T22:31:11.035360+0000","last_became_active":"2024-09-15T22:30:23.522674+0000","last_became_peered":"2024-09-15T22:30:23.522674+0000","last_unstale":"2024-09-15T22:31:11.035360+0000","last_undegraded":"2024-09-15T22:31:11.035360+0000","last_fullsized":"2024-09-15T22:31:11.035360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:34.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030866+0000","last_change":"2024-09-15T22:30:21.084287+0000","last_active":"2024-09-15T22:31:11.030866+0000","last_peered":"2024-09-15T22:31:11.030866+0000","last_clean":"2024-09-15T22:31:11.030866+0000","last_became_active":"2024-09-15T22:30:21.083686+0000","last_became_peered":"2024-09-15T22:30:21.083686+0000","last_unstale":"2024-09-15T22:31:11.030866+0000","last_undegraded":"2024-09-15T22:31:11.030866+0000","last_fullsized":"2024-09-15T22:31:11.030866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:18.737268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030758+0000","last_change":"2024-09-15T22:30:23.529327+0000","last_active":"2024-09-15T22:31:11.030758+0000","last_peered":"2024-09-15T22:31:11.030758+0000","last_clean":"2024-09-15T22:31:11.030758+0000","last_became_active":"2024-09-15T22:30:23.529013+0000","last_became_peered":"2024-09-15T22:30:23.529013+0000","last_unstale":"2024-09-15T22:31:11.030758+0000","last_undegraded":"2024-09-15T22:31:11.030758+0000","last_fullsized":"2024-09-15T22:31:11.030758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:39.722197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030490+0000","last_change":"2024-09-15T22:30:21.081443+0000","last_active":"2024-09-15T22:31:11.030490+0000","last_peered":"2024-09-15T22:31:11.030490+0000","last_clean":"2024-09-15T22:31:11.030490+0000","last_became_active":"2024-09-15T22:30:21.081105+0000","last_became_peered":"2024-09-15T22:30:21.081105+0000","last_unstale":"2024-09-15T22:31:11.030490+0000","last_undegraded":"2024-09-15T22:31:11.030490+0000","last_fullsized":"2024-09-15T22:31:11.030490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:56.796153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.030971+0000","last_change":"2024-09-15T22:30:23.533866+0000","last_active":"2024-09-15T22:31:11.030971+0000","last_peered":"2024-09-15T22:31:11.030971+0000","last_clean":"2024-09-15T22:31:11.030971+0000","last_became_active":"2024-09-15T22:30:23.533541+0000","last_became_peered":"2024-09-15T22:30:23.533541+0000","last_unstale":"2024-09-15T22:31:11.030971+0000","last_undegraded":"2024-09-15T22:31:11.030971+0000","last_fullsized":"2024-09-15T22:31:11.030971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:26.923241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035954+0000","last_change":"2024-09-15T22:30:21.084794+0000","last_active":"2024-09-15T22:31:11.035954+0000","last_peered":"2024-09-15T22:31:11.035954+0000","last_clean":"2024-09-15T22:31:11.035954+0000","last_became_active":"2024-09-15T22:30:21.083415+0000","last_became_peered":"2024-09-15T22:30:21.083415+0000","last_unstale":"2024-09-15T22:31:11.035954+0000","last_undegraded":"2024-09-15T22:31:11.035954+0000","last_fullsized":"2024-09-15T22:31:11.035954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:13.689217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028245+0000","last_change":"2024-09-15T22:30:23.527870+0000","last_active":"2024-09-15T22:31:11.028245+0000","last_peered":"2024-09-15T22:31:11.028245+0000","last_clean":"2024-09-15T22:31:11.028245+0000","last_became_active":"2024-09-15T22:30:23.527529+0000","last_became_peered":"2024-09-15T22:30:23.527529+0000","last_unstale":"2024-09-15T22:31:11.028245+0000","last_undegraded":"2024-09-15T22:31:11.028245+0000","last_fullsized":"2024-09-15T22:31:11.028245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:30.086127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.028468+0000","last_change":"2024-09-15T22:30:23.528943+0000","last_active":"2024-09-15T22:31:11.028468+0000","last_peered":"2024-09-15T22:31:11.028468+0000","last_clean":"2024-09-15T22:31:11.028468+0000","last_became_active":"2024-09-15T22:30:23.528578+0000","last_became_peered":"2024-09-15T22:30:23.528578+0000","last_unstale":"2024-09-15T22:31:11.028468+0000","last_undegraded":"2024-09-15T22:31:11.028468+0000","last_fullsized":"2024-09-15T22:31:11.028468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:37.832903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.035773+0000","last_change":"2024-09-15T22:30:21.085166+0000","last_active":"2024-09-15T22:31:11.035773+0000","last_peered":"2024-09-15T22:31:11.035773+0000","last_clean":"2024-09-15T22:31:11.035773+0000","last_became_active":"2024-09-15T22:30:21.083482+0000","last_became_peered":"2024-09-15T22:30:21.083482+0000","last_unstale":"2024-09-15T22:31:11.035773+0000","last_undegraded":"2024-09-15T22:31:11.035773+0000","last_fullsized":"2024-09-15T22:31:11.035773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:47.430411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.034587+0000","last_change":"2024-09-15T22:30:23.523096+0000","last_active":"2024-09-15T22:31:11.034587+0000","last_peered":"2024-09-15T22:31:11.034587+0000","last_clean":"2024-09-15T22:31:11.034587+0000","last_became_active":"2024-09-15T22:30:23.522736+0000","last_became_peered":"2024-09-15T22:30:23.522736+0000","last_unstale":"2024-09-15T22:31:11.034587+0000","last_undegraded":"2024-09-15T22:31:11.034587+0000","last_fullsized":"2024-09-15T22:31:11.034587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:06.307576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.042273+0000","last_change":"2024-09-15T22:31:11.041784+0000","last_active":"2024-09-15T22:31:11.042273+0000","last_peered":"2024-09-15T22:31:11.042273+0000","last_clean":"2024-09-15T22:31:11.042273+0000","last_became_active":"2024-09-15T22:31:11.035691+0000","last_became_peered":"2024-09-15T22:31:11.035691+0000","last_unstale":"2024-09-15T22:31:11.042273+0000","last_undegraded":"2024-09-15T22:31:11.042273+0000","last_fullsized":"2024-09-15T22:31:11.042273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:40.558924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.283677+0000","last_change":"2024-09-15T22:30:23.533926+0000","last_active":"2024-09-15T22:31:11.283677+0000","last_peered":"2024-09-15T22:31:11.283677+0000","last_clean":"2024-09-15T22:31:11.283677+0000","last_became_active":"2024-09-15T22:30:23.533640+0000","last_became_peered":"2024-09-15T22:30:23.533640+0000","last_unstale":"2024-09-15T22:31:11.283677+0000","last_undegraded":"2024-09-15T22:31:11.283677+0000","last_fullsized":"2024-09-15T22:31:11.283677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:07.684910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031757+0000","last_change":"2024-09-15T22:30:21.090319+0000","last_active":"2024-09-15T22:31:11.031757+0000","last_peered":"2024-09-15T22:31:11.031757+0000","last_clean":"2024-09-15T22:31:11.031757+0000","last_became_active":"2024-09-15T22:30:21.089301+0000","last_became_peered":"2024-09-15T22:30:21.089301+0000","last_unstale":"2024-09-15T22:31:11.031757+0000","last_undegraded":"2024-09-15T22:31:11.031757+0000","last_fullsized":"2024-09-15T22:31:11.031757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:16.501805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.031520+0000","last_change":"2024-09-15T22:30:23.531710+0000","last_active":"2024-09-15T22:31:11.031520+0000","last_peered":"2024-09-15T22:31:11.031520+0000","last_clean":"2024-09-15T22:31:11.031520+0000","last_became_active":"2024-09-15T22:30:23.531400+0000","last_became_peered":"2024-09-15T22:30:23.531400+0000","last_unstale":"2024-09-15T22:31:11.031520+0000","last_undegraded":"2024-09-15T22:31:11.031520+0000","last_fullsized":"2024-09-15T22:31:11.031520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:22.502071+0000","last_clean_scrub_stamp":"2024-09-15T22:30:22.502071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:11.865981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T22:31:11.044526+0000","last_change":"2024-09-15T22:31:11.044526+0000","last_active":"2024-09-15T22:31:11.044526+0000","last_peered":"2024-09-15T22:31:11.044526+0000","last_clean":"2024-09-15T22:31:11.044526+0000","last_became_active":"2024-09-15T22:31:11.035686+0000","last_became_peered":"2024-09-15T22:31:11.035686+0000","last_unstale":"2024-09-15T22:31:11.044526+0000","last_undegraded":"2024-09-15T22:31:11.044526+0000","last_fullsized":"2024-09-15T22:31:11.044526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:30:20.066122+0000","last_clean_scrub_stamp":"2024-09-15T22:30:20.066122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:00.447208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":404,"num_read_kb":269,"num_write":163,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":60346,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645341,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":434022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874274,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41060,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704092,"statfs":{"total":95995035648,"available":95952990208,"internally_reserved":0,"allocated":1585152,"data_stored":1085078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005095,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":905216,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234029,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462962,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40968,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704184,"statfs":{"total":95995035648,"available":95953084416,"internally_reserved":0,"allocated":1495040,"data_stored":1024946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":892928,"data_stored":433065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855421,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1511424,"data_stored":1024819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":493659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":433376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":434208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":954368,"data_stored":492622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":913408,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:31:43.326 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:31:43.326 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:31:43.326 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:31:43.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T22:31:43.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:43 smithi022 ceph-mon[30634]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-15T22:31:43.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:43 smithi110 ceph-mon[35282]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-15T22:31:43.723 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:43.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:43 smithi112 ceph-mon[35032]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 -- 172.21.15.22:0/98440834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f010e260 msgr2=0x7fd4f0110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 --2- 172.21.15.22:0/98440834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f010e260 0x7fd4f0110650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ca0 tx=0x7fd4e802a950 comp rx=0 tx=0).stop 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 -- 172.21.15.22:0/98440834 shutdown_connections 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 --2- 172.21.15.22:0/98440834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4f0074ee0 0x7fd4f010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 --2- 172.21.15.22:0/98440834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f010e260 0x7fd4f0110650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 --2- 172.21.15.22:0/98440834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4f00745c0 0x7fd4f00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 -- 172.21.15.22:0/98440834 >> 172.21.15.22:0/98440834 conn(0x7fd4f00fd740 msgr2=0x7fd4f00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 -- 172.21.15.22:0/98440834 shutdown_connections 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.296+0000 7fd4f7000640 1 -- 172.21.15.22:0/98440834 wait complete. 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.297+0000 7fd4f7000640 1 Processor -- start 2024-09-15T22:31:44.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.297+0000 7fd4f7000640 1 -- start start 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f7000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4f00745c0 0x7fd4f019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f7000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 0x7fd4f019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f7000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4f010e260 0x7fd4f019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f7000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0113fb0 con 0x7fd4f0074ee0 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f7000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0113e30 con 0x7fd4f010e260 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f7000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0114130 con 0x7fd4f00745c0 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 0x7fd4f019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 0x7fd4f019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55826/0 (socket says 172.21.15.22:55826) 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 -- 172.21.15.22:0/1198480248 learned_addr learned my addr 172.21.15.22:0/1198480248 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5c00640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4f00745c0 0x7fd4f019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f6600640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4f010e260 0x7fd4f019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 -- 172.21.15.22:0/1198480248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4f00745c0 msgr2=0x7fd4f019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4f00745c0 0x7fd4f019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 -- 172.21.15.22:0/1198480248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4f010e260 msgr2=0x7fd4f019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4f010e260 0x7fd4f019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.298+0000 7fd4f5200640 1 -- 172.21.15.22:0/1198480248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f019f410 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.299+0000 7fd4f5200640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 0x7fd4f019a9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00e9f0 tx=0x7fd4dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.299+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00cd80 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.299+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f019f700 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.299+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4dc005500 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.299+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc010690 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.299+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f01a6fe0 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.300+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f00749a0 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.302+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd4dc0046c0 con 0x7fd4f0074ee0 2024-09-15T22:31:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.303+0000 7fd4ee000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4d80a32d0 0x7fd4d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:44.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.304+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd4dc0cfe80 con 0x7fd4f0074ee0 2024-09-15T22:31:44.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.304+0000 7fd4f5c00640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4d80a32d0 0x7fd4d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:44.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.304+0000 7fd4f5c00640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4d80a32d0 0x7fd4d80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40095f0 tx=0x7fd4e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:44.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.307+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4dc09ca00 con 0x7fd4f0074ee0 2024-09-15T22:31:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:44 smithi022 ceph-mon[30634]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.531+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4f0108e50 con 0x7fd4f0074ee0 2024-09-15T22:31:44.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.532+0000 7fd4ee000640 1 -- 172.21.15.22:0/1198480248 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd4dc09c300 con 0x7fd4f0074ee0 2024-09-15T22:31:44.533 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:44.533 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4d80a32d0 msgr2=0x7fd4d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4d80a32d0 0x7fd4d80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40095f0 tx=0x7fd4e4005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 msgr2=0x7fd4f019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 0x7fd4f019a9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00e9f0 tx=0x7fd4dc00edf0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 shutdown_connections 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4d80a32d0 0x7fd4d80a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4f010e260 0x7fd4f019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4f0074ee0 0x7fd4f019a9a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 --2- 172.21.15.22:0/1198480248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4f00745c0 0x7fd4f019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 >> 172.21.15.22:0/1198480248 conn(0x7fd4f00fd740 msgr2=0x7fd4f00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 shutdown_connections 2024-09-15T22:31:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:44.534+0000 7fd4f7000640 1 -- 172.21.15.22:0/1198480248 wait complete. 2024-09-15T22:31:44.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:44 smithi110 ceph-mon[35282]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:44.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:44 smithi112 ceph-mon[35032]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:31:45.356 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:31:45.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:31:45.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:45 smithi110 ceph-mon[35282]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:31:45.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:45 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1198480248' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:31:45.739 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:45.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:45 smithi022 ceph-mon[30634]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:31:45.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:45 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1198480248' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:31:45.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:45 smithi112 ceph-mon[35032]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:31:45.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:45 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1198480248' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 -- 172.21.15.22:0/3096346025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1478109140 msgr2=0x7f1478110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 --2- 172.21.15.22:0/3096346025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1478109140 0x7f1478110cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1470009ca0 tx=0x7f147002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 -- 172.21.15.22:0/3096346025 shutdown_connections 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 --2- 172.21.15.22:0/3096346025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14781049c0 0x7f1478108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 --2- 172.21.15.22:0/3096346025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1478109140 0x7f1478110cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 --2- 172.21.15.22:0/3096346025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1478104010 0x7f14781043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 -- 172.21.15.22:0/3096346025 >> 172.21.15.22:0/3096346025 conn(0x7f14780ffa50 msgr2=0x7f1478101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:46.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 -- 172.21.15.22:0/3096346025 shutdown_connections 2024-09-15T22:31:46.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.279+0000 7f147da00640 1 -- 172.21.15.22:0/3096346025 wait complete. 2024-09-15T22:31:46.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 Processor -- start 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 -- start start 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 0x7f147819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14781049c0 0x7f147819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1478109140 0x7f147819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14781141c0 con 0x7f14781049c0 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1478114040 con 0x7f1478109140 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.280+0000 7f147da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1478114340 con 0x7f1478104010 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 0x7f147819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 0x7f147819a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46718/0 (socket says 172.21.15.22:46718) 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14781049c0 0x7f147819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:46.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 -- 172.21.15.22:0/2773222129 learned_addr learned my addr 172.21.15.22:0/2773222129 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1477400640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1478109140 0x7f147819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 -- 172.21.15.22:0/2773222129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1478109140 msgr2=0x7f147819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1478109140 0x7f147819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 -- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14781049c0 msgr2=0x7f147819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14781049c0 0x7f147819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 -- 172.21.15.22:0/2773222129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147819f670 con 0x7f1478104010 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476000640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14781049c0 0x7f147819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.281+0000 7f1476a00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 0x7f147819a6c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f146800d950 tx=0x7f146800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.282+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468017030 con 0x7f1478104010 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.282+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147819f960 con 0x7f1478104010 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.282+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1468004020 con 0x7f1478104010 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.282+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14680047a0 con 0x7f1478104010 2024-09-15T22:31:46.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.282+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14781a7240 con 0x7f1478104010 2024-09-15T22:31:46.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.283+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14781043f0 con 0x7f1478104010 2024-09-15T22:31:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.285+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f14680041d0 con 0x7f1478104010 2024-09-15T22:31:46.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.287+0000 7f146f400640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f145c0a32d0 0x7f145c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:46.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.287+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f14680cfab0 con 0x7f1478104010 2024-09-15T22:31:46.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.287+0000 7f1476000640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f145c0a32d0 0x7f145c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:46.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.287+0000 7f1476000640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f145c0a32d0 0x7f145c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f147810ab10 tx=0x7f1464005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:46.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.289+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f146809c630 con 0x7f1478104010 2024-09-15T22:31:46.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.513+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f147810c380 con 0x7f1478104010 2024-09-15T22:31:46.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.514+0000 7f146f400640 1 -- 172.21.15.22:0/2773222129 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11920 (secure 0 0 0) 0x7f146809bf30 con 0x7f1478104010 2024-09-15T22:31:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:46.517 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-09-15T22:30:40:642902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:30:39.648360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24529,24530,24548]},"id":1}]} 2024-09-15T22:31:46.517 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f145c0a32d0 msgr2=0x7f145c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f145c0a32d0 0x7f145c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f147810ab10 tx=0x7f1464005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 msgr2=0x7f147819a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 0x7f147819a6c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f146800d950 tx=0x7f146800de10 comp rx=0 tx=0).stop 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 shutdown_connections 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f145c0a32d0 0x7f145c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1478109140 0x7f147819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14781049c0 0x7f147819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 --2- 172.21.15.22:0/2773222129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1478104010 0x7f147819a6c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:46.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 >> 172.21.15.22:0/2773222129 conn(0x7f14780ffa50 msgr2=0x7f1478100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:46.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 shutdown_connections 2024-09-15T22:31:46.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:46.518+0000 7f147da00640 1 -- 172.21.15.22:0/2773222129 wait complete. 2024-09-15T22:31:47.340 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:31:47.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:47 smithi110 ceph-mon[35282]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:47.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:47 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2773222129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:47 smithi022 ceph-mon[30634]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:47.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:47 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2773222129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:47.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:47 smithi112 ceph-mon[35032]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:47.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:47 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2773222129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 -- 172.21.15.22:0/4195751440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f41049a0 msgr2=0x7ff6f41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 --2- 172.21.15.22:0/4195751440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f41049a0 0x7ff6f41089f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009900 tx=0x7ff6dc02a410 comp rx=0 tx=0).stop 2024-09-15T22:31:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 -- 172.21.15.22:0/4195751440 shutdown_connections 2024-09-15T22:31:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 --2- 172.21.15.22:0/4195751440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4109120 0x7ff6f4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 --2- 172.21.15.22:0/4195751440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f41049a0 0x7ff6f41089f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 --2- 172.21.15.22:0/4195751440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6f4103ff0 0x7ff6f41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 -- 172.21.15.22:0/4195751440 >> 172.21.15.22:0/4195751440 conn(0x7ff6f40ffa90 msgr2=0x7ff6f4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 -- 172.21.15.22:0/4195751440 shutdown_connections 2024-09-15T22:31:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.253+0000 7ff6f9800640 1 -- 172.21.15.22:0/4195751440 wait complete. 2024-09-15T22:31:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.254+0000 7ff6f9800640 1 Processor -- start 2024-09-15T22:31:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.254+0000 7ff6f9800640 1 -- start start 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6f41049a0 0x7ff6f419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f9800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4114120 con 0x7ff6f4109120 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f9800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113fa0 con 0x7ff6f4103ff0 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f9800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41142a0 con 0x7ff6f41049a0 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55858/0 (socket says 172.21.15.22:55858) 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f3400640 1 -- 172.21.15.22:0/3396867032 learned_addr learned my addr 172.21.15.22:0/3396867032 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6ebe00640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6f41049a0 0x7ff6f419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f2a00640 1 -- 172.21.15.22:0/3396867032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6f41049a0 msgr2=0x7ff6f419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f2a00640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6f41049a0 0x7ff6f419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f2a00640 1 -- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f4109120 msgr2=0x7ff6f419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f2a00640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.255+0000 7ff6f2a00640 1 -- 172.21.15.22:0/3396867032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f419f650 con 0x7ff6f4103ff0 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.256+0000 7ff6f2a00640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a6a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400e9f0 tx=0x7ff6e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.256+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400cd80 con 0x7ff6f4103ff0 2024-09-15T22:31:48.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.256+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f419f940 con 0x7ff6f4103ff0 2024-09-15T22:31:48.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.256+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6e40035f0 con 0x7ff6f4103ff0 2024-09-15T22:31:48.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.256+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4010670 con 0x7ff6f4103ff0 2024-09-15T22:31:48.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.256+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f41a7220 con 0x7ff6f4103ff0 2024-09-15T22:31:48.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.257+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f41043d0 con 0x7ff6f4103ff0 2024-09-15T22:31:48.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.259+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff6e40037a0 con 0x7ff6f4103ff0 2024-09-15T22:31:48.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.260+0000 7ff6eb400640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff6d80a32d0 0x7ff6d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:48.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.261+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff6e40cfe50 con 0x7ff6f4103ff0 2024-09-15T22:31:48.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.261+0000 7ff6ebe00640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff6d80a32d0 0x7ff6d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:48.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.261+0000 7ff6ebe00640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff6d80a32d0 0x7ff6d80a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009230 tx=0x7ff6dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:48.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.263+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6e409ca60 con 0x7ff6f4103ff0 2024-09-15T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.485+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6f419ba00 con 0x7ff6f4103ff0 2024-09-15T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.486+0000 7ff6eb400640 1 -- 172.21.15.22:0/3396867032 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11920 (secure 0 0 0) 0x7ff6f419ba00 con 0x7ff6f4103ff0 2024-09-15T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:48.489 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-09-15T22:30:40:642902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:30:39.648360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24529,24530,24548]},"id":1}]} 2024-09-15T22:31:48.489 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:31:48.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.488+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff6d80a32d0 msgr2=0x7ff6d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:48.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff6d80a32d0 0x7ff6d80a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009230 tx=0x7ff6dc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4103ff0 msgr2=0x7ff6f419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:48.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a6a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400e9f0 tx=0x7ff6e400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 shutdown_connections 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6f41049a0 0x7ff6f419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff6d80a32d0 0x7ff6d80a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 --2- 172.21.15.22:0/3396867032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a6a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 >> 172.21.15.22:0/3396867032 conn(0x7ff6f40ffa90 msgr2=0x7ff6f4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 shutdown_connections 2024-09-15T22:31:48.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:48.489+0000 7ff6f9800640 1 -- 172.21.15.22:0/3396867032 wait complete. 2024-09-15T22:31:49.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:31:49.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:49 smithi022 ceph-mon[30634]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:49.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:49 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3396867032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:49.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:49 smithi110 ceph-mon[35282]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:49.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:49 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3396867032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:49.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:49 smithi112 ceph-mon[35032]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:49.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:49 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3396867032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:50.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 -- 172.21.15.22:0/2227015798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768112a50 msgr2=0x7f9768114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:50.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 --2- 172.21.15.22:0/2227015798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768112a50 0x7f9768114e40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9760009ca0 tx=0x7f976002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 -- 172.21.15.22:0/2227015798 shutdown_connections 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 --2- 172.21.15.22:0/2227015798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768077040 0x7f9768112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 --2- 172.21.15.22:0/2227015798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768112a50 0x7f9768114e40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 --2- 172.21.15.22:0/2227015798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768076720 0x7f9768076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 -- 172.21.15.22:0/2227015798 >> 172.21.15.22:0/2227015798 conn(0x7f97680ffa50 msgr2=0x7f9768101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 -- 172.21.15.22:0/2227015798 shutdown_connections 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.201+0000 7f976fe00640 1 -- 172.21.15.22:0/2227015798 wait complete. 2024-09-15T22:31:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.203+0000 7f976fe00640 1 Processor -- start 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.203+0000 7f976fe00640 1 -- start start 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.203+0000 7f976fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 0x7f976819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.203+0000 7f976fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768077040 0x7f976819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 0x7f97681a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976fe00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9768118600 con 0x7f9768077040 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9768118480 con 0x7f9768112a50 2024-09-15T22:31:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9768118780 con 0x7f9768076720 2024-09-15T22:31:50.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 0x7f97681a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:50.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768077040 0x7f976819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:50.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 0x7f976819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 0x7f976819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58334/0 (socket says 172.21.15.22:58334) 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 0x7f97681a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:41442/0 (socket says 172.21.15.22:41442) 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 -- 172.21.15.22:0/2822659107 learned_addr learned my addr 172.21.15.22:0/2822659107 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 -- 172.21.15.22:0/2822659107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 msgr2=0x7f97681a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 0x7f97681a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 -- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768077040 msgr2=0x7f976819f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768077040 0x7f976819f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976d400640 1 -- 172.21.15.22:0/2822659107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97681a3b90 con 0x7f9768076720 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976de00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 0x7f97681a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.204+0000 7f976ca00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768077040 0x7f976819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.205+0000 7f976d400640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 0x7f976819eb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f975c00e9f0 tx=0x7f975c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.205+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c00cd80 con 0x7f9768076720 2024-09-15T22:31:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.205+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97681a3e80 con 0x7f9768076720 2024-09-15T22:31:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.205+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f975c010910 con 0x7f9768076720 2024-09-15T22:31:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.205+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c0188f0 con 0x7f9768076720 2024-09-15T22:31:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.205+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97681ab710 con 0x7f9768076720 2024-09-15T22:31:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.206+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9768076b00 con 0x7f9768076720 2024-09-15T22:31:50.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.208+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f975c010ac0 con 0x7f9768076720 2024-09-15T22:31:50.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.210+0000 7f9766000640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f97500a32d0 0x7f97500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:50.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.210+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f975c0d0270 con 0x7f9768076720 2024-09-15T22:31:50.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.210+0000 7f976ca00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f97500a32d0 0x7f97500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:50.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.210+0000 7f976ca00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f97500a32d0 0x7f97500a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97681034b0 tx=0x7f9754005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.212+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f975c09c7a0 con 0x7f9768076720 2024-09-15T22:31:50.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.398+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97681ab910 con 0x7f9768076720 2024-09-15T22:31:50.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.399+0000 7f9766000640 1 -- 172.21.15.22:0/2822659107 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22773 (secure 0 0 0) 0x7f975c0a0aa0 con 0x7f9768076720 2024-09-15T22:31:50.401 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:50.402 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:31:11.024043+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:31:50.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f97500a32d0 msgr2=0x7f97500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f97500a32d0 0x7f97500a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97681034b0 tx=0x7f9754005f90 comp rx=0 tx=0).stop 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 msgr2=0x7f976819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 0x7f976819eb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f975c00e9f0 tx=0x7f975c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 shutdown_connections 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f97500a32d0 0x7f97500a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9768112a50 0x7f97681a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9768077040 0x7f976819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 --2- 172.21.15.22:0/2822659107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9768076720 0x7f976819eb60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 >> 172.21.15.22:0/2822659107 conn(0x7f97680ffa50 msgr2=0x7f9768101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 shutdown_connections 2024-09-15T22:31:50.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:50.402+0000 7f976fe00640 1 -- 172.21.15.22:0/2822659107 wait complete. 2024-09-15T22:31:51.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:31:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:51 smithi022 ceph-mon[30634]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:51 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2822659107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:51.639 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:51.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:51 smithi110 ceph-mon[35282]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:51.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:51 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2822659107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:51.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:51 smithi112 ceph-mon[35032]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:51.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:51 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2822659107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:31:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 -- 172.21.15.22:0/2213983525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068103e30 msgr2=0x7f6068104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 --2- 172.21.15.22:0/2213983525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068103e30 0x7f6068104210 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6058009900 tx=0x7f605802a410 comp rx=0 tx=0).stop 2024-09-15T22:31:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 -- 172.21.15.22:0/2213983525 shutdown_connections 2024-09-15T22:31:52.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 --2- 172.21.15.22:0/2213983525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f6068108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 --2- 172.21.15.22:0/2213983525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6068108f60 0x7f6068110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 --2- 172.21.15.22:0/2213983525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068103e30 0x7f6068104210 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 -- 172.21.15.22:0/2213983525 >> 172.21.15.22:0/2213983525 conn(0x7f60680ff910 msgr2=0x7f6068101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 -- 172.21.15.22:0/2213983525 shutdown_connections 2024-09-15T22:31:52.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.226+0000 7f606da00640 1 -- 172.21.15.22:0/2213983525 wait complete. 2024-09-15T22:31:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.227+0000 7f606da00640 1 Processor -- start 2024-09-15T22:31:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.227+0000 7f606da00640 1 -- start start 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6068103e30 0x7f606819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f606819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068108f60 0x7f606819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6068113fc0 con 0x7f6068108f60 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6068113e40 con 0x7f6068103e30 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6068114140 con 0x7f60681047e0 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068108f60 0x7f606819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f6067400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f606819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f6067400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f606819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58356/0 (socket says 172.21.15.22:58356) 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f6067400640 1 -- 172.21.15.22:0/972559165 learned_addr learned my addr 172.21.15.22:0/972559165 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f606d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068108f60 0x7f606819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33790/0 (socket says 172.21.15.22:33790) 2024-09-15T22:31:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.228+0000 7f6067e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6068103e30 0x7f606819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6067400640 1 -- 172.21.15.22:0/972559165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6068103e30 msgr2=0x7f606819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6067400640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6068103e30 0x7f606819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6067400640 1 -- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068108f60 msgr2=0x7f606819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6067400640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068108f60 0x7f606819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6067400640 1 -- 172.21.15.22:0/972559165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606819f440 con 0x7f60681047e0 2024-09-15T22:31:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6067400640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f606819a9d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f605400e9f0 tx=0x7f605400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605400cd80 con 0x7f60681047e0 2024-09-15T22:31:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606819f730 con 0x7f60681047e0 2024-09-15T22:31:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6054005500 con 0x7f60681047e0 2024-09-15T22:31:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054010690 con 0x7f60681047e0 2024-09-15T22:31:52.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.229+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681a7010 con 0x7f60681047e0 2024-09-15T22:31:52.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.230+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6068105310 con 0x7f60681047e0 2024-09-15T22:31:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.233+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f60540046c0 con 0x7f60681047e0 2024-09-15T22:31:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.234+0000 7f6064c00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f604c0a32d0 0x7f604c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.234+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f60540d00f0 con 0x7f60681047e0 2024-09-15T22:31:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.235+0000 7f6067e00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f604c0a32d0 0x7f604c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.235+0000 7f6067e00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f604c0a32d0 0x7f604c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6058009230 tx=0x7f60580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.236+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60540541b0 con 0x7f60681047e0 2024-09-15T22:31:52.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.458+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6068104210 con 0x7f60681047e0 2024-09-15T22:31:52.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.458+0000 7f6064c00640 1 -- 172.21.15.22:0/972559165 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11920 (secure 0 0 0) 0x7f6068104210 con 0x7f60681047e0 2024-09-15T22:31:52.461 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:31:52.461 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-09-15T22:30:40:642902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:30:39.648360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24529,24530,24548]},"id":1}]} 2024-09-15T22:31:52.461 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:31:52.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.461+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f604c0a32d0 msgr2=0x7f604c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:52.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.461+0000 7f606da00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f604c0a32d0 0x7f604c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6058009230 tx=0x7f60580058d0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.461+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 msgr2=0x7f606819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:52.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.461+0000 7f606da00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f606819a9d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f605400e9f0 tx=0x7f605400edf0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 shutdown_connections 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60681047e0 0x7f606819a9d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f604c0a32d0 0x7f604c0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6068108f60 0x7f606819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 --2- 172.21.15.22:0/972559165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6068103e30 0x7f606819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 >> 172.21.15.22:0/972559165 conn(0x7f60680ff910 msgr2=0x7f6068100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 shutdown_connections 2024-09-15T22:31:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:52.462+0000 7f606da00640 1 -- 172.21.15.22:0/972559165 wait complete. 2024-09-15T22:31:53.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:30:24.572684+0000', 'modified': '2024-09-15T22:30:39.648360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24548, 'mds_1': 24530, 'mds_2': 24529}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24499': {'gid': 24499, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/3072966464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 3072966464}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 3072966464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24511': {'gid': 24511, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6837/35956348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 35956348}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 35956348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.110:6837/1376752055', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6836', 'nonce': 1376752055}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 1376752055}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.112:6839/1853253510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 1853253510}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 1853253510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.22:6839/3141077377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 3141077377}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 3141077377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.110:6839/1046187875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6838', 'nonce': 1046187875}, {'type': 'v1', 'addr': '172.21.15.110:6839', 'nonce': 1046187875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24548, 'qdb_cluster': [24529, 24530, 24548]} 2024-09-15T22:31:53.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-15T22:31:53.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:31:53.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:53 smithi022 ceph-mon[30634]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-15T22:31:53.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:53 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/972559165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:53.577 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:53.654 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:53 smithi112 ceph-mon[35032]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-15T22:31:53.654 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:53 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/972559165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:53 smithi110 ceph-mon[35282]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-15T22:31:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:53 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/972559165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:31:54.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 -- 172.21.15.22:0/1495766744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8444109120 msgr2=0x7f8444110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 --2- 172.21.15.22:0/1495766744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8444109120 0x7f8444110ca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f843c009ca0 tx=0x7f843c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 -- 172.21.15.22:0/1495766744 shutdown_connections 2024-09-15T22:31:54.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 --2- 172.21.15.22:0/1495766744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8444109120 0x7f8444110ca0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 --2- 172.21.15.22:0/1495766744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84441049a0 0x7f84441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 --2- 172.21.15.22:0/1495766744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 0x7f84441043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 -- 172.21.15.22:0/1495766744 >> 172.21.15.22:0/1495766744 conn(0x7f84440ffa90 msgr2=0x7f8444101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:54.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 -- 172.21.15.22:0/1495766744 shutdown_connections 2024-09-15T22:31:54.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.134+0000 7f844ba00640 1 -- 172.21.15.22:0/1495766744 wait complete. 2024-09-15T22:31:54.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 Processor -- start 2024-09-15T22:31:54.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 -- start start 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 0x7f844419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 0x7f844419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8444109120 0x7f844419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8444114130 con 0x7f8444109120 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8444113fb0 con 0x7f8444103ff0 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.135+0000 7f844ba00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84441142b0 con 0x7f84441049a0 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 0x7f844419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f8449a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8444109120 0x7f844419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 0x7f844419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58374/0 (socket says 172.21.15.22:58374) 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f8449a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8444109120 0x7f844419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33808/0 (socket says 172.21.15.22:33808) 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 -- 172.21.15.22:0/4284452899 learned_addr learned my addr 172.21.15.22:0/4284452899 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f8449000640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 0x7f844419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 -- 172.21.15.22:0/4284452899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 msgr2=0x7f844419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 0x7f844419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 -- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8444109120 msgr2=0x7f844419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8444109120 0x7f844419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 -- 172.21.15.22:0/4284452899 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844419f580 con 0x7f84441049a0 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f8449000640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 0x7f844419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.136+0000 7f843be00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 0x7f844419ab10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f842c00e9f0 tx=0x7f842c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.137+0000 7f8442000640 1 -- 172.21.15.22:0/4284452899 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c00cd80 con 0x7f84441049a0 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.137+0000 7f8442000640 1 -- 172.21.15.22:0/4284452899 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f842c010910 con 0x7f84441049a0 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.137+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844419f870 con 0x7f84441049a0 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.137+0000 7f8442000640 1 -- 172.21.15.22:0/4284452899 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c018990 con 0x7f84441049a0 2024-09-15T22:31:54.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.137+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84441a7150 con 0x7f84441049a0 2024-09-15T22:31:54.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.140+0000 7f8442000640 1 -- 172.21.15.22:0/4284452899 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f842c010ac0 con 0x7f84441049a0 2024-09-15T22:31:54.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.140+0000 7f844e476740 1 Processor -- start 2024-09-15T22:31:54.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.140+0000 7f844e476740 1 -- start start 2024-09-15T22:31:54.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f844e476740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c043930710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f844e476740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c04393afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f844e476740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c04393b510 0x55c04393d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f844e476740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c0438960b0 con 0x55c04393b510 2024-09-15T22:31:54.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f844e476740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c04383dab0 con 0x55c043930c50 2024-09-15T22:31:54.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f844e476740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c043892070 con 0x55c043930330 2024-09-15T22:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f8449a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c043930710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f843be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c04393b510 0x55c04393d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f8449000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c04393afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f8449a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c043930710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58384/0 (socket says 172.21.15.22:58384) 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f8449a00640 1 -- 172.21.15.22:0/4256354836 learned_addr learned my addr 172.21.15.22:0/4256354836 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.141+0000 7f8442000640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84280a32d0 0x7f84280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8442000640 1 -- 172.21.15.22:0/4284452899 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f842c0cfe20 con 0x7f84441049a0 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449000640 1 -- 172.21.15.22:0/4256354836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 msgr2=0x55c043930710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449000640 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c043930710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449000640 1 -- 172.21.15.22:0/4256354836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c04393b510 msgr2=0x55c04393d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449000640 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c04393b510 0x55c04393d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449000640 1 -- 172.21.15.22:0/4256354836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04384a4a0 con 0x55c043930c50 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449a00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84280a32d0 0x7f84280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f8449000640 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c04393afd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f843400bc80 tx=0x7f843400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01ad000e034093e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f843a000640 1 -- 172.21.15.22:0/4256354836 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434015070 con 0x55c043930c50 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f843a000640 1 -- 172.21.15.22:0/4256354836 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f843401a940 con 0x55c043930c50 2024-09-15T22:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.142+0000 7f843a000640 1 -- 172.21.15.22:0/4256354836 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434011980 con 0x55c043930c50 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 -- 172.21.15.22:0/4256354836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 msgr2=0x55c04393afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c04393afd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f843400bc80 tx=0x7f843400f730 comp rx=0 tx=0).stop 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f8449a00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84280a32d0 0x7f84280a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f843c004af0 tx=0x7f843c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 -- 172.21.15.22:0/4256354836 shutdown_connections 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c04393b510 0x55c04393d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c04393afd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 --2- 172.21.15.22:0/4256354836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c043930710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 -- 172.21.15.22:0/4256354836 >> 172.21.15.22:0/4256354836 conn(0x55c04392c8c0 msgr2=0x55c04392cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 -- 172.21.15.22:0/4256354836 shutdown_connections 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.143+0000 7f844e476740 1 -- 172.21.15.22:0/4256354836 wait complete. 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.144+0000 7f844e476740 1 -- start start 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.144+0000 7f844e476740 1 Processor -- start 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c0439385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c043938ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c04393b510 0x55c043939020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c04393e060 con 0x55c043930c50 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c04381e920 con 0x55c04393b510 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c04393e1e0 con 0x55c043930330 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f844e476740 10 client.0 _ll_register_callbacks cb 0x55c0438428a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c0439385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c0439385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58396/0 (socket says 172.21.15.22:58396) 2024-09-15T22:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 -- 172.21.15.22:0/402277887 learned_addr learned my addr 172.21.15.22:0/402277887 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449a00640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c04393b510 0x55c043939020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f843be00640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c043938ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 -- 172.21.15.22:0/402277887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c04393b510 msgr2=0x55c043939020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c04393b510 0x55c043939020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 -- 172.21.15.22:0/402277887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 msgr2=0x55c043938ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c043938ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449000640 1 -- 172.21.15.22:0/402277887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0436072b0 con 0x55c043930330 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f8449a00640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c04393b510 0x55c043939020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.145+0000 7f843be00640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c043938ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f8449000640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c0439385a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f84340115c0 tx=0x7f843400bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfcca31f68a3bba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f8432a00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f8432a00640 1 -- 172.21.15.22:0/402277887 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434015070 con 0x55c043930330 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f8432a00640 1 -- 172.21.15.22:0/402277887 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f843401a730 con 0x55c043930330 2024-09-15T22:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f843401a940 con 0x55c043930330 2024-09-15T22:31:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f8432a00640 1 -- 172.21.15.22:0/402277887 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f843401aaf0 con 0x55c043930330 2024-09-15T22:31:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f844e476740 10 client.24907 fetch_fsmap learned FSMap version 24 2024-09-15T22:31:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c043949ea0 con 0x55c043930330 2024-09-15T22:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.146+0000 7f8432a00640 1 -- 172.21.15.22:0/402277887 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f843401a940 con 0x55c043930330 2024-09-15T22:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f8432a00640 1 -- 172.21.15.22:0/402277887 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f84340049e0 con 0x55c043930330 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f844e476740 10 client.24907 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f844e476740 10 client.24907 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f844e476740 20 client.24907 populate_metadata read hostname 'smithi022' 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f844e476740 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04394c2b0 0x55c04394d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f844e476740 4 client.24907 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 --> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0438a3620 con 0x55c04394c2b0 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.147+0000 7f843be00640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04394c2b0 0x55c04394d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.148+0000 7f843be00640 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04394c2b0 0x55c04394d720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51049f7048ee01b9 server_cookie=1e647aefb3f4ba34 in_seq=0 out_seq=0 2024-09-15T22:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.148+0000 7f8432a00640 10 client.24907 ms_handle_connect on v2:172.21.15.112:6838/1853253510 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f8432a00640 1 -- 172.21.15.22:0/402277887 <== mds.2 v2:172.21.15.112:6838/1853253510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0438a3620 con 0x55c04394c2b0 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f8432a00640 10 client.24907 handle_command_reply: tid=0 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 client.24907 shutdown 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 msgr2=0x55c0439385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c0439385a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f84340115c0 tx=0x7f843400bfa0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 shutdown_connections 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04394c2b0 0x55c04394d720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c04393b510 0x55c043939020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f8432a00640 0 client.24907 ms_handle_reset on v2:172.21.15.112:6838/1853253510 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c043938ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 --2- 172.21.15.22:0/402277887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c043930330 0x55c0439385a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 >> 172.21.15.22:0/402277887 conn(0x55c04392c8c0 msgr2=0x55c0439325a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 shutdown_connections 2024-09-15T22:31:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.149+0000 7f844e476740 1 -- 172.21.15.22:0/402277887 wait complete. 2024-09-15T22:31:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.150+0000 7f844e476740 20 client.24907 trim_cache size 0 max 16384 2024-09-15T22:31:54.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.168+0000 7f844e476740 1 Processor -- start 2024-09-15T22:31:54.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.168+0000 7f844e476740 1 -- start start 2024-09-15T22:31:54.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f844e476740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c043938af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f844e476740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 0x55c043939030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f844e476740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c043935800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f844e476740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c04394ba60 con 0x55c043930330 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f844e476740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c04394c130 con 0x55c043930c50 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f844e476740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c04394c800 con 0x55c04392c8c0 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f843be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 0x55c043939030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f8449000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c043938af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f843be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 0x55c043939030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33830/0 (socket says 172.21.15.22:33830) 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f843be00640 1 -- 172.21.15.22:0/2579820236 learned_addr learned my addr 172.21.15.22:0/2579820236 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f8449a00640 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c043935800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f8449000640 1 -- 172.21.15.22:0/2579820236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 msgr2=0x55c043935800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f8449000640 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c043935800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f8449000640 1 -- 172.21.15.22:0/2579820236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 msgr2=0x55c043939030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.169+0000 7f8449000640 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 0x55c043939030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.170+0000 7f8449000640 1 -- 172.21.15.22:0/2579820236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c043930120 con 0x55c04392c8c0 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.170+0000 7f843be00640 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 0x55c043939030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.170+0000 7f8449000640 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c043938af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8434004e30 tx=0x7f843400b5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca8494f662a451f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.170+0000 7f8439600640 1 -- 172.21.15.22:0/2579820236 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434015040 con 0x55c04392c8c0 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.170+0000 7f8439600640 1 -- 172.21.15.22:0/2579820236 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84340116a0 con 0x55c04392c8c0 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.170+0000 7f8439600640 1 -- 172.21.15.22:0/2579820236 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843401a920 con 0x55c04392c8c0 2024-09-15T22:31:54.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 -- 172.21.15.22:0/2579820236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 msgr2=0x55c043938af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c043938af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8434004e30 tx=0x7f843400b5a0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 -- 172.21.15.22:0/2579820236 shutdown_connections 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930c50 0x55c043935800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930330 0x55c043939030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 --2- 172.21.15.22:0/2579820236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c043938af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 -- 172.21.15.22:0/2579820236 >> 172.21.15.22:0/2579820236 conn(0x55c04394b680 msgr2=0x55c043936e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 -- 172.21.15.22:0/2579820236 shutdown_connections 2024-09-15T22:31:54.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 -- 172.21.15.22:0/2579820236 wait complete. 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.171+0000 7f844e476740 1 -- start start 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 Processor -- start 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c0439561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930330 0x55c04394f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c04394fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c04394d5a0 con 0x55c043930c50 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c04394ced0 con 0x55c043930330 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c04394dc70 con 0x55c04392c8c0 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f844e476740 10 client.0 _ll_register_callbacks cb 0x7f843400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.172+0000 7f8449a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c04394fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c04394fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33844/0 (socket says 172.21.15.22:33844) 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449a00640 1 -- 172.21.15.22:0/2302088389 learned_addr learned my addr 172.21.15.22:0/2302088389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c0439561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f843be00640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930330 0x55c04394f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 -- 172.21.15.22:0/2302088389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930330 msgr2=0x55c04394f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930330 0x55c04394f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 -- 172.21.15.22:0/2302088389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 msgr2=0x55c04394fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c04394fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 -- 172.21.15.22:0/2302088389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0439502b0 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8449000640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c0439561a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8434004f20 tx=0x7f843401a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5af9ea7e319be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.173+0000 7f8432a00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f8432a00640 1 -- 172.21.15.22:0/2302088389 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843403c060 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f8432a00640 1 -- 172.21.15.22:0/2302088389 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8434034040 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84340116a0 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f8432a00640 1 -- 172.21.15.22:0/2302088389 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8434015070 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 10 client.24913 fetch_fsmap learned FSMap version 24 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c0439b6a20 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f8432a00640 1 -- 172.21.15.22:0/2302088389 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84340116a0 con 0x55c04392c8c0 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f8432a00640 1 -- 172.21.15.22:0/2302088389 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8434004680 con 0x55c04392c8c0 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 10 client.24913 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 10 client.24913 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 20 client.24913 populate_metadata read hostname 'smithi022' 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04393b510 0x55c0439ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 4 client.24913 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.174+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 --> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] -- command(tid 0: {"prefix": "status"}) -- 0x55c04389db30 con 0x55c04393b510 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.175+0000 7f843be00640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04393b510 0x55c0439ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.175+0000 7f843be00640 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04393b510 0x55c0439ba000 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95344844e21a9789 server_cookie=eea844bc17d3d948 in_seq=0 out_seq=0 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.175+0000 7f8432a00640 10 client.24913 ms_handle_connect on v2:172.21.15.112:6838/1853253510 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.175+0000 7f8432a00640 1 -- 172.21.15.22:0/2302088389 <== mds.2 v2:172.21.15.112:6838/1853253510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55c04389db30 con 0x55c04393b510 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.175+0000 7f8432a00640 10 client.24913 handle_command_reply: tid=0 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.175+0000 7f844e476740 1 client.24913 shutdown 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 msgr2=0x55c0439561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c0439561a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8434004f20 tx=0x7f843401a730 comp rx=0 tx=0).stop 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 shutdown_connections 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55c04393b510 0x55c0439ba000 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c043930c50 0x55c04394fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c043930330 0x55c04394f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f8432a00640 0 client.24913 ms_handle_reset on v2:172.21.15.112:6838/1853253510 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 --2- 172.21.15.22:0/2302088389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c04392c8c0 0x55c0439561a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 >> 172.21.15.22:0/2302088389 conn(0x55c04394b680 msgr2=0x55c04392b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 shutdown_connections 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 1 -- 172.21.15.22:0/2302088389 wait complete. 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.176+0000 7f844e476740 20 client.24913 trim_cache size 0 max 16384 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24529, 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 77.540758431, 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 79, 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 114.389367393 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84280a32d0 msgr2=0x7f84280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84280a32d0 0x7f84280a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f843c004af0 tx=0x7f843c0095c0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 msgr2=0x7f844419ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 0x7f844419ab10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f842c00e9f0 tx=0x7f842c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 shutdown_connections 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84441049a0 0x7f844419ab10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f84280a32d0 0x7f84280a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8444109120 0x7f844419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 --2- 172.21.15.22:0/4284452899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8444103ff0 0x7f844419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 >> 172.21.15.22:0/4284452899 conn(0x7f84440ffa90 msgr2=0x7f8444100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 shutdown_connections 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:54.177+0000 7f844ba00640 1 -- 172.21.15.22:0/4284452899 wait complete. 2024-09-15T22:31:54.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell mds.g status 2024-09-15T22:31:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:55.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:55 smithi022 ceph-mon[30634]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:31:55.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:55 smithi110 ceph-mon[35282]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:31:55.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:55 smithi112 ceph-mon[35032]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:31:55.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 -- 172.21.15.22:0/15747029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10109140 msgr2=0x7efc10110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 --2- 172.21.15.22:0/15747029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10109140 0x7efc10110cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc08009ca0 tx=0x7efc0802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 -- 172.21.15.22:0/15747029 shutdown_connections 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 --2- 172.21.15.22:0/15747029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10109140 0x7efc10110cc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 --2- 172.21.15.22:0/15747029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 0x7efc10108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 --2- 172.21.15.22:0/15747029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10104010 0x7efc101043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 -- 172.21.15.22:0/15747029 >> 172.21.15.22:0/15747029 conn(0x7efc100ffa50 msgr2=0x7efc10101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 -- 172.21.15.22:0/15747029 shutdown_connections 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.925+0000 7efc18000640 1 -- 172.21.15.22:0/15747029 wait complete. 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.926+0000 7efc18000640 1 Processor -- start 2024-09-15T22:31:55.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.926+0000 7efc18000640 1 -- start start 2024-09-15T22:31:55.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc18000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 0x7efc1019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc18000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 0x7efc1019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc18000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10109140 0x7efc1019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc18000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc101141a0 con 0x7efc10104010 2024-09-15T22:31:55.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc18000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efc10114020 con 0x7efc101049c0 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc18000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efc10114320 con 0x7efc10109140 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc15600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 0x7efc1019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc15600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 0x7efc1019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33866/0 (socket says 172.21.15.22:33866) 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc15600640 1 -- 172.21.15.22:0/735910484 learned_addr learned my addr 172.21.15.22:0/735910484 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc16000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10109140 0x7efc1019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.927+0000 7efc14c00640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 0x7efc1019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc15600640 1 -- 172.21.15.22:0/735910484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10109140 msgr2=0x7efc1019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc15600640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10109140 0x7efc1019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc15600640 1 -- 172.21.15.22:0/735910484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 msgr2=0x7efc1019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc15600640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 0x7efc1019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc15600640 1 -- 172.21.15.22:0/735910484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1019f5d0 con 0x7efc10104010 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc14c00640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 0x7efc1019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc16000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10109140 0x7efc1019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc15600640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 0x7efc1019a620 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc0400e9f0 tx=0x7efc0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc0e000640 1 -- 172.21.15.22:0/735910484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400cd80 con 0x7efc10104010 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc0e000640 1 -- 172.21.15.22:0/735910484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc04010910 con 0x7efc10104010 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1019f8c0 con 0x7efc10104010 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc0e000640 1 -- 172.21.15.22:0/735910484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04018990 con 0x7efc10104010 2024-09-15T22:31:55.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.928+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc101a71a0 con 0x7efc10104010 2024-09-15T22:31:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.932+0000 7efc1ac06740 1 Processor -- start 2024-09-15T22:31:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.932+0000 7efc1ac06740 1 -- start start 2024-09-15T22:31:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 0x55ee834ac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc1ac06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee834120b0 con 0x55ee834ac330 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc1ac06740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ee833b9ab0 con 0x55ee834b7510 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc1ac06740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ee8340e070 con 0x55ee834acc50 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc0e000640 1 -- 172.21.15.22:0/735910484 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efc04010ac0 con 0x7efc10104010 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc16000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 0x55ee834ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc16000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 0x55ee834ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33878/0 (socket says 172.21.15.22:33878) 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc16000640 1 -- 172.21.15.22:0/1201303530 learned_addr learned my addr 172.21.15.22:0/1201303530 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc14c00640 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.933+0000 7efc15600640 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc16000640 1 -- 172.21.15.22:0/1201303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 msgr2=0x55ee834b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc16000640 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc16000640 1 -- 172.21.15.22:0/1201303530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 msgr2=0x55ee834b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc16000640 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc16000640 1 -- 172.21.15.22:0/1201303530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee833c64a0 con 0x55ee834ac330 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc16000640 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 0x55ee834ac710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efc08035000 tx=0x7efc08009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da1b440effc0fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc02600640 1 -- 172.21.15.22:0/1201303530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08031db0 con 0x55ee834ac330 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc02600640 1 -- 172.21.15.22:0/1201303530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc08036040 con 0x55ee834ac330 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc02600640 1 -- 172.21.15.22:0/1201303530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08004330 con 0x55ee834ac330 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.934+0000 7efc0e000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efbf80a32d0 0x7efbf80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc0e000640 1 -- 172.21.15.22:0/735910484 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7efc040cff50 con 0x7efc10104010 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc15600640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efbf80a32d0 0x7efbf80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc1ac06740 1 -- 172.21.15.22:0/1201303530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 msgr2=0x55ee834ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 0x55ee834ac710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efc08035000 tx=0x7efc08009800 comp rx=0 tx=0).stop 2024-09-15T22:31:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc1ac06740 1 -- 172.21.15.22:0/1201303530 shutdown_connections 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1201303530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834ac330 0x55ee834ac710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.935+0000 7efc15600640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efbf80a32d0 0x7efbf80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc0409c360 tx=0x7efc04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.936+0000 7efc1ac06740 1 -- 172.21.15.22:0/1201303530 >> 172.21.15.22:0/1201303530 conn(0x55ee834a88c0 msgr2=0x55ee834a8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.936+0000 7efc1ac06740 1 -- 172.21.15.22:0/1201303530 shutdown_connections 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.936+0000 7efc1ac06740 1 -- 172.21.15.22:0/1201303530 wait complete. 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.936+0000 7efc1ac06740 1 -- start start 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.936+0000 7efc1ac06740 1 Processor -- start 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834b7510 0x55ee834b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee834ba060 con 0x55ee834b7510 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ee8339a920 con 0x55ee834ac330 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ee834ba1e0 con 0x55ee834acc50 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc1ac06740 10 client.0 _ll_register_callbacks cb 0x55ee833be8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc16000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc16000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:41542/0 (socket says 172.21.15.22:41542) 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc16000640 1 -- 172.21.15.22:0/132401300 learned_addr learned my addr 172.21.15.22:0/132401300 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc16000640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834b7510 0x55ee834b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.937+0000 7efc14c00640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc16000640 1 -- 172.21.15.22:0/132401300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 msgr2=0x55ee834b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc16000640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc16000640 1 -- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834b7510 msgr2=0x55ee834b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc16000640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834b7510 0x55ee834b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc16000640 1 -- 172.21.15.22:0/132401300 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee831832b0 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc16000640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834b45f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc08009620 tx=0x7efc0803e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c362c60405f4885 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efbf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efbf6a00640 1 -- 172.21.15.22:0/132401300 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08059060 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc08036040 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.938+0000 7efbf6a00640 1 -- 172.21.15.22:0/132401300 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7efc08003b70 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efbf6a00640 1 -- 172.21.15.22:0/132401300 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc08003d70 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 10 client.24920 fetch_fsmap learned FSMap version 24 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee834ba060 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efbf6a00640 1 -- 172.21.15.22:0/132401300 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc08036040 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efbf6a00640 1 -- 172.21.15.22:0/132401300 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efc08004c60 con 0x55ee834ac330 2024-09-15T22:31:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 10 client.24920 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 10 client.24920 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 20 client.24920 populate_metadata read hostname 'smithi022' 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee834c7f30 0x55ee834c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 4 client.24920 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.939+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 --> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee8341f620 con 0x55ee834c7f30 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.940+0000 7efc14c00640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee834c7f30 0x55ee834c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.940+0000 7efc14c00640 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee834c7f30 0x55ee834c93a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d62d1fb1804669fd server_cookie=20b456203c33ea18 in_seq=0 out_seq=0 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.940+0000 7efbf6a00640 10 client.24920 ms_handle_connect on v2:172.21.15.22:6838/3141077377 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efbf6a00640 1 -- 172.21.15.22:0/132401300 <== mds.1 v2:172.21.15.22:6838/3141077377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee8341f620 con 0x55ee834c7f30 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efbf6a00640 10 client.24920 handle_command_reply: tid=0 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 client.24920 shutdown 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 msgr2=0x55ee834b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834b45f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc08009620 tx=0x7efc0803e040 comp rx=0 tx=0).stop 2024-09-15T22:31:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 shutdown_connections 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee834c7f30 0x55ee834c93a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834acc50 0x55ee834b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834b7510 0x55ee834b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 --2- 172.21.15.22:0/132401300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834b45f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efbf6a00640 0 client.24920 ms_handle_reset on v2:172.21.15.22:6838/3141077377 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.941+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 >> 172.21.15.22:0/132401300 conn(0x55ee834a88c0 msgr2=0x55ee834ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.942+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 shutdown_connections 2024-09-15T22:31:55.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.942+0000 7efc1ac06740 1 -- 172.21.15.22:0/132401300 wait complete. 2024-09-15T22:31:55.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.942+0000 7efc1ac06740 20 client.24920 trim_cache size 0 max 16384 2024-09-15T22:31:55.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.960+0000 7efc1ac06740 1 Processor -- start 2024-09-15T22:31:55.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.960+0000 7efc1ac06740 1 -- start start 2024-09-15T22:31:55.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834ac330 0x55ee834b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc1ac06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee834c76e0 con 0x55ee834acc50 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc1ac06740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ee834c7db0 con 0x55ee834b7510 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc1ac06740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ee834c8480 con 0x55ee834ac330 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33890/0 (socket says 172.21.15.22:33890) 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 -- 172.21.15.22:0/2935753488 learned_addr learned my addr 172.21.15.22:0/2935753488 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc16000640 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834ac330 0x55ee834b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc16000640 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 -- 172.21.15.22:0/2935753488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834ac330 msgr2=0x55ee834b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834ac330 0x55ee834b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 -- 172.21.15.22:0/2935753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 msgr2=0x55ee834b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.961+0000 7efc14c00640 1 -- 172.21.15.22:0/2935753488 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee834b6f60 con 0x55ee834acc50 2024-09-15T22:31:55.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.962+0000 7efc14c00640 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834b1850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ee834a9c40 tx=0x7efbfc00ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236e86b44ce1b3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.962+0000 7efc01c00640 1 -- 172.21.15.22:0/2935753488 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc003cc0 con 0x55ee834acc50 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.962+0000 7efc01c00640 1 -- 172.21.15.22:0/2935753488 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbfc003e60 con 0x55ee834acc50 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.962+0000 7efc01c00640 1 -- 172.21.15.22:0/2935753488 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc011440 con 0x55ee834acc50 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 -- 172.21.15.22:0/2935753488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 msgr2=0x55ee834b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834b1850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ee834a9c40 tx=0x7efbfc00ddd0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 -- 172.21.15.22:0/2935753488 shutdown_connections 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834b7510 0x55ee834b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834b1850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 --2- 172.21.15.22:0/2935753488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834ac330 0x55ee834b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 -- 172.21.15.22:0/2935753488 >> 172.21.15.22:0/2935753488 conn(0x55ee834a88c0 msgr2=0x55ee834b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 -- 172.21.15.22:0/2935753488 shutdown_connections 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.963+0000 7efc1ac06740 1 -- 172.21.15.22:0/2935753488 wait complete. 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 -- start start 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 Processor -- start 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834b7510 0x55ee834cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee834c9220 con 0x55ee834acc50 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ee834c8b50 con 0x55ee834ac330 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ee834c98f0 con 0x55ee834b7510 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc1ac06740 10 client.0 _ll_register_callbacks cb 0x7efc08031bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:31:55.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.964+0000 7efc14c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33902/0 (socket says 172.21.15.22:33902) 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 -- 172.21.15.22:0/1145449151 learned_addr learned my addr 172.21.15.22:0/1145449151 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc16000640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834b7510 0x55ee834cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc16000640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 -- 172.21.15.22:0/1145449151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834b7510 msgr2=0x55ee834cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834b7510 0x55ee834cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 -- 172.21.15.22:0/1145449151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 msgr2=0x55ee834cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 -- 172.21.15.22:0/1145449151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee834d0010 con 0x55ee834acc50 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc16000640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:55.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efc14c00640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834cbac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efbfc004bb0 tx=0x7efbfc004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90f7297061dc360 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:55.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.965+0000 7efbf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efbf6a00640 1 -- 172.21.15.22:0/1145449151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc004900 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efbf6a00640 1 -- 172.21.15.22:0/1145449151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7efbfc005000 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbfc003e60 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efbf6a00640 1 -- 172.21.15.22:0/1145449151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efbfc005200 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efc1ac06740 10 client.14898 fetch_fsmap learned FSMap version 24 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee83532b50 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efbf6a00640 1 -- 172.21.15.22:0/1145449151 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbfc003e60 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efbf6a00640 1 -- 172.21.15.22:0/1145449151 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efbfc02fb10 con 0x55ee834acc50 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.966+0000 7efc1ac06740 10 client.14898 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:31:55.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc1ac06740 10 client.14898 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc1ac06740 20 client.14898 populate_metadata read hostname 'smithi022' 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee83537370 0x55ee83536080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc1ac06740 4 client.14898 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 --> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] -- command(tid 0: {"prefix": "status"}) -- 0x55ee83419b30 con 0x55ee83537370 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc16000640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee83537370 0x55ee83536080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efc16000640 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee83537370 0x55ee83536080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab719bceb194723d server_cookie=161dd96b2ae333ea in_seq=0 out_seq=0 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.967+0000 7efbf6a00640 10 client.14898 ms_handle_connect on v2:172.21.15.22:6838/3141077377 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efbf6a00640 1 -- 172.21.15.22:0/1145449151 <== mds.1 v2:172.21.15.22:6838/3141077377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ee83419b30 con 0x55ee83537370 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efbf6a00640 10 client.14898 handle_command_reply: tid=0 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 client.14898 shutdown 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 msgr2=0x55ee834cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834cbac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efbfc004bb0 tx=0x7efbfc004300 comp rx=0 tx=0).stop 2024-09-15T22:31:55.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 shutdown_connections 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x55ee83537370 0x55ee83536080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee834b7510 0x55ee834cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efbf6a00640 0 client.14898 ms_handle_reset on v2:172.21.15.22:6838/3141077377 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee834acc50 0x55ee834cbac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 --2- 172.21.15.22:0/1145449151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ee834ac330 0x55ee834cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 >> 172.21.15.22:0/1145449151 conn(0x55ee834a88c0 msgr2=0x55ee834a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 shutdown_connections 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 1 -- 172.21.15.22:0/1145449151 wait complete. 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.968+0000 7efc1ac06740 20 client.14898 trim_cache size 0 max 16384 2024-09-15T22:31:55.974 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24530, 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 80.338766229000001, 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 79, 2024-09-15T22:31:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 112.059677424 2024-09-15T22:31:55.976 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:31:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efbf80a32d0 msgr2=0x7efbf80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efbf80a32d0 0x7efbf80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc0409c360 tx=0x7efc04000bc0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 msgr2=0x7efc1019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 0x7efc1019a620 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc0400e9f0 tx=0x7efc0400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 shutdown_connections 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc10109140 0x7efc1019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7efbf80a32d0 0x7efbf80a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc101049c0 0x7efc1019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 --2- 172.21.15.22:0/735910484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc10104010 0x7efc1019a620 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 >> 172.21.15.22:0/735910484 conn(0x7efc100ffa50 msgr2=0x7efc10100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 shutdown_connections 2024-09-15T22:31:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:55.969+0000 7efc18000640 1 -- 172.21.15.22:0/735910484 wait complete. 2024-09-15T22:31:56.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:31:57.115 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:57.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:57 smithi022 ceph-mon[30634]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 -- 172.21.15.22:0/1250264565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460076720 msgr2=0x7f4460076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 --2- 172.21.15.22:0/1250264565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460076720 0x7f4460076b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4450009900 tx=0x7f445002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 -- 172.21.15.22:0/1250264565 shutdown_connections 2024-09-15T22:31:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 --2- 172.21.15.22:0/1250264565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460112870 0x7f4460114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 --2- 172.21.15.22:0/1250264565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4460077040 0x7f4460112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 --2- 172.21.15.22:0/1250264565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460076720 0x7f4460076b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 -- 172.21.15.22:0/1250264565 >> 172.21.15.22:0/1250264565 conn(0x7f44600ff8d0 msgr2=0x7f4460101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 -- 172.21.15.22:0/1250264565 shutdown_connections 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.635+0000 7f445f200640 1 -- 172.21.15.22:0/1250264565 wait complete. 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 Processor -- start 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 -- start start 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460076720 0x7f44601a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 0x7f44601a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4460112870 0x7f446019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4460118450 con 0x7f4460077040 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f44601182d0 con 0x7f4460112870 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.636+0000 7f445f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44601185d0 con 0x7f4460076720 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 0x7f44601a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460076720 0x7f44601a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 0x7f44601a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33922/0 (socket says 172.21.15.22:33922) 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 -- 172.21.15.22:0/4149424028 learned_addr learned my addr 172.21.15.22:0/4149424028 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445e800640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4460112870 0x7f446019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 -- 172.21.15.22:0/4149424028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460076720 msgr2=0x7f44601a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460076720 0x7f44601a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 -- 172.21.15.22:0/4149424028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4460112870 msgr2=0x7f446019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4460112870 0x7f446019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445d400640 1 -- 172.21.15.22:0/4149424028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446019efb0 con 0x7f4460077040 2024-09-15T22:31:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.637+0000 7f445de00640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460076720 0x7f44601a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.638+0000 7f445d400640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 0x7f44601a4bb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f444c00d950 tx=0x7f444c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.638+0000 7f4456a00640 1 -- 172.21.15.22:0/4149424028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c017030 con 0x7f4460077040 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.638+0000 7f4456a00640 1 -- 172.21.15.22:0/4149424028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f444c004020 con 0x7f4460077040 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.638+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446019f2a0 con 0x7f4460077040 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.638+0000 7f4456a00640 1 -- 172.21.15.22:0/4149424028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c0047a0 con 0x7f4460077040 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.638+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44601ab5f0 con 0x7f4460077040 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 Processor -- start 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 -- start start 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe800e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800ee00 0x55dfe8019180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe80196c0 0x55dfe801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dfe7f740b0 con 0x55dfe80196c0 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dfe7f1bab0 con 0x55dfe800ee00 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.642+0000 7f446780a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dfe7f70070 con 0x55dfe800e4e0 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f4456a00640 1 -- 172.21.15.22:0/4149424028 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f444c0041d0 con 0x7f4460077040 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe800e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe80196c0 0x55dfe801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800ee00 0x55dfe8019180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe800e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58510/0 (socket says 172.21.15.22:58510) 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 -- 172.21.15.22:0/3540429884 learned_addr learned my addr 172.21.15.22:0/3540429884 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 -- 172.21.15.22:0/3540429884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800ee00 msgr2=0x55dfe8019180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800ee00 0x55dfe8019180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 -- 172.21.15.22:0/3540429884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe80196c0 msgr2=0x55dfe801bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe80196c0 0x55dfe801bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.643+0000 7f445e800640 1 -- 172.21.15.22:0/3540429884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe7f284a0 con 0x55dfe800e4e0 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f445e800640 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe800e8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4458009f10 tx=0x7f4458010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8a5fdc99109c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f444b000640 1 -- 172.21.15.22:0/3540429884 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458016070 con 0x55dfe800e4e0 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f444b000640 1 -- 172.21.15.22:0/3540429884 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f445801bb40 con 0x55dfe800e4e0 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f444b000640 1 -- 172.21.15.22:0/3540429884 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458012cb0 con 0x55dfe800e4e0 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f4456a00640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44440a3350 0x7f44440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f4456a00640 1 -- 172.21.15.22:0/4149424028 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f444c0cf3c0 con 0x7f4460077040 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f445de00640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44440a3350 0x7f44440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f446780a740 1 -- 172.21.15.22:0/3540429884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 msgr2=0x55dfe800e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.644+0000 7f446780a740 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe800e8c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4458009f10 tx=0x7f4458010740 comp rx=0 tx=0).stop 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 -- 172.21.15.22:0/3540429884 shutdown_connections 2024-09-15T22:31:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe80196c0 0x55dfe801bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800ee00 0x55dfe8019180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 --2- 172.21.15.22:0/3540429884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe800e8c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 -- 172.21.15.22:0/3540429884 >> 172.21.15.22:0/3540429884 conn(0x55dfe800aa70 msgr2=0x55dfe800ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 -- 172.21.15.22:0/3540429884 shutdown_connections 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 -- 172.21.15.22:0/3540429884 wait complete. 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f445de00640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44440a3350 0x7f44440a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4450000c00 tx=0x7f4450031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.645+0000 7f446780a740 1 -- start start 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 Processor -- start 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe80165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe8016af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe8017030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dfe801c330 con 0x55dfe800ee00 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dfe7efc920 con 0x55dfe80196c0 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dfe801c4b0 con 0x55dfe800e4e0 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f446780a740 10 client.0 _ll_register_callbacks cb 0x55dfe7f208a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe8016af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe8016af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33944/0 (socket says 172.21.15.22:33944) 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f445d400640 1 -- 172.21.15.22:0/3047489288 learned_addr learned my addr 172.21.15.22:0/3047489288 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.646+0000 7f445de00640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe80165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445e800640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe8017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445d400640 1 -- 172.21.15.22:0/3047489288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 msgr2=0x55dfe80165b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445d400640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe80165b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445d400640 1 -- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 msgr2=0x55dfe8017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445d400640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe8017030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445d400640 1 -- 172.21.15.22:0/3047489288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe7ce52b0 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445e800640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe8017030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f445d400640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe8016af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f444c009610 tx=0x7f444c0051f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f71d9ccb9965d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f443f400640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f443f400640 1 -- 172.21.15.22:0/3047489288 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c09b610 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f443f400640 1 -- 172.21.15.22:0/3047489288 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f444c084b90 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.647+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f445801bb40 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f443f400640 1 -- 172.21.15.22:0/3047489288 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f444c09b1a0 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 10 client.14910 fetch_fsmap learned FSMap version 24 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dfe8028040 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f443f400640 1 -- 172.21.15.22:0/3047489288 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f445801bb40 con 0x55dfe800ee00 2024-09-15T22:31:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f443f400640 1 -- 172.21.15.22:0/3047489288 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f444c09cb70 con 0x55dfe800ee00 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 10 client.14910 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 10 client.14910 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 20 client.14910 populate_metadata read hostname 'smithi022' 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe802a670 0x55dfe802bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 4 client.14910 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.648+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfe7f81620 con 0x55dfe802a670 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.649+0000 7f445de00640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe802a670 0x55dfe802bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.649+0000 7f445de00640 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe802a670 0x55dfe802bae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9191fc1dcad7b6 server_cookie=e19e50f1bb32b3df in_seq=0 out_seq=0 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.649+0000 7f443f400640 10 client.14910 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f443f400640 1 -- 172.21.15.22:0/3047489288 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfe7f81620 con 0x55dfe802a670 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f443f400640 10 client.14910 handle_command_reply: tid=0 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 client.14910 shutdown 2024-09-15T22:31:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 msgr2=0x55dfe8016af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe8016af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f444c009610 tx=0x7f444c0051f0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 shutdown_connections 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe802a670 0x55dfe802bae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe8017030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe8016af0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f443f400640 0 client.14910 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 --2- 172.21.15.22:0/3047489288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe80165b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.650+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 >> 172.21.15.22:0/3047489288 conn(0x55dfe800aa70 msgr2=0x55dfe8010750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.651+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 shutdown_connections 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.651+0000 7f446780a740 1 -- 172.21.15.22:0/3047489288 wait complete. 2024-09-15T22:31:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.651+0000 7f446780a740 20 client.14910 trim_cache size 0 max 16384 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.669+0000 7f446780a740 1 Processor -- start 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.669+0000 7f446780a740 1 -- start start 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f446780a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800e4e0 0x55dfe8010f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f446780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe800ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f446780a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe80196c0 0x55dfe8018520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f446780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dfe8029e20 con 0x55dfe800ee00 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f446780a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dfe802a4f0 con 0x55dfe800e4e0 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f446780a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dfe802abc0 con 0x55dfe80196c0 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe800ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe800ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33958/0 (socket says 172.21.15.22:33958) 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 -- 172.21.15.22:0/168226225 learned_addr learned my addr 172.21.15.22:0/168226225 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:57.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445e800640 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe80196c0 0x55dfe8018520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445de00640 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800e4e0 0x55dfe8010f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 -- 172.21.15.22:0/168226225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe80196c0 msgr2=0x55dfe8018520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe80196c0 0x55dfe8018520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 -- 172.21.15.22:0/168226225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800e4e0 msgr2=0x55dfe8010f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800e4e0 0x55dfe8010f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.670+0000 7f445d400640 1 -- 172.21.15.22:0/168226225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe8015580 con 0x55dfe800ee00 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.671+0000 7f445d400640 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe800ae50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f444c098210 tx=0x7f444c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d19a2cd67ba942e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.671+0000 7f444a600640 1 -- 172.21.15.22:0/168226225 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c09b380 con 0x55dfe800ee00 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.671+0000 7f444a600640 1 -- 172.21.15.22:0/168226225 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f444c09bf40 con 0x55dfe800ee00 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.671+0000 7f444a600640 1 -- 172.21.15.22:0/168226225 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c0a44b0 con 0x55dfe800ee00 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 -- 172.21.15.22:0/168226225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 msgr2=0x55dfe800ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe800ae50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f444c098210 tx=0x7f444c086040 comp rx=0 tx=0).stop 2024-09-15T22:31:57.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 -- 172.21.15.22:0/168226225 shutdown_connections 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe80196c0 0x55dfe8018520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe800ae50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 --2- 172.21.15.22:0/168226225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe800e4e0 0x55dfe8010f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 -- 172.21.15.22:0/168226225 >> 172.21.15.22:0/168226225 conn(0x55dfe800aa70 msgr2=0x55dfe8017e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 -- 172.21.15.22:0/168226225 shutdown_connections 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 -- 172.21.15.22:0/168226225 wait complete. 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.672+0000 7f446780a740 1 -- start start 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 Processor -- start 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe8033fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe80344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe802ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dfe802b960 con 0x55dfe800ee00 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dfe802b290 con 0x55dfe80196c0 2024-09-15T22:31:57.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dfe802c030 con 0x55dfe800e4e0 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f446780a740 10 client.0 _ll_register_callbacks cb 0x7f444c0d2b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe80344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f445de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe8033fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f445d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe80344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33970/0 (socket says 172.21.15.22:33970) 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.673+0000 7f445d400640 1 -- 172.21.15.22:0/2549436392 learned_addr learned my addr 172.21.15.22:0/2549436392 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445e800640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe802ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445de00640 1 -- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 msgr2=0x55dfe802ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445de00640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe802ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445de00640 1 -- 172.21.15.22:0/2549436392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 msgr2=0x55dfe80344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445de00640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe80344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445de00640 1 -- 172.21.15.22:0/2549436392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe802f4c0 con 0x55dfe800e4e0 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445d400640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe80344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:31:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f445de00640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe8033fa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f445002a9e0 tx=0x7f445002a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aefe737acaa8133f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f443f400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f443f400640 1 -- 172.21.15.22:0/2549436392 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450057060 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f443f400640 1 -- 172.21.15.22:0/2549436392 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f44500317b0 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.674+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f444c09bf40 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.675+0000 7f443f400640 1 -- 172.21.15.22:0/2549436392 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4450035040 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.675+0000 7f446780a740 10 client.24949 fetch_fsmap learned FSMap version 24 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.675+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dfe8095880 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.675+0000 7f443f400640 1 -- 172.21.15.22:0/2549436392 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f444c09bf40 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.675+0000 7f443f400640 1 -- 172.21.15.22:0/2549436392 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f445005c070 con 0x55dfe800e4e0 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.675+0000 7f446780a740 10 client.24949 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f446780a740 10 client.24949 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:31:57.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f446780a740 20 client.24949 populate_metadata read hostname 'smithi022' 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f446780a740 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe809a440 0x55dfe8099150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f446780a740 4 client.24949 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "status"}) -- 0x55dfe7f7bb30 con 0x55dfe809a440 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f445d400640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe809a440 0x55dfe8099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f445d400640 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe809a440 0x55dfe8099150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0e7989f060e2d33 server_cookie=8a4131bf535249c in_seq=0 out_seq=0 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.676+0000 7f443f400640 10 client.24949 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f443f400640 1 -- 172.21.15.22:0/2549436392 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55dfe7f7bb30 con 0x55dfe809a440 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f443f400640 10 client.24949 handle_command_reply: tid=0 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 client.24949 shutdown 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 msgr2=0x55dfe8033fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe8033fa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f445002a9e0 tx=0x7f445002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 shutdown_connections 2024-09-15T22:31:57.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dfe809a440 0x55dfe8099150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dfe80196c0 0x55dfe802ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f443f400640 0 client.24949 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dfe800ee00 0x55dfe80344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 --2- 172.21.15.22:0/2549436392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dfe800e4e0 0x55dfe8033fa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 >> 172.21.15.22:0/2549436392 conn(0x55dfe800aa70 msgr2=0x55dfe8009bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 shutdown_connections 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 1 -- 172.21.15.22:0/2549436392 wait complete. 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.677+0000 7f446780a740 20 client.24949 trim_cache size 0 max 16384 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:31:57.690 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24548, 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 92.155611166, 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 79, 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 107.390803371 2024-09-15T22:31:57.691 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44440a3350 msgr2=0x7f44440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44440a3350 0x7f44440a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4450000c00 tx=0x7f4450031510 comp rx=0 tx=0).stop 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 msgr2=0x7f44601a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 0x7f44601a4bb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f444c00d950 tx=0x7f444c00de10 comp rx=0 tx=0).stop 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 shutdown_connections 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44440a3350 0x7f44440a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4460112870 0x7f446019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4460077040 0x7f44601a4bb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 --2- 172.21.15.22:0/4149424028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4460076720 0x7f44601a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 >> 172.21.15.22:0/4149424028 conn(0x7f44600ff8d0 msgr2=0x7f4460101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:57.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 shutdown_connections 2024-09-15T22:31:57.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:57.678+0000 7f445f200640 1 -- 172.21.15.22:0/4149424028 wait complete. 2024-09-15T22:31:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:57 smithi110 ceph-mon[35282]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:57 smithi112 ceph-mon[35032]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:31:58.516 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T22:31:58.516 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:31:58.530 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:31:58.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T22:31:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:31:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 -- 172.21.15.22:0/2781537883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e84074b40 msgr2=0x7f9e84074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 --2- 172.21.15.22:0/2781537883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e84074b40 0x7f9e84074fa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009900 tx=0x7f9e7002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 -- 172.21.15.22:0/2781537883 shutdown_connections 2024-09-15T22:31:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 --2- 172.21.15.22:0/2781537883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e84074b40 0x7f9e84074fa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 --2- 172.21.15.22:0/2781537883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e841098b0 0x7f9e8410bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 --2- 172.21.15.22:0/2781537883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e840761a0 0x7f9e84074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 -- 172.21.15.22:0/2781537883 >> 172.21.15.22:0/2781537883 conn(0x7f9e840fd1f0 msgr2=0x7f9e840ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 -- 172.21.15.22:0/2781537883 shutdown_connections 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.513+0000 7f9e89800640 1 -- 172.21.15.22:0/2781537883 wait complete. 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.514+0000 7f9e89800640 1 Processor -- start 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.514+0000 7f9e89800640 1 -- start start 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.514+0000 7f9e89800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 0x7f9e84199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.514+0000 7f9e89800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e840761a0 0x7f9e8419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.514+0000 7f9e89800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e841098b0 0x7f9e841a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e89800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8410f8b0 con 0x7f9e84074b40 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e89800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8410f730 con 0x7f9e840761a0 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e89800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8410fa30 con 0x7f9e841098b0 2024-09-15T22:31:59.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 0x7f9e84199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e840761a0 0x7f9e8419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 0x7f9e84199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33996/0 (socket says 172.21.15.22:33996) 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 -- 172.21.15.22:0/4231073413 learned_addr learned my addr 172.21.15.22:0/4231073413 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e88e00640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e841098b0 0x7f9e841a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 -- 172.21.15.22:0/4231073413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e841098b0 msgr2=0x7f9e841a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e841098b0 0x7f9e841a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 -- 172.21.15.22:0/4231073413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e840761a0 msgr2=0x7f9e8419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e840761a0 0x7f9e8419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e83e00640 1 -- 172.21.15.22:0/4231073413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e841a1b40 con 0x7f9e84074b40 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.515+0000 7f9e88e00640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e841098b0 0x7f9e841a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.516+0000 7f9e83e00640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 0x7f9e84199f10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400ea60 tx=0x7f9e7400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.516+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400cde0 con 0x7f9e84074b40 2024-09-15T22:31:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.516+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e841a1e30 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.516+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e740035f0 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.516+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74010670 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.516+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e841a2280 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.517+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e841086c0 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.521+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9e740037a0 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.522+0000 7f9e80c00640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9e680a3300 0x7f9e680a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.523+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9e740cffa0 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.523+0000 7f9e83400640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9e680a3300 0x7f9e680a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.523+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e740541b0 con 0x7f9e84074b40 2024-09-15T22:31:59.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.524+0000 7f9e83400640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9e680a3300 0x7f9e680a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e700314e0 tx=0x7f9e70000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:31:59.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:31:59 smithi110 ceph-mon[35282]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:59.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.734+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9e84062630 con 0x7f9e680a3300 2024-09-15T22:31:59.736 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:31:59 smithi022 ceph-mon[30634]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:31:59.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.735+0000 7f9e80c00640 1 -- 172.21.15.22:0/4231073413 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9e84062630 con 0x7f9e680a3300 2024-09-15T22:31:59.737 INFO:teuthology.orchestra.run.smithi022.stdout:Backend: cephadm 2024-09-15T22:31:59.737 INFO:teuthology.orchestra.run.smithi022.stdout:Available: Yes 2024-09-15T22:31:59.737 INFO:teuthology.orchestra.run.smithi022.stdout:Paused: No 2024-09-15T22:31:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.738+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9e680a3300 msgr2=0x7f9e680a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:59.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.738+0000 7f9e89800640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9e680a3300 0x7f9e680a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e700314e0 tx=0x7f9e70000bc0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.738+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 msgr2=0x7f9e84199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.738+0000 7f9e89800640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 0x7f9e84199f10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400ea60 tx=0x7f9e7400ef20 comp rx=0 tx=0).stop 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 shutdown_connections 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e841098b0 0x7f9e841a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9e680a3300 0x7f9e680a57c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e840761a0 0x7f9e8419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 --2- 172.21.15.22:0/4231073413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e84074b40 0x7f9e84199f10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 >> 172.21.15.22:0/4231073413 conn(0x7f9e840fd1f0 msgr2=0x7f9e84105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 shutdown_connections 2024-09-15T22:31:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:31:59.739+0000 7f9e89800640 1 -- 172.21.15.22:0/4231073413 wait complete. 2024-09-15T22:31:59.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:31:59 smithi112 ceph-mon[35032]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:00.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T22:32:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:01.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 -- 172.21.15.22:0/4046216816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4078790 msgr2=0x7f66e4079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:01.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 --2- 172.21.15.22:0/4046216816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4078790 0x7f66e4079030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009ca0 tx=0x7f66dc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 -- 172.21.15.22:0/4046216816 shutdown_connections 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 --2- 172.21.15.22:0/4046216816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4078790 0x7f66e4079030 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 --2- 172.21.15.22:0/4046216816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e4078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 --2- 172.21.15.22:0/4046216816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e4076ba0 0x7f66e4076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 -- 172.21.15.22:0/4046216816 >> 172.21.15.22:0/4046216816 conn(0x7f66e40ff5b0 msgr2=0x7f66e41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 -- 172.21.15.22:0/4046216816 shutdown_connections 2024-09-15T22:32:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.519+0000 7f66e9600640 1 -- 172.21.15.22:0/4046216816 wait complete. 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.520+0000 7f66e9600640 1 Processor -- start 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.520+0000 7f66e9600640 1 -- start start 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e9600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4076ba0 0x7f66e419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e9600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e4078790 0x7f66e41a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e9600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4113ea0 con 0x7f66e4077df0 2024-09-15T22:32:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4113d20 con 0x7f66e4078790 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e9600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4114020 con 0x7f66e4076ba0 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e2000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44164/0 (socket says 172.21.15.22:44164) 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4076ba0 0x7f66e419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e2000640 1 -- 172.21.15.22:0/4084986760 learned_addr learned my addr 172.21.15.22:0/4084986760 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.521+0000 7f66e3400640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e4078790 0x7f66e41a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e2000640 1 -- 172.21.15.22:0/4084986760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4076ba0 msgr2=0x7f66e419e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e2000640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4076ba0 0x7f66e419e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e2000640 1 -- 172.21.15.22:0/4084986760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e4078790 msgr2=0x7f66e41a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e2000640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e4078790 0x7f66e41a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e2000640 1 -- 172.21.15.22:0/4084986760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e41a60a0 con 0x7f66e4077df0 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e2000640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e419e9b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66d000ea60 tx=0x7f66d000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d000cde0 con 0x7f66e4077df0 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66d00035f0 con 0x7f66e4077df0 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0010670 con 0x7f66e4077df0 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e41a6390 con 0x7f66e4077df0 2024-09-15T22:32:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.522+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e41a6880 con 0x7f66e4077df0 2024-09-15T22:32:01.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.524+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e4110780 con 0x7f66e4077df0 2024-09-15T22:32:01.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.526+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f66d00037a0 con 0x7f66e4077df0 2024-09-15T22:32:01.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.527+0000 7f66db400640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c80a3300 0x7f66c80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:01.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.528+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f66d00cfdb0 con 0x7f66e4077df0 2024-09-15T22:32:01.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.528+0000 7f66e2a00640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c80a3300 0x7f66c80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:01.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.528+0000 7f66e2a00640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c80a3300 0x7f66c80a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009bd0 tx=0x7f66d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:01.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.531+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66d00d4070 con 0x7f66e4077df0 2024-09-15T22:32:01.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:01 smithi110 ceph-mon[35282]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:01.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:01 smithi110 ceph-mon[35282]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:01.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.727+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f66e4062630 con 0x7f66c80a3300 2024-09-15T22:32:01.730 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:01 smithi022 ceph-mon[30634]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:01.730 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:01 smithi022 ceph-mon[30634]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:01.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.740+0000 7f66db400640 1 -- 172.21.15.22:0/4084986760 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f66e4062630 con 0x7f66c80a3300 2024-09-15T22:32:01.742 INFO:teuthology.orchestra.run.smithi022.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T22:32:01.742 INFO:teuthology.orchestra.run.smithi022.stdout:mds.a smithi022 running (114s) 24s ago 113s 12.5M - 19.1.1-326-g8921c8ef f1455bd0219c 307c115a66f9 2024-09-15T22:32:01.742 INFO:teuthology.orchestra.run.smithi022.stdout:mds.b smithi110 running (111s) 42s ago 111s 26.1M - 19.1.1-326-g8921c8ef f1455bd0219c 1f0fd074b643 2024-09-15T22:32:01.742 INFO:teuthology.orchestra.run.smithi022.stdout:mds.c smithi112 running (2m) 42s ago 2m 18.2M - 19.1.1-326-g8921c8ef f1455bd0219c 67c230ee291f 2024-09-15T22:32:01.742 INFO:teuthology.orchestra.run.smithi022.stdout:mds.d smithi022 running (2m) 24s ago 2m 12.8M - 19.1.1-326-g8921c8ef f1455bd0219c 8dbe2c9d89c7 2024-09-15T22:32:01.742 INFO:teuthology.orchestra.run.smithi022.stdout:mds.e smithi110 running (2m) 42s ago 2m 15.9M - 19.1.1-326-g8921c8ef f1455bd0219c e2bd7e7410f4 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.f smithi112 running (2m) 42s ago 2m 18.2M - 19.1.1-326-g8921c8ef f1455bd0219c e522e7479ea1 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.g smithi022 running (118s) 24s ago 117s 16.4M - 19.1.1-326-g8921c8ef f1455bd0219c a54f31e5ed85 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.h smithi110 running (2m) 42s ago 2m 16.6M - 19.1.1-326-g8921c8ef f1455bd0219c 1bc68a7f2753 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.i smithi112 running (2m) 42s ago 2m 20.3M - 19.1.1-326-g8921c8ef f1455bd0219c d36cb64cf7c9 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.j smithi022 running (2m) 24s ago 2m 12.8M - 19.1.1-326-g8921c8ef f1455bd0219c c683a778b962 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.k smithi110 running (2m) 42s ago 2m 13.4M - 19.1.1-326-g8921c8ef f1455bd0219c 09b3a543e7f8 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mds.l smithi112 running (2m) 42s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c 5dce3efe8ece 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.x smithi022 *:9283,8765 running (9m) 24s ago 9m 508M - 19.1.1-326-g8921c8ef f1455bd0219c ec0bebdab7b3 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.y smithi110 *:8443,8765 running (7m) 42s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c b8ab4bbf1cf1 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.z smithi112 *:8443,8765 running (7m) 42s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c cef4b2736c69 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a smithi022 running (9m) 24s ago 9m 47.3M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 71f0c89bb81b 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b smithi110 running (8m) 42s ago 8m 40.3M 2048M 19.1.1-326-g8921c8ef f1455bd0219c c31de8c6da4b 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c smithi112 running (8m) 42s ago 8m 43.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 28db664a0ea5 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 smithi022 running (7m) 24s ago 7m 52.9M 4273M 19.1.1-326-g8921c8ef f1455bd0219c ce1fb3cc05dd 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 smithi110 running (7m) 42s ago 7m 55.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d253685afb6d 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 smithi112 running (6m) 42s ago 6m 56.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c fc19aa63b451 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 smithi022 running (6m) 24s ago 6m 51.9M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 8b6df4948707 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 smithi110 running (5m) 42s ago 5m 46.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c a9f24a845bbe 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 smithi112 running (5m) 42s ago 5m 58.8M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 3e508f64dec8 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 smithi022 running (4m) 24s ago 4m 49.0M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 51fc203608bb 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 smithi110 running (4m) 42s ago 4m 50.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 960bf3975371 2024-09-15T22:32:01.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 smithi112 running (4m) 42s ago 4m 53.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c c6407a3e18ab 2024-09-15T22:32:01.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 smithi022 running (3m) 24s ago 3m 48.8M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 5e3109b37640 2024-09-15T22:32:01.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 smithi110 running (3m) 42s ago 3m 52.0M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 5935f7db1305 2024-09-15T22:32:01.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 smithi112 running (2m) 42s ago 2m 49.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 6703856985a5 2024-09-15T22:32:01.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c80a3300 msgr2=0x7f66c80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c80a3300 0x7f66c80a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009bd0 tx=0x7f66d4005f90 comp rx=0 tx=0).stop 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 msgr2=0x7f66e419e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e419e9b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66d000ea60 tx=0x7f66d000ef20 comp rx=0 tx=0).stop 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 shutdown_connections 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f66c80a3300 0x7f66c80a57c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e4078790 0x7f66e41a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66e4077df0 0x7f66e419e9b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 --2- 172.21.15.22:0/4084986760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e4076ba0 0x7f66e419e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 >> 172.21.15.22:0/4084986760 conn(0x7f66e40ff5b0 msgr2=0x7f66e4101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 shutdown_connections 2024-09-15T22:32:01.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:01.742+0000 7f66e9600640 1 -- 172.21.15.22:0/4084986760 wait complete. 2024-09-15T22:32:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:01 smithi112 ceph-mon[35032]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:01 smithi112 ceph-mon[35032]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:02.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T22:32:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:03.487 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:03 smithi022 ceph-mon[30634]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-15T22:32:03.487 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:03 smithi022 ceph-mon[30634]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:03.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 -- 172.21.15.22:0/3073864763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 msgr2=0x7fd160102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 --2- 172.21.15.22:0/3073864763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160102000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd150009900 tx=0x7fd15002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 -- 172.21.15.22:0/3073864763 shutdown_connections 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 --2- 172.21.15.22:0/3073864763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd160102e00 0x7fd160103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 --2- 172.21.15.22:0/3073864763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1601037c0 0x7fd16010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 --2- 172.21.15.22:0/3073864763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160102000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 -- 172.21.15.22:0/3073864763 >> 172.21.15.22:0/3073864763 conn(0x7fd1600fd390 msgr2=0x7fd1600ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 -- 172.21.15.22:0/3073864763 shutdown_connections 2024-09-15T22:32:03.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.601+0000 7fd164a00640 1 -- 172.21.15.22:0/3073864763 wait complete. 2024-09-15T22:32:03.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.602+0000 7fd164a00640 1 Processor -- start 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 -- start start 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd160102e00 0x7fd1600745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1601037c0 0x7fd160074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd16010d8d0 con 0x7fd160101c00 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd16010d750 con 0x7fd1601037c0 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd164a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd16010da50 con 0x7fd160102e00 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd15de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd15de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44188/0 (socket says 172.21.15.22:44188) 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd15de00640 1 -- 172.21.15.22:0/2880499699 learned_addr learned my addr 172.21.15.22:0/2880499699 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:03.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd157e00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd160102e00 0x7fd1600745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.603+0000 7fd15e800640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1601037c0 0x7fd160074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd15de00640 1 -- 172.21.15.22:0/2880499699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd160102e00 msgr2=0x7fd1600745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd15de00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd160102e00 0x7fd1600745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd15de00640 1 -- 172.21.15.22:0/2880499699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1601037c0 msgr2=0x7fd160074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd15de00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1601037c0 0x7fd160074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd15de00640 1 -- 172.21.15.22:0/2880499699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600753e0 con 0x7fd160101c00 2024-09-15T22:32:03.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd15de00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160075f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd150031440 tx=0x7fd150032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:03.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15003f030 con 0x7fd160101c00 2024-09-15T22:32:03.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.604+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd150003ce0 con 0x7fd160101c00 2024-09-15T22:32:03.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.605+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1601a2040 con 0x7fd160101c00 2024-09-15T22:32:03.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.605+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150035070 con 0x7fd160101c00 2024-09-15T22:32:03.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.605+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1601a24f0 con 0x7fd160101c00 2024-09-15T22:32:03.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.606+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd160108fa0 con 0x7fd160101c00 2024-09-15T22:32:03.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.608+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd150042030 con 0x7fd160101c00 2024-09-15T22:32:03.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.609+0000 7fd156a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1440a32d0 0x7fd1440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:03.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.609+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd1500eff30 con 0x7fd160101c00 2024-09-15T22:32:03.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.609+0000 7fd157e00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1440a32d0 0x7fd1440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:03.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.610+0000 7fd157e00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1440a32d0 0x7fd1440a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd160075d10 tx=0x7fd148005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:03.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.613+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1500bc460 con 0x7fd160101c00 2024-09-15T22:32:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:03 smithi110 ceph-mon[35282]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-15T22:32:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:03 smithi110 ceph-mon[35282]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:03.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.808+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd160062630 con 0x7fd1440a32d0 2024-09-15T22:32:03.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.814+0000 7fd156a00640 1 -- 172.21.15.22:0/2880499699 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd160062630 con 0x7fd1440a32d0 2024-09-15T22:32:03.816 INFO:teuthology.orchestra.run.smithi022.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T22:32:03.816 INFO:teuthology.orchestra.run.smithi022.stdout:mds.all 12/12 44s ago 2m smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi110=b;smithi110=e;smithi110=h;smithi110=k;smithi112=c;smithi112=f;smithi112=i;smithi112=l;count:12 2024-09-15T22:32:03.816 INFO:teuthology.orchestra.run.smithi022.stdout:mgr 3/3 44s ago 7m smithi022=x;smithi110=y;smithi112=z;count:3 2024-09-15T22:32:03.816 INFO:teuthology.orchestra.run.smithi022.stdout:mon 3/3 44s ago 8m smithi022:172.21.15.22=a;smithi110:172.21.15.110=b;smithi112:172.21.15.112=c;count:3 2024-09-15T22:32:03.816 INFO:teuthology.orchestra.run.smithi022.stdout:osd 12 44s ago - 2024-09-15T22:32:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1440a32d0 msgr2=0x7fd1440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1440a32d0 0x7fd1440a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd160075d10 tx=0x7fd148005f90 comp rx=0 tx=0).stop 2024-09-15T22:32:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 msgr2=0x7fd160075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160075f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd150031440 tx=0x7fd150032ce0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 shutdown_connections 2024-09-15T22:32:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd160102e00 0x7fd1600745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd1440a32d0 0x7fd1440a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1601037c0 0x7fd160074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 --2- 172.21.15.22:0/2880499699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd160101c00 0x7fd160075f90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:03.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 >> 172.21.15.22:0/2880499699 conn(0x7fd1600fd390 msgr2=0x7fd160106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:03.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 shutdown_connections 2024-09-15T22:32:03.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:03.816+0000 7fd164a00640 1 -- 172.21.15.22:0/2880499699 wait complete. 2024-09-15T22:32:03.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:03 smithi112 ceph-mon[35032]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-15T22:32:03.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:03 smithi112 ceph-mon[35032]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:04.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T22:32:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:05 smithi022 ceph-mon[30634]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:32:05.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:05 smithi022 ceph-mon[30634]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:05.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 -- 172.21.15.22:0/1313704022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a1010e1e0 msgr2=0x7f6a101105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:05.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 --2- 172.21.15.22:0/1313704022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a1010e1e0 0x7f6a101105d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009ca0 tx=0x7f6a0802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 -- 172.21.15.22:0/1313704022 shutdown_connections 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 --2- 172.21.15.22:0/1313704022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a1010e1e0 0x7f6a101105d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 --2- 172.21.15.22:0/1313704022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a100750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 --2- 172.21.15.22:0/1313704022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a10076220 0x7f6a10074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 -- 172.21.15.22:0/1313704022 >> 172.21.15.22:0/1313704022 conn(0x7f6a100fd390 msgr2=0x7f6a100ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.662+0000 7f6a15000640 1 -- 172.21.15.22:0/1313704022 shutdown_connections 2024-09-15T22:32:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.663+0000 7f6a15000640 1 -- 172.21.15.22:0/1313704022 wait complete. 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.663+0000 7f6a15000640 1 Processor -- start 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 -- start start 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a1019e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 0x7f6a1019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1010e1e0 0x7f6a101a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10113ea0 con 0x7f6a10076220 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10113d20 con 0x7f6a10074c50 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a15000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10114020 con 0x7f6a1010e1e0 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a0de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a1019e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:05.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 0x7f6a1019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a0de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a1019e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:54372/0 (socket says 172.21.15.22:54372) 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a0de00640 1 -- 172.21.15.22:0/646414858 learned_addr learned my addr 172.21.15.22:0/646414858 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 0x7f6a1019e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44212/0 (socket says 172.21.15.22:44212) 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.664+0000 7f6a0e800640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1010e1e0 0x7f6a101a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0de00640 1 -- 172.21.15.22:0/646414858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1010e1e0 msgr2=0x7f6a101a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0de00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1010e1e0 0x7f6a101a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0de00640 1 -- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 msgr2=0x7f6a1019e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0de00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 0x7f6a1019e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0de00640 1 -- 172.21.15.22:0/646414858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a101a60a0 con 0x7f6a10074c50 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0e800640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1010e1e0 0x7f6a101a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a07e00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 0x7f6a1019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:05.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a0de00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a1019e470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000e9f0 tx=0x7f6a0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:05.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000ccc0 con 0x7f6a10074c50 2024-09-15T22:32:05.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a101a6390 con 0x7f6a10074c50 2024-09-15T22:32:05.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a00005500 con 0x7f6a10074c50 2024-09-15T22:32:05.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00010690 con 0x7f6a10074c50 2024-09-15T22:32:05.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.665+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a101a68d0 con 0x7f6a10074c50 2024-09-15T22:32:05.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.666+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10104290 con 0x7f6a10074c50 2024-09-15T22:32:05.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.668+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6a000046c0 con 0x7f6a10074c50 2024-09-15T22:32:05.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.669+0000 7f6a06a00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f69f40a3300 0x7f69f40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:05.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.670+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f6a000cfec0 con 0x7f6a10074c50 2024-09-15T22:32:05.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.670+0000 7f6a07e00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f69f40a3300 0x7f69f40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:05.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.670+0000 7f6a07e00640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f69f40a3300 0x7f69f40a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a1019f990 tx=0x7f69f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:05.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.673+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a0009ca40 con 0x7f6a10074c50 2024-09-15T22:32:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:05 smithi110 ceph-mon[35282]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:32:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:05 smithi110 ceph-mon[35282]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:05.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:05 smithi112 ceph-mon[35032]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-15T22:32:05.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:05 smithi112 ceph-mon[35032]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:05.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.863+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6a10062630 con 0x7f69f40a3300 2024-09-15T22:32:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.865+0000 7f6a06a00640 1 -- 172.21.15.22:0/646414858 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6a10062630 con 0x7f69f40a3300 2024-09-15T22:32:05.866 INFO:teuthology.orchestra.run.smithi022.stdout:HOST ADDR LABELS STATUS 2024-09-15T22:32:05.866 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 172.21.15.22 2024-09-15T22:32:05.867 INFO:teuthology.orchestra.run.smithi022.stdout:smithi110 172.21.15.110 2024-09-15T22:32:05.867 INFO:teuthology.orchestra.run.smithi022.stdout:smithi112 172.21.15.112 2024-09-15T22:32:05.867 INFO:teuthology.orchestra.run.smithi022.stdout:3 hosts in cluster 2024-09-15T22:32:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f69f40a3300 msgr2=0x7f69f40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f69f40a3300 0x7f69f40a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a1019f990 tx=0x7f69f8005f90 comp rx=0 tx=0).stop 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 msgr2=0x7f6a1019e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a1019e470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000e9f0 tx=0x7f6a0000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 shutdown_connections 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a1010e1e0 0x7f6a101a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f69f40a3300 0x7f69f40a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10076220 0x7f6a1019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 --2- 172.21.15.22:0/646414858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a10074c50 0x7f6a1019e470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.867+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 >> 172.21.15.22:0/646414858 conn(0x7f6a100fd390 msgr2=0x7f6a10101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.868+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 shutdown_connections 2024-09-15T22:32:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:05.868+0000 7f6a15000640 1 -- 172.21.15.22:0/646414858 wait complete. 2024-09-15T22:32:06.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T22:32:07.038 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:07.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:07 smithi022 ceph-mon[30634]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:07.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:07 smithi022 ceph-mon[30634]: from='client.24965 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:07.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 -- 172.21.15.22:0/528069179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798076220 msgr2=0x7f8798074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:07.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 --2- 172.21.15.22:0/528069179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798076220 0x7f8798074680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8788009900 tx=0x7f878802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 -- 172.21.15.22:0/528069179 shutdown_connections 2024-09-15T22:32:07.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 --2- 172.21.15.22:0/528069179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8798109a80 0x7f879810bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 --2- 172.21.15.22:0/528069179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798074c50 0x7f87980750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 --2- 172.21.15.22:0/528069179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798076220 0x7f8798074680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 -- 172.21.15.22:0/528069179 >> 172.21.15.22:0/528069179 conn(0x7f87980fd390 msgr2=0x7f87980ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:07.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 -- 172.21.15.22:0/528069179 shutdown_connections 2024-09-15T22:32:07.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.630+0000 7f879d400640 1 -- 172.21.15.22:0/528069179 wait complete. 2024-09-15T22:32:07.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 Processor -- start 2024-09-15T22:32:07.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 -- start start 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8798074c50 0x7f879819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 0x7f879819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798109a80 0x7f87981a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f879810fad0 con 0x7f8798109a80 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f879810f950 con 0x7f8798076220 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.631+0000 7f879d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f879810fc50 con 0x7f8798074c50 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 0x7f879819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 0x7f879819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:54396/0 (socket says 172.21.15.22:54396) 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f8796800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8798074c50 0x7f879819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 -- 172.21.15.22:0/1253074862 learned_addr learned my addr 172.21.15.22:0/1253074862 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f8797200640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798109a80 0x7f87981a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:07.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 -- 172.21.15.22:0/1253074862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8798074c50 msgr2=0x7f879819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8798074c50 0x7f879819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 -- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798109a80 msgr2=0x7f87981a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798109a80 0x7f87981a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 -- 172.21.15.22:0/1253074862 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87981a1d00 con 0x7f8798076220 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f8797200640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798109a80 0x7f87981a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.632+0000 7f878fe00640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 0x7f879819a610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f878000e9f0 tx=0x7f878000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.633+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878000cd80 con 0x7f8798076220 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.633+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8780010910 con 0x7f8798076220 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.633+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87981a1ff0 con 0x7f8798076220 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.633+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780018990 con 0x7f8798076220 2024-09-15T22:32:07.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.633+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87981a24a0 con 0x7f8798076220 2024-09-15T22:32:07.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.634+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8798108800 con 0x7f8798076220 2024-09-15T22:32:07.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.637+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8780010ac0 con 0x7f8798076220 2024-09-15T22:32:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.638+0000 7f878f400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f877c0a3300 0x7f877c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.638+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f87800d0220 con 0x7f8798076220 2024-09-15T22:32:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.638+0000 7f8796800640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f877c0a3300 0x7f877c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.639+0000 7f8796800640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f877c0a3300 0x7f877c0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f878802a9e0 tx=0x7f87880315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.639+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f878009cda0 con 0x7f8798076220 2024-09-15T22:32:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:07 smithi110 ceph-mon[35282]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:07 smithi110 ceph-mon[35282]: from='client.24965 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:07.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.837+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8798062630 con 0x7f877c0a3300 2024-09-15T22:32:07.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.838+0000 7f878f400640 1 -- 172.21.15.22:0/1253074862 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8798062630 con 0x7f877c0a3300 2024-09-15T22:32:07.841 INFO:teuthology.orchestra.run.smithi022.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T22:32:07.841 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:32:07.841 INFO:teuthology.orchestra.run.smithi022.stdout:smithi110 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002T480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:32:07.841 INFO:teuthology.orchestra.run.smithi022.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T22:32:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f877c0a3300 msgr2=0x7f877c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f877c0a3300 0x7f877c0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f878802a9e0 tx=0x7f87880315b0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 msgr2=0x7f879819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 0x7f879819a610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f878000e9f0 tx=0x7f878000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 shutdown_connections 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f877c0a3300 0x7f877c0a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8798109a80 0x7f87981a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8798076220 0x7f879819a610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 --2- 172.21.15.22:0/1253074862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8798074c50 0x7f879819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 >> 172.21.15.22:0/1253074862 conn(0x7f87980fd390 msgr2=0x7f87981059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 shutdown_connections 2024-09-15T22:32:07.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:07.841+0000 7f879d400640 1 -- 172.21.15.22:0/1253074862 wait complete. 2024-09-15T22:32:07.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:07 smithi112 ceph-mon[35032]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:07.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:07 smithi112 ceph-mon[35032]: from='client.24965 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:08.653 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:32:08.662 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:32:08.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T22:32:09.041 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:09.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:09 smithi022 ceph-mon[30634]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:09.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:09 smithi022 ceph-mon[30634]: from='client.24971 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:09.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 -- 172.21.15.22:0/2590549317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 msgr2=0x7f1ce01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:09.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 --2- 172.21.15.22:0/2590549317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce01030c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009900 tx=0x7f1ccc02a410 comp rx=0 tx=0).stop 2024-09-15T22:32:09.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 -- 172.21.15.22:0/2590549317 shutdown_connections 2024-09-15T22:32:09.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 --2- 172.21.15.22:0/2590549317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 0x7f1ce0109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 --2- 172.21.15.22:0/2590549317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce01030c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 --2- 172.21.15.22:0/2590549317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 -- 172.21.15.22:0/2590549317 >> 172.21.15.22:0/2590549317 conn(0x7f1ce00fd1f0 msgr2=0x7f1ce00ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:09.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 -- 172.21.15.22:0/2590549317 shutdown_connections 2024-09-15T22:32:09.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.662+0000 7f1ce5400640 1 -- 172.21.15.22:0/2590549317 wait complete. 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 Processor -- start 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 -- start start 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 0x7f1ce01a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce010d710 con 0x7f1ce0102c40 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce010d590 con 0x7f1ce0101a40 2024-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.663+0000 7f1ce5400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce010d890 con 0x7f1ce0103600 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdf400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdf400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44262/0 (socket says 172.21.15.22:44262) 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:54414/0 (socket says 172.21.15.22:54414) 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdf400640 1 -- 172.21.15.22:0/1670431001 learned_addr learned my addr 172.21.15.22:0/1670431001 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1ce4a00640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 0x7f1ce01a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 -- 172.21.15.22:0/1670431001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 msgr2=0x7f1ce01a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 0x7f1ce01a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 -- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 msgr2=0x7f1ce019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1cdfe00640 1 -- 172.21.15.22:0/1670431001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce01a1b80 con 0x7f1ce0101a40 2024-09-15T22:32:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.664+0000 7f1ce4a00640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 0x7f1ce01a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.665+0000 7f1cdfe00640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0199f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000e9c0 tx=0x7f1cd000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.665+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000ccc0 con 0x7f1ce0101a40 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.665+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd00035f0 con 0x7f1ce0101a40 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.665+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce01a1e70 con 0x7f1ce0101a40 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.665+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000ce60 con 0x7f1ce0101a40 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.665+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce01a22c0 con 0x7f1ce0101a40 2024-09-15T22:32:09.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.666+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce01a2550 con 0x7f1ce0101a40 2024-09-15T22:32:09.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.668+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1cd00037a0 con 0x7f1ce0101a40 2024-09-15T22:32:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.669+0000 7f1cdcc00640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1cc40a3300 0x7f1cc40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.670+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1cd00d0120 con 0x7f1ce0101a40 2024-09-15T22:32:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.670+0000 7f1cdf400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1cc40a3300 0x7f1cc40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.670+0000 7f1cdf400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1cc40a3300 0x7f1cc40a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ce019b470 tx=0x7f1ccc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:09.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.671+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1cd009cca0 con 0x7f1ce0101a40 2024-09-15T22:32:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:09 smithi110 ceph-mon[35282]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:09 smithi110 ceph-mon[35282]: from='client.24971 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:09.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:09 smithi112 ceph-mon[35032]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:09.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:09 smithi112 ceph-mon[35032]: from='client.24971 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.895+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1ce01a2920 con 0x7f1ce0101a40 2024-09-15T22:32:09.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.896+0000 7f1cdcc00640 1 -- 172.21.15.22:0/1670431001 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3093 (secure 0 0 0) 0x7f1cd009c5a0 con 0x7f1ce0101a40 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:e24 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:btime 2024-09-15T22:30:40:642902+0000 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:legacy client fscid: 1 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:Filesystem 'cephfs' (1) 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:fs_name cephfs 2024-09-15T22:32:09.898 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 24 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-15T22:30:24.572684+0000 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-15T22:30:39.648360+0000 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:tableserver 0 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:root 0 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:session_timeout 300 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:session_autoclose 300 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:max_file_size 1099511627776 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:max_xattr_size 65536 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:required_client_features {} 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure 0 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure_osd_epoch 0 2024-09-15T22:32:09.899 INFO:teuthology.orchestra.run.smithi022.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:max_mds 3 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:in 0,1,2 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:up {0=24548,1=24530,2=24529} 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:failed 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:damaged 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:stopped 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:data_pools [3] 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:metadata_pool 2 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:inline_data disabled 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:balancer 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:bal_rank_mask -1 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:standby_count_wanted 0 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:qdb_cluster leader: 24548 members: 24529,24530,24548 2024-09-15T22:32:09.900 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b{0:24548} state up:active seq 5 addr [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.h{0:24512} state up:standby-replay seq 1 addr [v2:172.21.15.110:6836/1376752055,v1:172.21.15.110:6837/1376752055] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.g{1:24530} state up:active seq 9 addr [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c{1:24511} state up:standby-replay seq 1 addr [v2:172.21.15.112:6836/35956348,v1:172.21.15.112:6837/35956348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.i{2:24529} state up:active seq 11 addr [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f{2:24499} state up:standby-replay seq 1 addr [v2:172.21.15.112:6834/3072966464,v1:172.21.15.112:6835/3072966464] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:Standby daemons: 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.j{-1:14454} state up:standby seq 1 addr [v2:172.21.15.22:6834/2103622454,v1:172.21.15.22:6835/2103622454] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d{-1:14466} state up:standby seq 1 addr [v2:172.21.15.22:6836/3608871420,v1:172.21.15.22:6837/3608871420] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a{-1:14517} state up:standby seq 1 addr [v2:172.21.15.22:6840/2894630573,v1:172.21.15.22:6841/2894630573] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.901 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.k{-1:24449} state up:standby seq 1 addr [v2:172.21.15.110:6832/1172139023,v1:172.21.15.110:6833/1172139023] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.902 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.l{-1:24463} state up:standby seq 1 addr [v2:172.21.15.112:6832/4122441633,v1:172.21.15.112:6833/4122441633] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.902 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e{-1:24485} state up:standby seq 1 addr [v2:172.21.15.110:6834/4194953231,v1:172.21.15.110:6835/4194953231] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:32:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:32:09.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1cc40a3300 msgr2=0x7f1cc40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1cc40a3300 0x7f1cc40a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ce019b470 tx=0x7f1ccc0315b0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 msgr2=0x7f1ce0199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0199f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000e9c0 tx=0x7f1cd000ee80 comp rx=0 tx=0).stop 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 shutdown_connections 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ce0103600 0x7f1ce01a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1cc40a3300 0x7f1cc40a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce0102c40 0x7f1ce019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 --2- 172.21.15.22:0/1670431001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce0101a40 0x7f1ce0199f50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:09.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 >> 172.21.15.22:0/1670431001 conn(0x7f1ce00fd1f0 msgr2=0x7f1ce0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 shutdown_connections 2024-09-15T22:32:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:09.898+0000 7f1ce5400640 1 -- 172.21.15.22:0/1670431001 wait complete. 2024-09-15T22:32:10.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:10 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1670431001' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:32:10.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:10 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1670431001' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:32:10.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T22:32:10.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:10 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1670431001' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:32:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:11.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:11 smithi022 ceph-mon[30634]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:11.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:11 smithi022 ceph-mon[30634]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:32:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:11 smithi110 ceph-mon[35282]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:11 smithi110 ceph-mon[35282]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:32:11.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 -- 172.21.15.22:0/2772535794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc103600 msgr2=0x7f07fc109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 --2- 172.21.15.22:0/2772535794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc103600 0x7f07fc109e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009ca0 tx=0x7f07f402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 -- 172.21.15.22:0/2772535794 shutdown_connections 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 --2- 172.21.15.22:0/2772535794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc103600 0x7f07fc109e90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 --2- 172.21.15.22:0/2772535794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc102c40 0x7f07fc1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 --2- 172.21.15.22:0/2772535794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07fc101a40 0x7f07fc101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 -- 172.21.15.22:0/2772535794 >> 172.21.15.22:0/2772535794 conn(0x7f07fc0fd1f0 msgr2=0x7f07fc0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:11.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 -- 172.21.15.22:0/2772535794 shutdown_connections 2024-09-15T22:32:11.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.808+0000 7f07fb200640 1 -- 172.21.15.22:0/2772535794 wait complete. 2024-09-15T22:32:11.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.809+0000 7f07fb200640 1 Processor -- start 2024-09-15T22:32:11.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 -- start start 2024-09-15T22:32:11.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc101a40 0x7f07fc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:11.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 0x7f07fc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:11.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07fc103600 0x7f07fc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:11.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc10d6f0 con 0x7f07fc102c40 2024-09-15T22:32:11.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc10d570 con 0x7f07fc101a40 2024-09-15T22:32:11.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07fb200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc10d870 con 0x7f07fc103600 2024-09-15T22:32:11.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.810+0000 7f07f9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 0x7f07fc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:11.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc101a40 0x7f07fc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:11.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 0x7f07fc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55132/0 (socket says 172.21.15.22:55132) 2024-09-15T22:32:11.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9400640 1 -- 172.21.15.22:0/3411390387 learned_addr learned my addr 172.21.15.22:0/3411390387 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:11.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07fa800640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07fc103600 0x7f07fc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:11.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 -- 172.21.15.22:0/3411390387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07fc103600 msgr2=0x7f07fc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:11.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07fc103600 0x7f07fc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 -- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 msgr2=0x7f07fc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 0x7f07fc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 -- 172.21.15.22:0/3411390387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc0753e0 con 0x7f07fc101a40 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9400640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 0x7f07fc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.811+0000 7f07f9e00640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc101a40 0x7f07fc075f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e9c0 tx=0x7f07ec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.812+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00ccc0 con 0x7f07fc101a40 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.812+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07ec0035f0 con 0x7f07fc101a40 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.812+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc1a1e40 con 0x7f07fc101a40 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.812+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00ce60 con 0x7f07fc101a40 2024-09-15T22:32:11.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.812+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc1a2290 con 0x7f07fc101a40 2024-09-15T22:32:11.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.813+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc108d70 con 0x7f07fc101a40 2024-09-15T22:32:11.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.817+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f07ec0037a0 con 0x7f07fc101a40 2024-09-15T22:32:11.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.818+0000 7f07f2a00640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07e00a32c0 0x7f07e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.818+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f07ec0cfc10 con 0x7f07fc101a40 2024-09-15T22:32:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.818+0000 7f07f9400640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07e00a32c0 0x7f07e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.819+0000 7f07f9400640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07e00a32c0 0x7f07e00a5780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07fc075d10 tx=0x7f07e800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:11.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:11.822+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07ec09c8f0 con 0x7f07fc101a40 2024-09-15T22:32:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:11 smithi112 ceph-mon[35032]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:11 smithi112 ceph-mon[35032]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:32:12.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.010+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f07fc062f40 con 0x7f07fc101a40 2024-09-15T22:32:12.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.011+0000 7f07f2a00640 1 -- 172.21.15.22:0/3411390387 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5311 (secure 0 0 0) 0x7f07ec09c1f0 con 0x7f07fc101a40 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 81 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:fsid d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-15T22:22:15.226622+0000 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-15T22:31:11.024043+0000 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:crush_version 26 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:full_ratio 0.95 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:backfillfull_ratio 0.9 2024-09-15T22:32:12.014 INFO:teuthology.orchestra.run.smithi022.stdout:nearfull_ratio 0.85 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:require_min_compat_client luminous 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:min_compat_client luminous 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:require_osd_release squid 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:stretch_mode_enabled false 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:max_osd 12 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 up in weight 1 up_from 8 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6802/1552898806,v1:172.21.15.22:6803/1552898806] [v2:172.21.15.22:6804/1552898806,v1:172.21.15.22:6805/1552898806] exists,up aa244aa0-6f2d-4a42-9b2a-09f860eb8225 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 up in weight 1 up_from 13 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/2485792273,v1:172.21.15.110:6801/2485792273] [v2:172.21.15.110:6802/2485792273,v1:172.21.15.110:6803/2485792273] exists,up ce9db823-3025-4c1c-ad9f-30f700ded503 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 up in weight 1 up_from 17 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/1634459120,v1:172.21.15.112:6801/1634459120] [v2:172.21.15.112:6802/1634459120,v1:172.21.15.112:6803/1634459120] exists,up 15d10045-c544-42a2-b986-99217d81c454 2024-09-15T22:32:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 up in weight 1 up_from 23 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6810/2418580016,v1:172.21.15.22:6811/2418580016] [v2:172.21.15.22:6812/2418580016,v1:172.21.15.22:6813/2418580016] exists,up 22c855e6-5548-457e-8a07-3f65c3c9189c 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6808/2813378643,v1:172.21.15.110:6809/2813378643] [v2:172.21.15.110:6810/2813378643,v1:172.21.15.110:6811/2813378643] exists,up 2b2c8bcb-5000-4dc8-aa69-67617f69c5f7 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 up in weight 1 up_from 35 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/1940652320,v1:172.21.15.112:6809/1940652320] [v2:172.21.15.112:6810/1940652320,v1:172.21.15.112:6811/1940652320] exists,up 5c23e30e-e3fb-472d-9fb8-8ca3f9742c49 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 up in weight 1 up_from 42 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6818/4293876036,v1:172.21.15.22:6819/4293876036] [v2:172.21.15.22:6820/4293876036,v1:172.21.15.22:6821/4293876036] exists,up 55a5401c-0205-407d-bf6b-bd98309df058 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 up in weight 1 up_from 47 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6816/152931890,v1:172.21.15.110:6817/152931890] [v2:172.21.15.110:6818/152931890,v1:172.21.15.110:6819/152931890] exists,up b1c41c5d-3218-4783-9c59-e49c4a97c43a 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 up in weight 1 up_from 54 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/126632637,v1:172.21.15.112:6817/126632637] [v2:172.21.15.112:6818/126632637,v1:172.21.15.112:6819/126632637] exists,up db438831-af66-49ce-933e-327537a59442 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 up in weight 1 up_from 61 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6826/2222374873,v1:172.21.15.22:6827/2222374873] [v2:172.21.15.22:6828/2222374873,v1:172.21.15.22:6829/2222374873] exists,up db7ade71-4c38-48a7-9ea0-520da038202c 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 up in weight 1 up_from 65 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6824/1916851446,v1:172.21.15.110:6825/1916851446] [v2:172.21.15.110:6826/1916851446,v1:172.21.15.110:6827/1916851446] exists,up e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 up in weight 1 up_from 72 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/362844051,v1:172.21.15.112:6825/362844051] [v2:172.21.15.112:6826/362844051,v1:172.21.15.112:6827/362844051] exists,up 82f9f6ab-86fe-40e5-879a-0c6230700163 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.e [2,1] 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.14 [2,4] 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1d [8,11] 2024-09-15T22:32:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1f [7,11] 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.0 [4,8] 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.7 [3,9] 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.21 [4,6] 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.24 [4,9] 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.25 [5,9] 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/3305817552 expires 2024-09-16T22:23:09.459721+0000 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3624200134 expires 2024-09-16T22:23:09.459721+0000 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1725043068 expires 2024-09-16T22:23:09.459721+0000 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/3305817552 expires 2024-09-16T22:23:09.459721+0000 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/2616449464 expires 2024-09-16T22:22:40.678920+0000 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/2616449464 expires 2024-09-16T22:22:40.678920+0000 2024-09-15T22:32:12.017 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3382105738 expires 2024-09-16T22:22:40.678920+0000 2024-09-15T22:32:12.018 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3049867263 expires 2024-09-16T22:23:09.459721+0000 2024-09-15T22:32:12.018 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3523117683 expires 2024-09-16T22:22:40.678920+0000 2024-09-15T22:32:12.018 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1271758657 expires 2024-09-16T22:22:40.678920+0000 2024-09-15T22:32:12.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07e00a32c0 msgr2=0x7f07e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:12.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07e00a32c0 0x7f07e00a5780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07fc075d10 tx=0x7f07e800b4a0 comp rx=0 tx=0).stop 2024-09-15T22:32:12.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc101a40 msgr2=0x7f07fc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc101a40 0x7f07fc075f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e9c0 tx=0x7f07ec00ee80 comp rx=0 tx=0).stop 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 shutdown_connections 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07fc103600 0x7f07fc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07e00a32c0 0x7f07e00a5780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07fc102c40 0x7f07fc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 --2- 172.21.15.22:0/3411390387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc101a40 0x7f07fc075f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 >> 172.21.15.22:0/3411390387 conn(0x7f07fc0fd1f0 msgr2=0x7f07fc105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 shutdown_connections 2024-09-15T22:32:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:12.015+0000 7f07fb200640 1 -- 172.21.15.22:0/3411390387 wait complete. 2024-09-15T22:32:12.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:12 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3411390387' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:32:12.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:12 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3411390387' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:32:12.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:12 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3411390387' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:32:12.932 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T22:32:12.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:32:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:13.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:13 smithi022 ceph-mon[30634]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-15T22:32:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:13 smithi110 ceph-mon[35282]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-15T22:32:13.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:13 smithi112 ceph-mon[35032]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-15T22:32:13.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 -- 172.21.15.22:0/328805012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38077040 msgr2=0x7f5b381124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 --2- 172.21.15.22:0/328805012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38077040 0x7f5b381124f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009900 tx=0x7f5b2002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 -- 172.21.15.22:0/328805012 shutdown_connections 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 --2- 172.21.15.22:0/328805012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b38112a30 0x7f5b38114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 --2- 172.21.15.22:0/328805012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38077040 0x7f5b381124f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 --2- 172.21.15.22:0/328805012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38076720 0x7f5b38076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 -- 172.21.15.22:0/328805012 >> 172.21.15.22:0/328805012 conn(0x7f5b380ffa90 msgr2=0x7f5b38101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 -- 172.21.15.22:0/328805012 shutdown_connections 2024-09-15T22:32:13.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.917+0000 7f5b3e000640 1 -- 172.21.15.22:0/328805012 wait complete. 2024-09-15T22:32:13.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.918+0000 7f5b3e000640 1 Processor -- start 2024-09-15T22:32:13.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 -- start start 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 0x7f5b381a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38077040 0x7f5b381a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b38112a30 0x7f5b3819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38118600 con 0x7f5b38076720 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38118480 con 0x7f5b38077040 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b3e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38118780 con 0x7f5b38112a30 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b37400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 0x7f5b381a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b2ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38077040 0x7f5b381a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b37400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 0x7f5b381a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55152/0 (socket says 172.21.15.22:55152) 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b37400640 1 -- 172.21.15.22:0/1497916957 learned_addr learned my addr 172.21.15.22:0/1497916957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.919+0000 7f5b37e00640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b38112a30 0x7f5b3819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:13.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b37400640 1 -- 172.21.15.22:0/1497916957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b38112a30 msgr2=0x7f5b3819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:13.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b37400640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b38112a30 0x7f5b3819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:13.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b37400640 1 -- 172.21.15.22:0/1497916957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38077040 msgr2=0x7f5b381a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:13.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b37400640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38077040 0x7f5b381a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:13.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b37400640 1 -- 172.21.15.22:0/1497916957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3819efc0 con 0x7f5b38076720 2024-09-15T22:32:13.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b2ea00640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38077040 0x7f5b381a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:13.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.920+0000 7f5b37400640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 0x7f5b381a46d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800ebc0 tx=0x7f5b2800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:13.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.921+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28010630 con 0x7f5b38076720 2024-09-15T22:32:13.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.921+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b28010cb0 con 0x7f5b38076720 2024-09-15T22:32:13.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.921+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28018bd0 con 0x7f5b38076720 2024-09-15T22:32:13.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.921+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3819f2b0 con 0x7f5b38076720 2024-09-15T22:32:13.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.921+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b381ab5a0 con 0x7f5b38076720 2024-09-15T22:32:13.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.922+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b38076b00 con 0x7f5b38076720 2024-09-15T22:32:13.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.926+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5b280107d0 con 0x7f5b38076720 2024-09-15T22:32:13.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.927+0000 7f5b34c00640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5b1c0a3240 0x7f5b1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:13.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.927+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5b280d0150 con 0x7f5b38076720 2024-09-15T22:32:13.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.927+0000 7f5b2ea00640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5b1c0a3240 0x7f5b1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:13.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.928+0000 7f5b2ea00640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5b1c0a3240 0x7f5b1c0a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b20000c00 tx=0x7f5b20031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:13.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:13.930+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b2809c7e0 con 0x7f5b38076720 2024-09-15T22:32:14.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.152+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b381ab7d0 con 0x7f5b38076720 2024-09-15T22:32:14.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.153+0000 7f5b34c00640 1 -- 172.21.15.22:0/1497916957 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11920 (secure 0 0 0) 0x7f5b280a0ae0 con 0x7f5b38076720 2024-09-15T22:32:14.156 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:14.156 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-09-15T22:30:40:642902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:30:39.648360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24529,24530,24548]},"id":1}]} 2024-09-15T22:32:14.156 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:32:14.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.155+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5b1c0a3240 msgr2=0x7f5b1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:14.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.155+0000 7f5b3e000640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5b1c0a3240 0x7f5b1c0a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b20000c00 tx=0x7f5b20031510 comp rx=0 tx=0).stop 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.155+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 msgr2=0x7f5b381a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.155+0000 7f5b3e000640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 0x7f5b381a46d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800ebc0 tx=0x7f5b2800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 shutdown_connections 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b38112a30 0x7f5b3819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5b1c0a3240 0x7f5b1c0a5700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b38077040 0x7f5b381a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 --2- 172.21.15.22:0/1497916957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b38076720 0x7f5b381a46d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 >> 172.21.15.22:0/1497916957 conn(0x7f5b380ffa90 msgr2=0x7f5b38101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 shutdown_connections 2024-09-15T22:32:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:14.156+0000 7f5b3e000640 1 -- 172.21.15.22:0/1497916957 wait complete. 2024-09-15T22:32:14.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:14 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1497916957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:32:14.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:14 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1497916957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:32:14.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:14 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1497916957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:32:15.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:32:15.449 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:15 smithi110 ceph-mon[35282]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-15T22:32:15.744 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:15 smithi022 ceph-mon[30634]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-15T22:32:15.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:15 smithi112 ceph-mon[35032]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-15T22:32:16.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 -- 172.21.15.22:0/2122121894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff338102360 msgr2=0x7ff33810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:16.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 --2- 172.21.15.22:0/2122121894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff338102360 0x7ff33810e890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff330009cd0 tx=0x7ff33002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 -- 172.21.15.22:0/2122121894 shutdown_connections 2024-09-15T22:32:16.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 --2- 172.21.15.22:0/2122121894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3381019c0 0x7ff338101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 --2- 172.21.15.22:0/2122121894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff338102360 0x7ff33810e890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 --2- 172.21.15.22:0/2122121894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3381079c0 0x7ff338107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 -- 172.21.15.22:0/2122121894 >> 172.21.15.22:0/2122121894 conn(0x7ff3380fd740 msgr2=0x7ff3380ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 -- 172.21.15.22:0/2122121894 shutdown_connections 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.066+0000 7ff33de00640 1 -- 172.21.15.22:0/2122121894 wait complete. 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.067+0000 7ff33de00640 1 Processor -- start 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.067+0000 7ff33de00640 1 -- start start 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33de00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 0x7ff33819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff338102360 0x7ff33819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3381079c0 0x7ff33819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33de00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff338111dc0 con 0x7ff3381019c0 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff338111c40 con 0x7ff3381079c0 2024-09-15T22:32:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33de00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff338111f40 con 0x7ff338102360 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 0x7ff33819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 0x7ff33819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55172/0 (socket says 172.21.15.22:55172) 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 -- 172.21.15.22:0/4169969810 learned_addr learned my addr 172.21.15.22:0/4169969810 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33d400640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3381079c0 0x7ff33819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff337e00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff338102360 0x7ff33819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 -- 172.21.15.22:0/4169969810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff338102360 msgr2=0x7ff33819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff338102360 0x7ff33819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 -- 172.21.15.22:0/4169969810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3381079c0 msgr2=0x7ff33819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3381079c0 0x7ff33819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.068+0000 7ff33ca00640 1 -- 172.21.15.22:0/4169969810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33819f410 con 0x7ff3381019c0 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.069+0000 7ff33ca00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 0x7ff33819a460 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9f0 tx=0x7ff32c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.069+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00cd80 con 0x7ff3381019c0 2024-09-15T22:32:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.069+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32c010910 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.069+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33819f700 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.069+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c018990 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.069+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3381a6fe0 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.070+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff338101e20 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.072+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff32c010ac0 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.073+0000 7ff335600640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3200a3240 0x7ff3200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.073+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff32c0cfbe0 con 0x7ff3381019c0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.073+0000 7ff337e00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3200a3240 0x7ff3200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.074+0000 7ff337e00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3200a3240 0x7ff3200a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff33810dfd0 tx=0x7ff324005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.077+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff32c09c270 con 0x7ff3381019c0 2024-09-15T22:32:16.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.299+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3381a7280 con 0x7ff3381019c0 2024-09-15T22:32:16.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.300+0000 7ff335600640 1 -- 172.21.15.22:0/4169969810 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11920 (secure 0 0 0) 0x7ff32c0a0570 con 0x7ff3381019c0 2024-09-15T22:32:16.303 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:16.304 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"btime":"2024-09-15T22:30:40:642902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:30:39.648360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24529,24530,24548]},"id":1}]} 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 24 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3200a3240 msgr2=0x7ff3200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3200a3240 0x7ff3200a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff33810dfd0 tx=0x7ff324005f90 comp rx=0 tx=0).stop 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 msgr2=0x7ff33819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 0x7ff33819a460 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9f0 tx=0x7ff32c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 shutdown_connections 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff338102360 0x7ff33819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3200a3240 0x7ff3200a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3381079c0 0x7ff33819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 --2- 172.21.15.22:0/4169969810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3381019c0 0x7ff33819a460 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:16.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 >> 172.21.15.22:0/4169969810 conn(0x7ff3380fd740 msgr2=0x7ff33810cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:16.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 shutdown_connections 2024-09-15T22:32:16.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:16.302+0000 7ff33de00640 1 -- 172.21.15.22:0/4169969810 wait complete. 2024-09-15T22:32:16.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:16 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/4169969810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:32:16.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:16 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/4169969810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:32:16.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:16 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/4169969810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:32:17.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:32:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:17 smithi110 ceph-mon[35282]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:17 smithi022 ceph-mon[30634]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:32:17.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:17 smithi112 ceph-mon[35032]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 -- 172.21.15.22:0/1072001007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 msgr2=0x7f17f01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 --2- 172.21.15.22:0/1072001007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f01043d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009900 tx=0x7f17e002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 -- 172.21.15.22:0/1072001007 shutdown_connections 2024-09-15T22:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 --2- 172.21.15.22:0/1072001007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f0109120 0x7f17f0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 --2- 172.21.15.22:0/1072001007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f01049a0 0x7f17f01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 --2- 172.21.15.22:0/1072001007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f01043d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 -- 172.21.15.22:0/1072001007 >> 172.21.15.22:0/1072001007 conn(0x7f17f00ffa90 msgr2=0x7f17f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 -- 172.21.15.22:0/1072001007 shutdown_connections 2024-09-15T22:32:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.319+0000 7f17f6a00640 1 -- 172.21.15.22:0/1072001007 wait complete. 2024-09-15T22:32:18.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.320+0000 7f17f6a00640 1 Processor -- start 2024-09-15T22:32:18.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.320+0000 7f17f6a00640 1 -- start start 2024-09-15T22:32:18.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f0076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01049a0 0x7f17f0076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0109120 0x7f17f0077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f6a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0114170 con 0x7f17f0103ff0 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f6a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0113ff0 con 0x7f17f0109120 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f6a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01142f0 con 0x7f17f01049a0 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f0076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f0076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55188/0 (socket says 172.21.15.22:55188) 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 -- 172.21.15.22:0/2192192345 learned_addr learned my addr 172.21.15.22:0/2192192345 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17f4a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0109120 0x7f17f0077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17ef400640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01049a0 0x7f17f0076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 -- 172.21.15.22:0/2192192345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01049a0 msgr2=0x7f17f0076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01049a0 0x7f17f0076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 -- 172.21.15.22:0/2192192345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0109120 msgr2=0x7f17f0077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:18.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0109120 0x7f17f0077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17efe00640 1 -- 172.21.15.22:0/2192192345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f01aad10 con 0x7f17f0103ff0 2024-09-15T22:32:18.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.321+0000 7f17ef400640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01049a0 0x7f17f0076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:18.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.322+0000 7f17efe00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f0076700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17e002a9e0 tx=0x7f17e0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.322+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e003f070 con 0x7f17f0103ff0 2024-09-15T22:32:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.322+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e0031c90 con 0x7f17f0103ff0 2024-09-15T22:32:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.322+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f01aafa0 con 0x7f17f0103ff0 2024-09-15T22:32:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.322+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0035030 con 0x7f17f0103ff0 2024-09-15T22:32:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.322+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01ab3f0 con 0x7f17f0103ff0 2024-09-15T22:32:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.323+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f01054d0 con 0x7f17f0103ff0 2024-09-15T22:32:18.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.325+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f17e0042070 con 0x7f17f0103ff0 2024-09-15T22:32:18.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.326+0000 7f17ecc00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f17d40a3240 0x7f17d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:18.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.327+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f17e00eff90 con 0x7f17f0103ff0 2024-09-15T22:32:18.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.327+0000 7f17ef400640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f17d40a3240 0x7f17d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:18.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.327+0000 7f17ef400640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f17d40a3240 0x7f17d40a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f17f0077ec0 tx=0x7f17dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:18.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.331+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17e00bcd30 con 0x7f17f0103ff0 2024-09-15T22:32:18.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.521+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17f002d7c0 con 0x7f17f0103ff0 2024-09-15T22:32:18.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.523+0000 7f17ecc00640 1 -- 172.21.15.22:0/2192192345 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22773 (secure 0 0 0) 0x7f17e00dc020 con 0x7f17f0103ff0 2024-09-15T22:32:18.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:32:18.525 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:31:11.024043+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:32:18.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.526+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f17d40a3240 msgr2=0x7f17d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:18.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.526+0000 7f17f6a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f17d40a3240 0x7f17d40a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f17f0077ec0 tx=0x7f17dc005f90 comp rx=0 tx=0).stop 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.526+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 msgr2=0x7f17f0076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.526+0000 7f17f6a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f0076700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17e002a9e0 tx=0x7f17e0003c10 comp rx=0 tx=0).stop 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 shutdown_connections 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01049a0 0x7f17f0076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f17d40a3240 0x7f17d40a5700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17f0109120 0x7f17f0077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 --2- 172.21.15.22:0/2192192345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17f0103ff0 0x7f17f0076700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 >> 172.21.15.22:0/2192192345 conn(0x7f17f00ffa90 msgr2=0x7f17f0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 shutdown_connections 2024-09-15T22:32:18.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:18.527+0000 7f17f6a00640 1 -- 172.21.15.22:0/2192192345 wait complete. 2024-09-15T22:32:19.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:30:24.572684+0000', 'modified': '2024-09-15T22:30:39.648360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24548, 'mds_1': 24530, 'mds_2': 24529}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24499': {'gid': 24499, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/3072966464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 3072966464}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 3072966464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24511': {'gid': 24511, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6837/35956348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 35956348}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 35956348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.110:6837/1376752055', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6836', 'nonce': 1376752055}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 1376752055}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.112:6839/1853253510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 1853253510}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 1853253510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.22:6839/3141077377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 3141077377}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 3141077377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.110:6839/1046187875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6838', 'nonce': 1046187875}, {'type': 'v1', 'addr': '172.21.15.110:6839', 'nonce': 1046187875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24548, 'qdb_cluster': [24529, 24530, 24548]} 2024-09-15T22:32:19.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-15T22:32:19.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:32:19.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:19 smithi022 ceph-mon[30634]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-15T22:32:19.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:19 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2192192345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:32:19.649 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:19 smithi110 ceph-mon[35282]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-15T22:32:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:19 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2192192345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:32:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:19 smithi112 ceph-mon[35032]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-15T22:32:19.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:19 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2192192345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:32:20.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 -- 172.21.15.22:0/3331750746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c1047e0 msgr2=0x7fe49c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/3331750746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c1047e0 0x7fe49c108830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe484009900 tx=0x7fe48402a410 comp rx=0 tx=0).stop 2024-09-15T22:32:20.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 -- 172.21.15.22:0/3331750746 shutdown_connections 2024-09-15T22:32:20.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/3331750746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c108f60 0x7fe49c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/3331750746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c1047e0 0x7fe49c108830 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/3331750746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49c103e30 0x7fe49c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 -- 172.21.15.22:0/3331750746 >> 172.21.15.22:0/3331750746 conn(0x7fe49c0ff8d0 msgr2=0x7fe49c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:20.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 -- 172.21.15.22:0/3331750746 shutdown_connections 2024-09-15T22:32:20.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.229+0000 7fe4a1a00640 1 -- 172.21.15.22:0/3331750746 wait complete. 2024-09-15T22:32:20.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.230+0000 7fe4a1a00640 1 Processor -- start 2024-09-15T22:32:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.230+0000 7fe4a1a00640 1 -- start start 2024-09-15T22:32:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49c103e30 0x7fe49c076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c1047e0 0x7fe49c076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 0x7fe49c077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c113fd0 con 0x7fe49c108f60 2024-09-15T22:32:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c113e50 con 0x7fe49c1047e0 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c114150 con 0x7fe49c103e30 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 0x7fe49c077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe493e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c1047e0 0x7fe49c076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 0x7fe49c077180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40620/0 (socket says 172.21.15.22:40620) 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 -- 172.21.15.22:0/1786522354 learned_addr learned my addr 172.21.15.22:0/1786522354 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe49be00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49c103e30 0x7fe49c076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 -- 172.21.15.22:0/1786522354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49c103e30 msgr2=0x7fe49c076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49c103e30 0x7fe49c076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 -- 172.21.15.22:0/1786522354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c1047e0 msgr2=0x7fe49c076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c1047e0 0x7fe49c076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe4a1000640 1 -- 172.21.15.22:0/1786522354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c1aab90 con 0x7fe49c108f60 2024-09-15T22:32:20.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.231+0000 7fe493e00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c1047e0 0x7fe49c076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.232+0000 7fe4a1000640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 0x7fe49c077180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe49400eb40 tx=0x7fe49400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.232+0000 7fe499600640 1 -- 172.21.15.22:0/1786522354 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494004b20 con 0x7fe49c108f60 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.232+0000 7fe499600640 1 -- 172.21.15.22:0/1786522354 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe494004cc0 con 0x7fe49c108f60 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.232+0000 7fe499600640 1 -- 172.21.15.22:0/1786522354 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494010720 con 0x7fe49c108f60 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.232+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c1aae80 con 0x7fe49c108f60 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.232+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c1ab2e0 con 0x7fe49c108f60 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.235+0000 7fe4a59f4740 1 Processor -- start 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.235+0000 7fe499600640 1 -- 172.21.15.22:0/1786522354 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe494005020 con 0x7fe49c108f60 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 -- start start 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d1b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d266c0 0x55b613d28ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b613c810b0 con 0x55b613d1be00 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b613c28ab0 con 0x55b613d266c0 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b613c7d070 con 0x55b613d1b4e0 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe49be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe49be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d26180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40630/0 (socket says 172.21.15.22:40630) 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe49be00640 1 -- 172.21.15.22:0/3429776459 learned_addr learned my addr 172.21.15.22:0/3429776459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe493e00640 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d266c0 0x55b613d28ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.236+0000 7fe493e00640 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d1b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe49be00640 1 -- 172.21.15.22:0/3429776459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 msgr2=0x55b613d1b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe49be00640 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d1b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe49be00640 1 -- 172.21.15.22:0/3429776459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d266c0 msgr2=0x55b613d28ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe49be00640 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d266c0 0x55b613d28ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe49be00640 1 -- 172.21.15.22:0/3429776459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b613c354a0 con 0x55b613d1be00 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe493e00640 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d266c0 0x55b613d28ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe49be00640 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d26180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009cf0 tx=0x7fe48c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f37916b15b3eef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe491600640 1 -- 172.21.15.22:0/3429776459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c004230 con 0x55b613d1be00 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe491600640 1 -- 172.21.15.22:0/3429776459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c0043d0 con 0x55b613d1be00 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.237+0000 7fe499600640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe4800a3240 0x7fe4800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe491600640 1 -- 172.21.15.22:0/3429776459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c019840 con 0x55b613d1be00 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe499600640 1 -- 172.21.15.22:0/1786522354 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe4940cfdb0 con 0x7fe49c108f60 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe493e00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe4800a3240 0x7fe4800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 -- 172.21.15.22:0/3429776459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 msgr2=0x55b613d26180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d26180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009cf0 tx=0x7fe48c011810 comp rx=0 tx=0).stop 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe493e00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe4800a3240 0x7fe4800a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe484000c00 tx=0x7fe484009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 -- 172.21.15.22:0/3429776459 shutdown_connections 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d266c0 0x55b613d28ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d26180 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/3429776459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d1b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.238+0000 7fe4a59f4740 1 -- 172.21.15.22:0/3429776459 >> 172.21.15.22:0/3429776459 conn(0x55b613d17a70 msgr2=0x55b613d17e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.239+0000 7fe4a59f4740 1 -- 172.21.15.22:0/3429776459 shutdown_connections 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.239+0000 7fe4a59f4740 1 -- 172.21.15.22:0/3429776459 wait complete. 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.239+0000 7fe4a59f4740 1 -- start start 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.239+0000 7fe4a59f4740 1 Processor -- start 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1b4e0 0x55b613d23510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d23a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d23f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b613d29330 con 0x55b613d1be00 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b613c09920 con 0x55b613d1b4e0 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b613d294b0 con 0x55b613d266c0 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a59f4740 10 client.0 _ll_register_callbacks cb 0x55b613c2d8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe493e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d23a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe493e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d23a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40640/0 (socket says 172.21.15.22:40640) 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe493e00640 1 -- 172.21.15.22:0/676011957 learned_addr learned my addr 172.21.15.22:0/676011957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe49be00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1b4e0 0x55b613d23510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.240+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe493e00640 1 -- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 msgr2=0x55b613d23f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe493e00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d23f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe493e00640 1 -- 172.21.15.22:0/676011957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1b4e0 msgr2=0x55b613d23510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe493e00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1b4e0 0x55b613d23510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe493e00640 1 -- 172.21.15.22:0/676011957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6139f22b0 con 0x55b613d1be00 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe49be00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1b4e0 0x55b613d23510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe493e00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d23a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe484003790 tx=0x7fe484031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4f19cd8913f95e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe48a000640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe48a000640 1 -- 172.21.15.22:0/676011957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840319c0 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe48a000640 1 -- 172.21.15.22:0/676011957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe484031b60 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.241+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe48c0043d0 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe48a000640 1 -- 172.21.15.22:0/676011957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe484031d60 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 10 client.14988 fetch_fsmap learned FSMap version 24 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b613d34f70 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe48a000640 1 -- 172.21.15.22:0/676011957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c0043d0 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe48a000640 1 -- 172.21.15.22:0/676011957 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe484049040 con 0x55b613d1be00 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 10 client.14988 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 20 client.14988 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613d37600 0x55b613d38a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 4 client.14988 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.242+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 --> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b613c8e620 con 0x55b613d37600 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.243+0000 7fe49be00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613d37600 0x55b613d38a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.243+0000 7fe49be00640 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613d37600 0x55b613d38a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bbb1dfabc6e27970 server_cookie=40f9b0f28dba86d8 in_seq=0 out_seq=0 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.243+0000 7fe48a000640 10 client.14988 ms_handle_connect on v2:172.21.15.112:6838/1853253510 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe48a000640 1 -- 172.21.15.22:0/676011957 <== mds.2 v2:172.21.15.112:6838/1853253510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b613c8e620 con 0x55b613d37600 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe48a000640 10 client.14988 handle_command_reply: tid=0 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 client.14988 shutdown 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 msgr2=0x55b613d23a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d23a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe484003790 tx=0x7fe484031510 comp rx=0 tx=0).stop 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 shutdown_connections 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d23f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613d37600 0x55b613d38a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1be00 0x55b613d23a50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/676011957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1b4e0 0x55b613d23510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 >> 172.21.15.22:0/676011957 conn(0x55b613d17a70 msgr2=0x55b613d1d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.244+0000 7fe48a000640 0 client.14988 ms_handle_reset on v2:172.21.15.112:6838/1853253510 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.245+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 shutdown_connections 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.245+0000 7fe4a59f4740 1 -- 172.21.15.22:0/676011957 wait complete. 2024-09-15T22:32:20.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.245+0000 7fe4a59f4740 20 client.14988 trim_cache size 0 max 16384 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.263+0000 7fe4a59f4740 1 Processor -- start 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.263+0000 7fe4a59f4740 1 -- start start 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 0x55b613d383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d20cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b613d36db0 con 0x55b613d1b4e0 2024-09-15T22:32:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b613d37480 con 0x55b613d1be00 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b613d37b50 con 0x55b613d266c0 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 0x55b613d383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 0x55b613d383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40644/0 (socket says 172.21.15.22:40644) 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 -- 172.21.15.22:0/2143629863 learned_addr learned my addr 172.21.15.22:0/2143629863 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe493e00640 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe4a1000640 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d20cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 -- 172.21.15.22:0/2143629863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 msgr2=0x55b613d20cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d20cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 -- 172.21.15.22:0/2143629863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 msgr2=0x55b613d20790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe49be00640 1 -- 172.21.15.22:0/2143629863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b613d17510 con 0x55b613d1b4e0 2024-09-15T22:32:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.264+0000 7fe493e00640 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.265+0000 7fe49be00640 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 0x55b613d383a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000c00 tx=0x7fe48c0194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ab978f142b5482 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.265+0000 7fe490c00640 1 -- 172.21.15.22:0/2143629863 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c005250 con 0x55b613d1b4e0 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.265+0000 7fe490c00640 1 -- 172.21.15.22:0/2143629863 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c003ad0 con 0x55b613d1b4e0 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.265+0000 7fe490c00640 1 -- 172.21.15.22:0/2143629863 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c019790 con 0x55b613d1b4e0 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 -- 172.21.15.22:0/2143629863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 msgr2=0x55b613d383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 0x55b613d383a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000c00 tx=0x7fe48c0194c0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 -- 172.21.15.22:0/2143629863 shutdown_connections 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d266c0 0x55b613d20cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/2143629863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d1b4e0 0x55b613d383a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 -- 172.21.15.22:0/2143629863 >> 172.21.15.22:0/2143629863 conn(0x55b613d17a70 msgr2=0x55b613d21de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 -- 172.21.15.22:0/2143629863 shutdown_connections 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 -- 172.21.15.22:0/2143629863 wait complete. 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 -- start start 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.266+0000 7fe4a59f4740 1 Processor -- start 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d41380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 0x55b613d20650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b613d388f0 con 0x55b613d266c0 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b613d38220 con 0x55b613d1be00 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b613d38fc0 con 0x55b613d1b4e0 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a59f4740 10 client.0 _ll_register_callbacks cb 0x7fe4840035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 0x55b613d20650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe49be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d41380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 0x55b613d20650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40660/0 (socket says 172.21.15.22:40660) 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe4a1000640 1 -- 172.21.15.22:0/4096687759 learned_addr learned my addr 172.21.15.22:0/4096687759 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.267+0000 7fe493e00640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe49be00640 1 -- 172.21.15.22:0/4096687759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 msgr2=0x55b613d20110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe49be00640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe49be00640 1 -- 172.21.15.22:0/4096687759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 msgr2=0x55b613d20650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe49be00640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 0x55b613d20650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe49be00640 1 -- 172.21.15.22:0/4096687759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b613d20e80 con 0x55b613d1b4e0 2024-09-15T22:32:20.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe4a1000640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 0x55b613d20650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe49be00640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d41380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000c00 tx=0x7fe48c011dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=822038db9a6b12f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe48a000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe48a000640 1 -- 172.21.15.22:0/4096687759 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c038070 con 0x55b613d1b4e0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe48a000640 1 -- 172.21.15.22:0/4096687759 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe48c0035f0 con 0x55b613d1b4e0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.268+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe48c003ad0 con 0x55b613d1b4e0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe48a000640 1 -- 172.21.15.22:0/4096687759 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe48c003c80 con 0x55b613d1b4e0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 10 client.25027 fetch_fsmap learned FSMap version 24 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b613da1d10 con 0x55b613d1b4e0 2024-09-15T22:32:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe48a000640 1 -- 172.21.15.22:0/4096687759 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c003ad0 con 0x55b613d1b4e0 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe48a000640 1 -- 172.21.15.22:0/4096687759 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe48c019bd0 con 0x55b613d1b4e0 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 10 client.25027 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 10 client.25027 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 20 client.25027 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613da6170 0x55b613da4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 4 client.25027 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.269+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 --> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] -- command(tid 0: {"prefix": "status"}) -- 0x55b613c88b30 con 0x55b613da6170 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.270+0000 7fe493e00640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613da6170 0x55b613da4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.270+0000 7fe493e00640 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613da6170 0x55b613da4e80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b51078d1c499299f server_cookie=45a9f3d89ae99423 in_seq=0 out_seq=0 2024-09-15T22:32:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.270+0000 7fe48a000640 10 client.25027 ms_handle_connect on v2:172.21.15.112:6838/1853253510 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.270+0000 7fe48a000640 1 -- 172.21.15.22:0/4096687759 <== mds.2 v2:172.21.15.112:6838/1853253510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b613c88b30 con 0x55b613da6170 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.270+0000 7fe48a000640 10 client.25027 handle_command_reply: tid=0 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.270+0000 7fe4a59f4740 1 client.25027 shutdown 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 msgr2=0x55b613d41380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d41380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000c00 tx=0x7fe48c011dc0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 shutdown_connections 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:6838/1853253510,v1:172.21.15.112:6839/1853253510] conn(0x55b613da6170 0x55b613da4e80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b613d266c0 0x55b613d20650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b613d1be00 0x55b613d20110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 --2- 172.21.15.22:0/4096687759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b613d1b4e0 0x55b613d41380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe48a000640 0 client.25027 ms_handle_reset on v2:172.21.15.112:6838/1853253510 2024-09-15T22:32:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 >> 172.21.15.22:0/4096687759 conn(0x55b613d17a70 msgr2=0x55b613d16bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 shutdown_connections 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 1 -- 172.21.15.22:0/4096687759 wait complete. 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.271+0000 7fe4a59f4740 20 client.25027 trim_cache size 0 max 16384 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24529, 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-15T22:32:20.277 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 103.63466968100001, 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 79, 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 140.48330278399999 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:32:20.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe4800a3240 msgr2=0x7fe4800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe4800a3240 0x7fe4800a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe484000c00 tx=0x7fe484009260 comp rx=0 tx=0).stop 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 msgr2=0x7fe49c077180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 0x7fe49c077180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe49400eb40 tx=0x7fe49400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 shutdown_connections 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe4800a3240 0x7fe4800a5700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe49c108f60 0x7fe49c077180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe49c1047e0 0x7fe49c076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 --2- 172.21.15.22:0/1786522354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe49c103e30 0x7fe49c076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 >> 172.21.15.22:0/1786522354 conn(0x7fe49c0ff8d0 msgr2=0x7fe49c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 shutdown_connections 2024-09-15T22:32:20.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:20.272+0000 7fe4a1a00640 1 -- 172.21.15.22:0/1786522354 wait complete. 2024-09-15T22:32:21.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell mds.g status 2024-09-15T22:32:21.439 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:21.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:21 smithi110 ceph-mon[35282]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:32:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:21 smithi022 ceph-mon[30634]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:32:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:21 smithi112 ceph-mon[35032]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-15T22:32:22.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 -- 172.21.15.22:0/1886710976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24102780 msgr2=0x7fbe241067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 --2- 172.21.15.22:0/1886710976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24102780 0x7fbe241067d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009900 tx=0x7fbe0c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 -- 172.21.15.22:0/1886710976 shutdown_connections 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 --2- 172.21.15.22:0/1886710976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe24106f00 0x7fbe2410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 --2- 172.21.15.22:0/1886710976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24102780 0x7fbe241067d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 --2- 172.21.15.22:0/1886710976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe241021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 -- 172.21.15.22:0/1886710976 >> 172.21.15.22:0/1886710976 conn(0x7fbe240fd890 msgr2=0x7fbe240ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.056+0000 7fbe29400640 1 -- 172.21.15.22:0/1886710976 shutdown_connections 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.057+0000 7fbe29400640 1 -- 172.21.15.22:0/1886710976 wait complete. 2024-09-15T22:32:22.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.058+0000 7fbe29400640 1 Processor -- start 2024-09-15T22:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.058+0000 7fbe29400640 1 -- start start 2024-09-15T22:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.058+0000 7fbe29400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.058+0000 7fbe29400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe24102780 0x7fbe24074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe29400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24106f00 0x7fbe24074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe29400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24111f60 con 0x7fbe24106f00 2024-09-15T22:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe29400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24111de0 con 0x7fbe24101dd0 2024-09-15T22:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe29400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe241120e0 con 0x7fbe24102780 2024-09-15T22:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58894/0 (socket says 172.21.15.22:58894) 2024-09-15T22:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 -- 172.21.15.22:0/2954408509 learned_addr learned my addr 172.21.15.22:0/2954408509 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe23200640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24106f00 0x7fbe24074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe1be00640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe24102780 0x7fbe24074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 -- 172.21.15.22:0/2954408509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe24102780 msgr2=0x7fbe24074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe24102780 0x7fbe24074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 -- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24106f00 msgr2=0x7fbe24074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24106f00 0x7fbe24074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.059+0000 7fbe22800640 1 -- 172.21.15.22:0/2954408509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe241a6900 con 0x7fbe24101dd0 2024-09-15T22:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.060+0000 7fbe22800640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe240744f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400e9f0 tx=0x7fbe1400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.060+0000 7fbe1b400640 1 -- 172.21.15.22:0/2954408509 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400cd80 con 0x7fbe24101dd0 2024-09-15T22:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.060+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe241a6bf0 con 0x7fbe24101dd0 2024-09-15T22:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.060+0000 7fbe1b400640 1 -- 172.21.15.22:0/2954408509 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe14010910 con 0x7fbe24101dd0 2024-09-15T22:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.060+0000 7fbe1b400640 1 -- 172.21.15.22:0/2954408509 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe140188f0 con 0x7fbe24101dd0 2024-09-15T22:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.060+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe241a7130 con 0x7fbe24101dd0 2024-09-15T22:32:22.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.064+0000 7fbe1b400640 1 -- 172.21.15.22:0/2954408509 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe14010ac0 con 0x7fbe24101dd0 2024-09-15T22:32:22.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.064+0000 7fbe2c060740 1 Processor -- start 2024-09-15T22:32:22.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.064+0000 7fbe2c060740 1 -- start start 2024-09-15T22:32:22.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08bb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe2c060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5598e08140b0 con 0x5598e08b9510 2024-09-15T22:32:22.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe2c060740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598e07bbab0 con 0x5598e08aec50 2024-09-15T22:32:22.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe2c060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598e0810070 con 0x5598e08ae330 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe1be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe22800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe23200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe23200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37388/0 (socket says 172.21.15.22:37388) 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.065+0000 7fbe23200640 1 -- 172.21.15.22:0/807154403 learned_addr learned my addr 172.21.15.22:0/807154403 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe23200640 1 -- 172.21.15.22:0/807154403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 msgr2=0x5598e08b8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe23200640 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe23200640 1 -- 172.21.15.22:0/807154403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 msgr2=0x5598e08bb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe23200640 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08bb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe23200640 1 -- 172.21.15.22:0/807154403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e07c84a0 con 0x5598e08ae330 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe1b400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe080a3240 0x7fbe080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe1b400640 1 -- 172.21.15.22:0/2954408509 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbe140cff20 con 0x7fbe24101dd0 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe23200640 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08ae710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009f50 tx=0x7fbe1c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d261746eaed75ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe22800640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe080a3240 0x7fbe080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe13400640 1 -- 172.21.15.22:0/807154403 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c004d20 con 0x5598e08ae330 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe13400640 1 -- 172.21.15.22:0/807154403 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe1c004050 con 0x5598e08ae330 2024-09-15T22:32:22.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.066+0000 7fbe13400640 1 -- 172.21.15.22:0/807154403 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c005280 con 0x5598e08ae330 2024-09-15T22:32:22.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 -- 172.21.15.22:0/807154403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 msgr2=0x5598e08ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08ae710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009f50 tx=0x7fbe1c0118d0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe22800640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe080a3240 0x7fbe080a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe140cda20 tx=0x7fbe140d39a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 -- 172.21.15.22:0/807154403 shutdown_connections 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 --2- 172.21.15.22:0/807154403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08ae710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 -- 172.21.15.22:0/807154403 >> 172.21.15.22:0/807154403 conn(0x5598e08aa8c0 msgr2=0x5598e08aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.067+0000 7fbe2c060740 1 -- 172.21.15.22:0/807154403 shutdown_connections 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.068+0000 7fbe2c060740 1 -- 172.21.15.22:0/807154403 wait complete. 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.068+0000 7fbe2c060740 1 -- start start 2024-09-15T22:32:22.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.068+0000 7fbe2c060740 1 Processor -- start 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5598e08bc060 con 0x5598e08b9510 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598e079c920 con 0x5598e08aec50 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598e08bc1e0 con 0x5598e08ae330 2024-09-15T22:32:22.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe2c060740 10 client.0 _ll_register_callbacks cb 0x5598e07c08a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe1be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe1be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58910/0 (socket says 172.21.15.22:58910) 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe1be00640 1 -- 172.21.15.22:0/491224120 learned_addr learned my addr 172.21.15.22:0/491224120 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe23200640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.069+0000 7fbe23200640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe1be00640 1 -- 172.21.15.22:0/491224120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 msgr2=0x5598e08b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe1be00640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe1be00640 1 -- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 msgr2=0x5598e08b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe1be00640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe1be00640 1 -- 172.21.15.22:0/491224120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e05852b0 con 0x5598e08aec50 2024-09-15T22:32:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe23200640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe1be00640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b6a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02a910 tx=0x7fbe0c0317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d4972f5ad374cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe07e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe07e00640 1 -- 172.21.15.22:0/491224120 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c035040 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe1c004050 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.070+0000 7fbe07e00640 1 -- 172.21.15.22:0/491224120 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbe0c004040 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe07e00640 1 -- 172.21.15.22:0/491224120 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe0c004240 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 10 client.25031 fetch_fsmap learned FSMap version 24 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598e08c7e10 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe07e00640 1 -- 172.21.15.22:0/491224120 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe1c004050 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe07e00640 1 -- 172.21.15.22:0/491224120 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe0c004990 con 0x5598e08aec50 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 10 client.25031 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 10 client.25031 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-15T22:32:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 20 client.25031 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e08ca430 0x5598e08cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 4 client.25031 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.071+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 --> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598e0821620 con 0x5598e08ca430 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.072+0000 7fbe23200640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e08ca430 0x5598e08cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.072+0000 7fbe23200640 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e08ca430 0x5598e08cb8a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98800492175a702c server_cookie=4a4bfc24dbff2481 in_seq=0 out_seq=0 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.072+0000 7fbe07e00640 10 client.25031 ms_handle_connect on v2:172.21.15.22:6838/3141077377 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe07e00640 1 -- 172.21.15.22:0/491224120 <== mds.1 v2:172.21.15.22:6838/3141077377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598e0821620 con 0x5598e08ca430 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe07e00640 10 client.25031 handle_command_reply: tid=0 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 client.25031 shutdown 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 msgr2=0x5598e08b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b6a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02a910 tx=0x7fbe0c0317c0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 shutdown_connections 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e08ca430 0x5598e08cb8a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08b9510 0x5598e08b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08aec50 0x5598e08b6a90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 --2- 172.21.15.22:0/491224120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08ae330 0x5598e08b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 >> 172.21.15.22:0/491224120 conn(0x5598e08aa8c0 msgr2=0x5598e08b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:22.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.073+0000 7fbe07e00640 0 client.25031 ms_handle_reset on v2:172.21.15.22:6838/3141077377 2024-09-15T22:32:22.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.074+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 shutdown_connections 2024-09-15T22:32:22.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.074+0000 7fbe2c060740 1 -- 172.21.15.22:0/491224120 wait complete. 2024-09-15T22:32:22.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.074+0000 7fbe2c060740 20 client.25031 trim_cache size 0 max 16384 2024-09-15T22:32:22.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 Processor -- start 2024-09-15T22:32:22.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 -- start start 2024-09-15T22:32:22.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5598e08c9be0 con 0x5598e08ae330 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598e08ca2b0 con 0x5598e08b9510 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe2c060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598e08ca980 con 0x5598e08aec50 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe23200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe23200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40694/0 (socket says 172.21.15.22:40694) 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe23200640 1 -- 172.21.15.22:0/4046067837 learned_addr learned my addr 172.21.15.22:0/4046067837 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe1be00640 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.093+0000 7fbe23200640 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe23200640 1 -- 172.21.15.22:0/4046067837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 msgr2=0x5598e08b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe23200640 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe23200640 1 -- 172.21.15.22:0/4046067837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 msgr2=0x5598e08b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe23200640 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe23200640 1 -- 172.21.15.22:0/4046067837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e08b4ac0 con 0x5598e08ae330 2024-09-15T22:32:22.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe1be00640 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:22.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe23200640 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08b5e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009f50 tx=0x7fbe1c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed00f6fa00d974b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:22.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe12a00640 1 -- 172.21.15.22:0/4046067837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c034070 con 0x5598e08ae330 2024-09-15T22:32:22.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe12a00640 1 -- 172.21.15.22:0/4046067837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe1c0049c0 con 0x5598e08ae330 2024-09-15T22:32:22.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.094+0000 7fbe12a00640 1 -- 172.21.15.22:0/4046067837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c005580 con 0x5598e08ae330 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 -- 172.21.15.22:0/4046067837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 msgr2=0x5598e08b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08b5e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009f50 tx=0x7fbe1c005fd0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 -- 172.21.15.22:0/4046067837 shutdown_connections 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 --2- 172.21.15.22:0/4046067837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08b5e10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 -- 172.21.15.22:0/4046067837 >> 172.21.15.22:0/4046067837 conn(0x5598e08aa8c0 msgr2=0x5598e08b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:22.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 -- 172.21.15.22:0/4046067837 shutdown_connections 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.095+0000 7fbe2c060740 1 -- 172.21.15.22:0/4046067837 wait complete. 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 -- start start 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 Processor -- start 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5598e08cb720 con 0x5598e08ae330 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598e08cb050 con 0x5598e08b9510 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5598e08cbdf0 con 0x5598e08aec50 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.096+0000 7fbe2c060740 10 client.0 _ll_register_callbacks cb 0x7fbe0c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:22.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe23200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe23200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40702/0 (socket says 172.21.15.22:40702) 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe23200640 1 -- 172.21.15.22:0/1190787425 learned_addr learned my addr 172.21.15.22:0/1190787425 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe23200640 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 -- 172.21.15.22:0/1190787425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 msgr2=0x5598e08ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 -- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 msgr2=0x5598e08d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 -- 172.21.15.22:0/1190787425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e08ceff0 con 0x5598e08aec50 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe1be00640 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08d4040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c000c00 tx=0x7fbe0c004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4dd091363c3000 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.097+0000 7fbe07e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe07e00640 1 -- 172.21.15.22:0/1190787425 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c035040 con 0x5598e08aec50 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe1c0049c0 con 0x5598e08aec50 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe07e00640 1 -- 172.21.15.22:0/1190787425 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbe0c031a30 con 0x5598e08aec50 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe07e00640 1 -- 172.21.15.22:0/1190787425 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe0c031c30 con 0x5598e08aec50 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe2c060740 10 client.25045 fetch_fsmap learned FSMap version 24 2024-09-15T22:32:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598e09352c0 con 0x5598e08aec50 2024-09-15T22:32:22.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe07e00640 1 -- 172.21.15.22:0/1190787425 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe1c0049c0 con 0x5598e08aec50 2024-09-15T22:32:22.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe07e00640 1 -- 172.21.15.22:0/1190787425 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe0c0039e0 con 0x5598e08aec50 2024-09-15T22:32:22.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.098+0000 7fbe2c060740 10 client.25045 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:32:22.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe2c060740 10 client.25045 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-15T22:32:22.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe2c060740 20 client.25045 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:22.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe2c060740 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e0939e80 0x5598e0938b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe2c060740 4 client.25045 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 --> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] -- command(tid 0: {"prefix": "status"}) -- 0x5598e081bb30 con 0x5598e0939e80 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe23200640 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e0939e80 0x5598e0938b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe23200640 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e0939e80 0x5598e0938b90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c804a72a32e62dcc server_cookie=dfd78b1c808141d5 in_seq=0 out_seq=0 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.099+0000 7fbe07e00640 10 client.25045 ms_handle_connect on v2:172.21.15.22:6838/3141077377 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe07e00640 1 -- 172.21.15.22:0/1190787425 <== mds.1 v2:172.21.15.22:6838/3141077377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5598e081bb30 con 0x5598e0939e80 2024-09-15T22:32:22.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe07e00640 10 client.25045 handle_command_reply: tid=0 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 client.25045 shutdown 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 msgr2=0x5598e08d4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08d4040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c000c00 tx=0x7fbe0c004610 comp rx=0 tx=0).stop 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 shutdown_connections 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:6838/3141077377,v1:172.21.15.22:6839/3141077377] conn(0x5598e0939e80 0x5598e0938b90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5598e08aec50 0x5598e08d4040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598e08b9510 0x5598e08ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 --2- 172.21.15.22:0/1190787425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598e08ae330 0x5598e08d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe07e00640 0 client.25045 ms_handle_reset on v2:172.21.15.22:6838/3141077377 2024-09-15T22:32:22.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 >> 172.21.15.22:0/1190787425 conn(0x5598e08aa8c0 msgr2=0x5598e08b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:22.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 shutdown_connections 2024-09-15T22:32:22.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 1 -- 172.21.15.22:0/1190787425 wait complete. 2024-09-15T22:32:22.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.100+0000 7fbe2c060740 20 client.25045 trim_cache size 0 max 16384 2024-09-15T22:32:22.110 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24530, 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-15T22:32:22.111 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 106.46989916299999, 2024-09-15T22:32:22.112 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-09-15T22:32:22.112 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-15T22:32:22.112 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 79, 2024-09-15T22:32:22.112 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 138.19081044500001 2024-09-15T22:32:22.112 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:32:22.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe080a3240 msgr2=0x7fbe080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe080a3240 0x7fbe080a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe140cda20 tx=0x7fbe140d39a0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 msgr2=0x7fbe240744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:22.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe240744f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400e9f0 tx=0x7fbe1400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 shutdown_connections 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe24102780 0x7fbe24074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe080a3240 0x7fbe080a5700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe24106f00 0x7fbe24074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 --2- 172.21.15.22:0/2954408509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe24101dd0 0x7fbe240744f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 >> 172.21.15.22:0/2954408509 conn(0x7fbe240fd890 msgr2=0x7fbe240fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 shutdown_connections 2024-09-15T22:32:22.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:22.101+0000 7fbe29400640 1 -- 172.21.15.22:0/2954408509 wait complete. 2024-09-15T22:32:22.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:32:23.241 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:23.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:23 smithi022 ceph-mon[30634]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-15T22:32:23.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:23 smithi110 ceph-mon[35282]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-15T22:32:23.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 -- 172.21.15.22:0/1975320680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 msgr2=0x7fa4a8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/1975320680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a8108830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa490009900 tx=0x7fa49002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 -- 172.21.15.22:0/1975320680 shutdown_connections 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/1975320680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a8108f60 0x7fa4a8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/1975320680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a8108830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/1975320680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4a8103e30 0x7fa4a8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 -- 172.21.15.22:0/1975320680 >> 172.21.15.22:0/1975320680 conn(0x7fa4a80ff8d0 msgr2=0x7fa4a8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 -- 172.21.15.22:0/1975320680 shutdown_connections 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.785+0000 7fa4a7e00640 1 -- 172.21.15.22:0/1975320680 wait complete. 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.786+0000 7fa4a7e00640 1 Processor -- start 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.786+0000 7fa4a7e00640 1 -- start start 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a8103e30 0x7fa4a819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4a8108f60 0x7fa4a819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8113fd0 con 0x7fa4a81047e0 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8113e50 con 0x7fa4a8103e30 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8114150 con 0x7fa4a8108f60 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a8103e30 0x7fa4a819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40716/0 (socket says 172.21.15.22:40716) 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa49fe00640 1 -- 172.21.15.22:0/202522330 learned_addr learned my addr 172.21.15.22:0/202522330 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.787+0000 7fa4a7400640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4a8108f60 0x7fa4a819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49fe00640 1 -- 172.21.15.22:0/202522330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4a8108f60 msgr2=0x7fa4a819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49fe00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4a8108f60 0x7fa4a819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49fe00640 1 -- 172.21.15.22:0/202522330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a8103e30 msgr2=0x7fa4a819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49fe00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a8103e30 0x7fa4a819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49fe00640 1 -- 172.21.15.22:0/202522330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a819f440 con 0x7fa4a81047e0 2024-09-15T22:32:23.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49fe00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a819a9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa490004770 tx=0x7fa490003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:23.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49f400640 1 -- 172.21.15.22:0/202522330 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49003f070 con 0x7fa4a81047e0 2024-09-15T22:32:23.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49f400640 1 -- 172.21.15.22:0/202522330 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa490031ca0 con 0x7fa4a81047e0 2024-09-15T22:32:23.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a819f6d0 con 0x7fa4a81047e0 2024-09-15T22:32:23.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa49f400640 1 -- 172.21.15.22:0/202522330 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490035030 con 0x7fa4a81047e0 2024-09-15T22:32:23.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.788+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a81a7010 con 0x7fa4a81047e0 2024-09-15T22:32:23.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.792+0000 7fa49f400640 1 -- 172.21.15.22:0/202522330 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa490042070 con 0x7fa4a81047e0 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.792+0000 7fa4b05f4740 1 Processor -- start 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.792+0000 7fa4b05f4740 1 -- start start 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.792+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bca4e0 0x55da68bca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.792+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 0x55da68bd5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da68b300b0 con 0x55da68bca4e0 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55da68ad7ab0 con 0x55da68bcae00 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55da68b2c070 con 0x55da68bd56c0 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bca4e0 0x55da68bca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 0x55da68bd5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 0x55da68bd5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58964/0 (socket says 172.21.15.22:58964) 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2577881559 learned_addr learned my addr 172.21.15.22:0/2577881559 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:23.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2577881559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 msgr2=0x55da68bd7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2577881559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bca4e0 msgr2=0x55da68bca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bca4e0 0x55da68bca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2577881559 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da68ae44a0 con 0x55da68bcae00 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.793+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa49f400640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa48c0a32c0 0x7fa48c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 0x55da68bd5180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa49800bd10 tx=0x7fa4980107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9edc6c8eb8f79a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa49f400640 1 -- 172.21.15.22:0/202522330 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fa4900efff0 con 0x7fa4a81047e0 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa4a7400640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa48c0a32c0 0x7fa48c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa497e00640 1 -- 172.21.15.22:0/2577881559 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498004030 con 0x55da68bcae00 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa497e00640 1 -- 172.21.15.22:0/2577881559 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4980041d0 con 0x55da68bcae00 2024-09-15T22:32:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.794+0000 7fa497e00640 1 -- 172.21.15.22:0/2577881559 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4980117e0 con 0x55da68bcae00 2024-09-15T22:32:23.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2577881559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 msgr2=0x55da68bd5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4a7400640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa48c0a32c0 0x7fa48c0a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0005fd0 tx=0x7fa4a00096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 0x55da68bd5180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa49800bd10 tx=0x7fa4980107a0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2577881559 shutdown_connections 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bcae00 0x55da68bd5180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2577881559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bca4e0 0x55da68bca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2577881559 >> 172.21.15.22:0/2577881559 conn(0x55da68bc6a70 msgr2=0x55da68bc6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2577881559 shutdown_connections 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2577881559 wait complete. 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.795+0000 7fa4b05f4740 1 -- start start 2024-09-15T22:32:23.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 Processor -- start 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bd25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da68bd8330 con 0x55da68bcae00 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55da68ab8920 con 0x55da68bca4e0 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55da68bd84b0 con 0x55da68bd56c0 2024-09-15T22:32:23.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4b05f4740 10 client.0 _ll_register_callbacks cb 0x55da68adc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bd25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.796+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bd25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58980/0 (socket says 172.21.15.22:58980) 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa4a6a00640 1 -- 172.21.15.22:0/3558747659 learned_addr learned my addr 172.21.15.22:0/3558747659 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa4a7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa49fe00640 1 -- 172.21.15.22:0/3558747659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 msgr2=0x55da68bd3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa49fe00640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa49fe00640 1 -- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 msgr2=0x55da68bd25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa49fe00640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bd25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa49fe00640 1 -- 172.21.15.22:0/3558747659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da688a12b0 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa4a7400640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bd25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa49fe00640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd2ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa4900edaa0 tx=0x7fa49003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40817b16676b1f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa494c00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.797+0000 7fa494c00640 1 -- 172.21.15.22:0/3558747659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490049050 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa494c00640 1 -- 172.21.15.22:0/3558747659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fa4900b8d10 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4980041d0 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa494c00640 1 -- 172.21.15.22:0/3558747659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa4900bc000 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 10 client.15024 fetch_fsmap learned FSMap version 24 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da68be3fe0 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa494c00640 1 -- 172.21.15.22:0/3558747659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4980041d0 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa494c00640 1 -- 172.21.15.22:0/3558747659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa49003b5f0 con 0x55da68bcae00 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 10 client.15024 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:32:23.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 10 client.15024 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:32:23.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 20 client.15024 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:23.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.798+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68be6630 0x55da68be7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.799+0000 7fa4b05f4740 4 client.15024 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:32:23.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.799+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da68b3d620 con 0x55da68be6630 2024-09-15T22:32:23.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.799+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68be6630 0x55da68be7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.799+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68be6630 0x55da68be7aa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2dd7724e7ffd8e4 server_cookie=d4c9eae055923127 in_seq=0 out_seq=0 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.799+0000 7fa494c00640 10 client.15024 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa494c00640 1 -- 172.21.15.22:0/3558747659 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da68b3d620 con 0x55da68be6630 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa494c00640 10 client.15024 handle_command_reply: tid=0 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 client.15024 shutdown 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 msgr2=0x55da68bd2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd2ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa4900edaa0 tx=0x7fa49003b460 comp rx=0 tx=0).stop 2024-09-15T22:32:23.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 shutdown_connections 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68be6630 0x55da68be7aa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68bd3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd2ae0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/3558747659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bd25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa494c00640 0 client.15024 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.800+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 >> 172.21.15.22:0/3558747659 conn(0x55da68bc6a70 msgr2=0x55da68bcc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.801+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 shutdown_connections 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.801+0000 7fa4b05f4740 1 -- 172.21.15.22:0/3558747659 wait complete. 2024-09-15T22:32:23.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.801+0000 7fa4b05f4740 20 client.15024 trim_cache size 0 max 16384 2024-09-15T22:32:23.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 Processor -- start 2024-09-15T22:32:23.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 -- start start 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bca4e0 0x55da68bd0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bd56c0 0x55da68bcf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da68be5de0 con 0x55da68bcae00 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55da68be64b0 con 0x55da68bd56c0 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55da68be6b80 con 0x55da68bca4e0 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40736/0 (socket says 172.21.15.22:40736) 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa49fe00640 1 -- 172.21.15.22:0/2583602724 learned_addr learned my addr 172.21.15.22:0/2583602724 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4a7400640 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bd56c0 0x55da68bcf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.820+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bca4e0 0x55da68bd0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa49fe00640 1 -- 172.21.15.22:0/2583602724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bca4e0 msgr2=0x55da68bd0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bca4e0 0x55da68bd0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa49fe00640 1 -- 172.21.15.22:0/2583602724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bd56c0 msgr2=0x55da68bcf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bd56c0 0x55da68bcf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa49fe00640 1 -- 172.21.15.22:0/2583602724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da68bca310 con 0x55da68bcae00 2024-09-15T22:32:23.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd13b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa4900c52b0 tx=0x7fa4900b8300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f8de4029aecbea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa497400640 1 -- 172.21.15.22:0/2583602724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490049070 con 0x55da68bcae00 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa497400640 1 -- 172.21.15.22:0/2583602724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4900bc6a0 con 0x55da68bcae00 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.821+0000 7fa497400640 1 -- 172.21.15.22:0/2583602724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4900bbaf0 con 0x55da68bcae00 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2583602724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 msgr2=0x55da68bd13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd13b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa4900c52b0 tx=0x7fa4900b8300 comp rx=0 tx=0).stop 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2583602724 shutdown_connections 2024-09-15T22:32:23.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bd56c0 0x55da68bcf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68bd13b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2583602724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bca4e0 0x55da68bd0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2583602724 >> 172.21.15.22:0/2583602724 conn(0x55da68bc6a70 msgr2=0x55da68bc6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2583602724 shutdown_connections 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.822+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2583602724 wait complete. 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 -- start start 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 Processor -- start 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bf0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68be9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68be9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da68be7920 con 0x55da68bcae00 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55da68be7250 con 0x55da68bca4e0 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55da68be7ff0 con 0x55da68bd56c0 2024-09-15T22:32:23.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa4b05f4740 10 client.0 _ll_register_callbacks cb 0x7fa490009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.823+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68be9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bf0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bf0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59000/0 (socket says 172.21.15.22:59000) 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2535694720 learned_addr learned my addr 172.21.15.22:0/2535694720 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68be9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40752/0 (socket says 172.21.15.22:40752) 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a7400640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68be9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2535694720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 msgr2=0x55da68be9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68be9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2535694720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 msgr2=0x55da68be9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68be9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 -- 172.21.15.22:0/2535694720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da68bea270 con 0x55da68bca4e0 2024-09-15T22:32:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa4a6a00640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bf0310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa498003f30 tx=0x7fa49800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90dc850f37d78378 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.824+0000 7fa494c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:32:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa494c00640 1 -- 172.21.15.22:0/2535694720 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498034060 con 0x55da68bca4e0 2024-09-15T22:32:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4900bc6a0 con 0x55da68bca4e0 2024-09-15T22:32:23.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa494c00640 1 -- 172.21.15.22:0/2535694720 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fa498005450 con 0x55da68bca4e0 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa494c00640 1 -- 172.21.15.22:0/2535694720 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa498005650 con 0x55da68bca4e0 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa4b05f4740 10 client.25055 fetch_fsmap learned FSMap version 24 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da68c50d40 con 0x55da68bca4e0 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa494c00640 1 -- 172.21.15.22:0/2535694720 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4900bc6a0 con 0x55da68bca4e0 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa494c00640 1 -- 172.21.15.22:0/2535694720 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa498039070 con 0x55da68bca4e0 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.825+0000 7fa4b05f4740 10 client.25055 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa4b05f4740 10 client.25055 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa4b05f4740 20 client.25055 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:23.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68c55530 0x55da68c54240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa4b05f4740 4 client.25055 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "status"}) -- 0x55da68b37b30 con 0x55da68c55530 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68c55530 0x55da68c54240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa49fe00640 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68c55530 0x55da68c54240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54f96449ae6a3927 server_cookie=a3d196b79ab82cc5 in_seq=0 out_seq=0 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa494c00640 10 client.25055 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa494c00640 1 -- 172.21.15.22:0/2535694720 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55da68b37b30 con 0x55da68c55530 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa494c00640 10 client.25055 handle_command_reply: tid=0 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.826+0000 7fa4b05f4740 1 client.25055 shutdown 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 msgr2=0x55da68bf0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bf0310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa498003f30 tx=0x7fa49800bea0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 shutdown_connections 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55da68c55530 0x55da68c54240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da68bd56c0 0x55da68be9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da68bcae00 0x55da68be9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 --2- 172.21.15.22:0/2535694720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da68bca4e0 0x55da68bf0310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 >> 172.21.15.22:0/2535694720 conn(0x55da68bc6a70 msgr2=0x55da68bd0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa494c00640 0 client.25055 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 shutdown_connections 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 1 -- 172.21.15.22:0/2535694720 wait complete. 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.827+0000 7fa4b05f4740 20 client.25055 trim_cache size 0 max 16384 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "d3c50556-73b0-11ef-bceb-c7b262605968", 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-15T22:32:23.832 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24548, 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 118.304380284, 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 24, 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 79, 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 133.53956959300001 2024-09-15T22:32:23.833 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa48c0a32c0 msgr2=0x7fa48c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa48c0a32c0 0x7fa48c0a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0005fd0 tx=0x7fa4a00096a0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 msgr2=0x7fa4a819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a819a9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa490004770 tx=0x7fa490003c10 comp rx=0 tx=0).stop 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 shutdown_connections 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4a8108f60 0x7fa4a819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fa48c0a32c0 0x7fa48c0a5780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4a81047e0 0x7fa4a819a9d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 --2- 172.21.15.22:0/202522330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a8103e30 0x7fa4a819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:23.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 >> 172.21.15.22:0/202522330 conn(0x7fa4a80ff8d0 msgr2=0x7fa4a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:23.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 shutdown_connections 2024-09-15T22:32:23.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:23.828+0000 7fa4a7e00640 1 -- 172.21.15.22:0/202522330 wait complete. 2024-09-15T22:32:23.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:23 smithi112 ceph-mon[35032]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-15T22:32:24.608 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:32:24.617 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:32:24.617 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:32:24.618 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:32:24.618 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:32:24.652 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:32:24.652 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-15T22:32:24.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:24.652 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-15T22:32:24.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:24.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-15T22:32:24.787 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-09-15T22:32:24.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:32:24.790 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-15T22:32:24.791 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:32:24.791 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:24.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:32:25.171 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:32:25.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:25 smithi022 ceph-mon[30634]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-15T22:32:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:25 smithi110 ceph-mon[35282]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 -- 172.21.15.22:0/2972746834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc103ff0 msgr2=0x7f07cc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 --2- 172.21.15.22:0/2972746834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc103ff0 0x7f07cc1043d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009900 tx=0x7f07bc02a410 comp rx=0 tx=0).stop 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 -- 172.21.15.22:0/2972746834 shutdown_connections 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 --2- 172.21.15.22:0/2972746834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc109120 0x7f07cc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 --2- 172.21.15.22:0/2972746834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 0x7f07cc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 --2- 172.21.15.22:0/2972746834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc103ff0 0x7f07cc1043d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 -- 172.21.15.22:0/2972746834 >> 172.21.15.22:0/2972746834 conn(0x7f07cc0ffa90 msgr2=0x7f07cc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 -- 172.21.15.22:0/2972746834 shutdown_connections 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.709+0000 7f07d2a00640 1 -- 172.21.15.22:0/2972746834 wait complete. 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.710+0000 7f07d2a00640 1 Processor -- start 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.710+0000 7f07d2a00640 1 -- start start 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc103ff0 0x7f07cc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 0x7f07cc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 0x7f07cc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d2a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc114120 con 0x7f07cc109120 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d2a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc113fa0 con 0x7f07cc1049a0 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d2a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc1142a0 con 0x7f07cc103ff0 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 0x7f07cc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 0x7f07cc19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40770/0 (socket says 172.21.15.22:40770) 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07d0a00640 1 -- 172.21.15.22:0/566919326 learned_addr learned my addr 172.21.15.22:0/566919326 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:25.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07cbe00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc103ff0 0x7f07cc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07cb400640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 0x7f07cc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07cb400640 1 -- 172.21.15.22:0/566919326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc103ff0 msgr2=0x7f07cc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.711+0000 7f07cb400640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc103ff0 0x7f07cc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07cb400640 1 -- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 msgr2=0x7f07cc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07cb400640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 0x7f07cc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07cb400640 1 -- 172.21.15.22:0/566919326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc19f5d0 con 0x7f07cc1049a0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07d0a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 0x7f07cc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07cb400640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 0x7f07cc19ab60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07b800e9f0 tx=0x7f07b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b800ccc0 con 0x7f07cc1049a0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07b8010910 con 0x7f07cc1049a0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc19f8c0 con 0x7f07cc1049a0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8018960 con 0x7f07cc1049a0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.712+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc1a71a0 con 0x7f07cc1049a0 2024-09-15T22:32:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.713+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc1043d0 con 0x7f07cc1049a0 2024-09-15T22:32:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.716+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f07b8010ac0 con 0x7f07cc1049a0 2024-09-15T22:32:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.717+0000 7f07c8c00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07b00a3240 0x7f07b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.717+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f07b80cfe50 con 0x7f07cc1049a0 2024-09-15T22:32:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.717+0000 7f07cbe00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07b00a3240 0x7f07b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.718+0000 7f07cbe00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07b00a3240 0x7f07b00a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009230 tx=0x7f07bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.719+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07b809c4e0 con 0x7f07cc1049a0 2024-09-15T22:32:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:25 smithi112 ceph-mon[35032]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-15T22:32:25.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.942+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07cc02d7c0 con 0x7f07cc1049a0 2024-09-15T22:32:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.942+0000 7f07c8c00640 1 -- 172.21.15.22:0/566919326 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f07b80a07e0 con 0x7f07cc1049a0 2024-09-15T22:32:25.943 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:32:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07b00a3240 msgr2=0x7f07b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07b00a3240 0x7f07b00a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009230 tx=0x7f07bc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 msgr2=0x7f07cc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 0x7f07cc19ab60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07b800e9f0 tx=0x7f07b800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 shutdown_connections 2024-09-15T22:32:25.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f07b00a3240 0x7f07b00a5700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07cc109120 0x7f07cc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07cc1049a0 0x7f07cc19ab60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 --2- 172.21.15.22:0/566919326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07cc103ff0 0x7f07cc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.945+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 >> 172.21.15.22:0/566919326 conn(0x7f07cc0ffa90 msgr2=0x7f07cc100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.946+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 shutdown_connections 2024-09-15T22:32:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:25.946+0000 7f07d2a00640 1 -- 172.21.15.22:0/566919326 wait complete. 2024-09-15T22:32:26.626 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:26 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/566919326' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:32:26.665 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:32:26.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:32:26.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:26.667 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-09-15T22:32:26.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:26 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/566919326' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:32:26.707 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:32:26.708 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42113sec preferred_lft 42113sec 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:32:26.709 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-09-15T22:32:26.710 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:32:26.711 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-15T22:32:26.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:32:26.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:26 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/566919326' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:32:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:27.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:27.132 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:32:27.189 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-09-15T22:32:27.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:27.192 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-09-15T22:32:27.248 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-09-15T22:32:27.249 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:32:27.249 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-15T22:32:27.249 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-15T22:32:27.249 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:32:27.250 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:32:27.250 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-15T22:32:27.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:32:27.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:32:27.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:32:27.250 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-15T22:32:27.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:32:27.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:27 smithi022 ceph-mon[30634]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-15T22:32:27.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:27 smithi110 ceph-mon[35282]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-15T22:32:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:27 smithi112 ceph-mon[35032]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-15T22:32:27.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:27.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:27.868 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-15T22:32:27.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:27.905 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-09-15T22:32:27.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:32:27.981 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-15T22:32:27.981 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:32:27.981 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:32:27.981 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-15T22:32:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:32:28.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:28.160 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:32:28.160 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:32:28.160 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-15T22:32:28.160 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:32:28.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:32:28.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:32:28.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:32:28.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:32:28.161 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-15T22:32:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:32:28.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:28.433 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:32:28.433 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-15T22:32:28.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-09-15T22:32:28.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:32:28.433 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-15T22:32:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:32:28.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:28.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:32:28.603 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:28.638 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:32:28.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:32:28.639 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:28.713 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-15T22:32:28.713 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-15T22:32:28.713 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/8bb874de-be6f-4ccc-b8bb-907598e7f380 2024-09-15T22:32:28.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:28.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/8bb874de-be6f-4ccc-b8bb-907598e7f380 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-15T22:32:28.875 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-15T22:32:28.876 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-15T22:32:29.560 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-15T22:32:29.560 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-15T22:32:29.561 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.110:6789,172.21.15.112:6789" 2024-09-15T22:32:29.561 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@d3c50556-73b0-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/8bb874de-be6f-4ccc-b8bb-907598e7f380 2024-09-15T22:32:29.561 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.22:6789/172.21.15.110:6789/172.21.15.112:6789" will pass to kernel 2024-09-15T22:32:29.564 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:32:29.564 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:32:29.564 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:32:29.564 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:32:29.564 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:32:29.567 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:32:29.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:32:29.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:29.627 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:32:29.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:29 smithi110 ceph-mon[35282]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:29.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:32:29.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:29.723 INFO:teuthology.orchestra.run.smithi022.stdout:client25064 2024-09-15T22:32:29.723 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:32:29.723 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:32:29.759 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:32:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:29 smithi022 ceph-mon[30634]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:29.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:29 smithi112 ceph-mon[35032]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-15T22:32:29.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:32:29.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:29.875 INFO:teuthology.orchestra.run.smithi022.stdout:client25064 2024-09-15T22:32:29.875 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:32:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:32:29.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:29.965 INFO:teuthology.orchestra.run.smithi022.stdout:client25064 2024-09-15T22:32:29.966 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d3c50556-73b0-11ef-bceb-c7b262605968.client25064/status') 2024-09-15T22:32:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:32:30.069 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.25064 (3)172.21.15.22:0/2463294732 2024-09-15T22:32:30.069 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2024-09-15T22:32:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2024-09-15T22:32:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2024-09-15T22:32:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:71 bytes copied, 5.7152e-05 s, 1.2 MB/s 2024-09-15T22:32:30.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:32:30.080 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T22:32:30.090 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:32:30.090 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:32:30.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 -- 172.21.15.22:0/3400258604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660104f50 msgr2=0x7f16601053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 --2- 172.21.15.22:0/3400258604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660104f50 0x7f16601053d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f164c009900 tx=0x7f164c02a410 comp rx=0 tx=0).stop 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 -- 172.21.15.22:0/3400258604 shutdown_connections 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 --2- 172.21.15.22:0/3400258604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1660105910 0x7f166010c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 --2- 172.21.15.22:0/3400258604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660104f50 0x7f16601053d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 --2- 172.21.15.22:0/3400258604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1660103d60 0x7f1660104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:30.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 -- 172.21.15.22:0/3400258604 >> 172.21.15.22:0/3400258604 conn(0x7f16600ff4e0 msgr2=0x7f1660101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:30.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 -- 172.21.15.22:0/3400258604 shutdown_connections 2024-09-15T22:32:30.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.249+0000 7f1667e00640 1 -- 172.21.15.22:0/3400258604 wait complete. 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 Processor -- start 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 -- start start 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 0x7f1660199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1660104f50 0x7f166019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1660105910 0x7f16601a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f166010fa30 con 0x7f1660103d60 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f166010f8b0 con 0x7f1660105910 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.250+0000 7f1667e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f166010fbb0 con 0x7f1660104f50 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 0x7f1660199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:30.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1664a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1660104f50 0x7f166019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 0x7f1660199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56034/0 (socket says 172.21.15.22:56034) 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 -- 172.21.15.22:0/1048448690 learned_addr learned my addr 172.21.15.22:0/1048448690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1660105910 0x7f16601a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 -- 172.21.15.22:0/1048448690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1660104f50 msgr2=0x7f166019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1660104f50 0x7f166019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 -- 172.21.15.22:0/1048448690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1660105910 msgr2=0x7f16601a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1660105910 0x7f16601a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 -- 172.21.15.22:0/1048448690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16601a1bc0 con 0x7f1660103d60 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.251+0000 7f1665400640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 0x7f1660199fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f165400e9c0 tx=0x7f165400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.252+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165400cd80 con 0x7f1660103d60 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.252+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16540035f0 con 0x7f1660103d60 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.252+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16601a1eb0 con 0x7f1660103d60 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.252+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654010690 con 0x7f1660103d60 2024-09-15T22:32:30.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.252+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16601a2310 con 0x7f1660103d60 2024-09-15T22:32:30.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.253+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166010b080 con 0x7f1660103d60 2024-09-15T22:32:30.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.255+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f16540037a0 con 0x7f1660103d60 2024-09-15T22:32:30.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.256+0000 7f165e000640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16480a32f0 0x7f16480a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:30.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.256+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f16540cfd10 con 0x7f1660103d60 2024-09-15T22:32:30.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.256+0000 7f1664a00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16480a32f0 0x7f16480a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:30.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.257+0000 7f1664a00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16480a32f0 0x7f16480a57b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f164c031440 tx=0x7f164c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:30.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.260+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16540d5020 con 0x7f1660103d60 2024-09-15T22:32:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:30.481+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f1660062ef0 con 0x7f1660103d60 2024-09-15T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.458+0000 7f165e000640 1 -- 172.21.15.22:0/1048448690 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f165409c9f0 con 0x7f1660103d60 2024-09-15T22:32:31.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16480a32f0 msgr2=0x7f16480a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16480a32f0 0x7f16480a57b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f164c031440 tx=0x7f164c0315b0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 msgr2=0x7f1660199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 0x7f1660199fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f165400e9c0 tx=0x7f165400ee80 comp rx=0 tx=0).stop 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 shutdown_connections 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1660104f50 0x7f166019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16480a32f0 0x7f16480a57b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1660105910 0x7f16601a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 --2- 172.21.15.22:0/1048448690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1660103d60 0x7f1660199fa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 >> 172.21.15.22:0/1048448690 conn(0x7f16600ff4e0 msgr2=0x7f1660108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 shutdown_connections 2024-09-15T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.462+0000 7f1667e00640 1 -- 172.21.15.22:0/1048448690 wait complete. 2024-09-15T22:32:31.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-15T22:32:31.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 -- 172.21.15.22:0/3835778656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc103d60 msgr2=0x7fe9bc104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/3835778656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc103d60 0x7fe9bc104160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009be0 tx=0x7fe9ac02a6c0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 -- 172.21.15.22:0/3835778656 shutdown_connections 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/3835778656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9bc105910 0x7fe9bc10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/3835778656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9bc104f50 0x7fe9bc1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/3835778656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc103d60 0x7fe9bc104160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 -- 172.21.15.22:0/3835778656 >> 172.21.15.22:0/3835778656 conn(0x7fe9bc0ff4e0 msgr2=0x7fe9bc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 -- 172.21.15.22:0/3835778656 shutdown_connections 2024-09-15T22:32:31.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.648+0000 7fe9c2c00640 1 -- 172.21.15.22:0/3835778656 wait complete. 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.649+0000 7fe9c2c00640 1 Processor -- start 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.649+0000 7fe9c2c00640 1 -- start start 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c2c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9bc103d60 0x7fe9bc199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c2c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9bc104f50 0x7fe9bc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c2c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 0x7fe9bc1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c2c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc10f970 con 0x7fe9bc103d60 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c2c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc10f7f0 con 0x7fe9bc105910 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c2c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc10faf0 con 0x7fe9bc104f50 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9bbe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9bc103d60 0x7fe9bc199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:31.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 0x7fe9bc1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 0x7fe9bc1a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:52284/0 (socket says 172.21.15.22:52284) 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 -- 172.21.15.22:0/2557371594 learned_addr learned my addr 172.21.15.22:0/2557371594 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9b3400640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9bc104f50 0x7fe9bc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 -- 172.21.15.22:0/2557371594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9bc104f50 msgr2=0x7fe9bc19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9bc104f50 0x7fe9bc19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 -- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9bc103d60 msgr2=0x7fe9bc199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.650+0000 7fe9c0c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9bc103d60 0x7fe9bc199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9c0c00640 1 -- 172.21.15.22:0/2557371594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc1a1bf0 con 0x7fe9bc105910 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9c0c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 0x7fe9bc1a1580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400e970 tx=0x7fe9b400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400ccc0 con 0x7fe9bc105910 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b400ce60 con 0x7fe9bc105910 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4010430 con 0x7fe9bc105910 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc1a1ee0 con 0x7fe9bc105910 2024-09-15T22:32:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.651+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1a2350 con 0x7fe9bc105910 2024-09-15T22:32:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.652+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc10b1a0 con 0x7fe9bc105910 2024-09-15T22:32:31.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.654+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe9b4005020 con 0x7fe9bc105910 2024-09-15T22:32:31.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.655+0000 7fe9b9600640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9a00a32f0 0x7fe9a00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:31.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.656+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe9b40cff70 con 0x7fe9bc105910 2024-09-15T22:32:31.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.656+0000 7fe9bbe00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9a00a32f0 0x7fe9a00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:31.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.656+0000 7fe9bbe00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9a00a32f0 0x7fe9a00a57b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006010 tx=0x7fe9ac000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:31.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.658+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9b409cc50 con 0x7fe9bc105910 2024-09-15T22:32:31.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-mon[30634]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:31.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1048448690' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-15T22:32:31.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:31 smithi112 ceph-mon[35032]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:31.858 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:31 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1048448690' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-15T22:32:31.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.873+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 --> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fe9bc0626d0 con 0x7fe9a00a32f0 2024-09-15T22:32:31.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.894+0000 7fe9b9600640 1 -- 172.21.15.22:0/2557371594 <== mgr.14150 v2:172.21.15.22:6800/191438634 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fe9bc0626d0 con 0x7fe9a00a32f0 2024-09-15T22:32:31.900 INFO:teuthology.orchestra.run.smithi022.stdout:{} 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9a00a32f0 msgr2=0x7fe9a00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9a00a32f0 0x7fe9a00a57b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006010 tx=0x7fe9ac000f40 comp rx=0 tx=0).stop 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 msgr2=0x7fe9bc1a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 0x7fe9bc1a1580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400e970 tx=0x7fe9b400ed70 comp rx=0 tx=0).stop 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 shutdown_connections 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9bc104f50 0x7fe9bc19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9a00a32f0 0x7fe9a00a57b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9bc105910 0x7fe9bc1a1580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 --2- 172.21.15.22:0/2557371594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9bc103d60 0x7fe9bc199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:31.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 >> 172.21.15.22:0/2557371594 conn(0x7fe9bc0ff4e0 msgr2=0x7fe9bc108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:31.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 shutdown_connections 2024-09-15T22:32:31.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:32:31.896+0000 7fe9c2c00640 1 -- 172.21.15.22:0/2557371594 wait complete. 2024-09-15T22:32:31.923 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T22:32:32.004 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-15T22:32:32.190 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:32:32.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-15T22:32:32.191 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:31 smithi110 ceph-mon[35282]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-15T22:32:32.191 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:31 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1048448690' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-15T22:32:32.194 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T22:32:32.238 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:32:32.238 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T22:32:32.238 INFO:tasks.workunit:timeout=3h 2024-09-15T22:32:32.238 INFO:tasks.workunit:cleanup=True 2024-09-15T22:32:32.239 DEBUG:teuthology.orchestra.run.smithi022:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:32.239 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:32:31.879+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:32:32.240 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:32:31.879+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:32:32.240 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:32:31.879+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:32:32.240 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:32:31.879+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:32:32.240 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:32:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:32:31.879+0000 7f4f6da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:32:32.274 INFO:teuthology.orchestra.run.smithi022.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:32.274 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-15 22:30:48.809906957 +0000 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-15 22:30:48.809906957 +0000 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-15 22:32:29.621957177 +0000 2024-09-15T22:32:32.275 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-15 22:30:48.809906957 +0000 2024-09-15T22:32:32.275 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T22:32:32.275 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T22:32:32.383 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:32:32.421 INFO:tasks.workunit.client.0.smithi022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T22:32:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:32 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1048448690' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-15T22:32:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:32 smithi022 ceph-mon[30634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:32:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:32 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1048448690' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-15T22:32:32.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:32 smithi112 ceph-mon[35032]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:32:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:32 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1048448690' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-15T22:32:32.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:32 smithi110 ceph-mon[35282]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-15T22:32:33.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:33 smithi022 ceph-mon[30634]: pgmap v352: 97 pgs: 97 active+clean; 645 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:32:33.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:33 smithi022 ceph-mon[30634]: from='client.25076 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:33.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:33 smithi112 ceph-mon[35032]: pgmap v352: 97 pgs: 97 active+clean; 645 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:32:33.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:33 smithi112 ceph-mon[35032]: from='client.25076 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:33 smithi110 ceph-mon[35282]: pgmap v352: 97 pgs: 97 active+clean; 645 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:32:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:33 smithi110 ceph-mon[35282]: from='client.25076 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:32:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:35 smithi022 ceph-mon[30634]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-15T22:32:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:35 smithi022 ceph-mon[30634]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:32:35.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:35 smithi112 ceph-mon[35032]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-15T22:32:35.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:35 smithi112 ceph-mon[35032]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:32:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:35 smithi110 ceph-mon[35282]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-15T22:32:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:35 smithi110 ceph-mon[35282]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:32:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:37 smithi022 ceph-mon[30634]: pgmap v354: 97 pgs: 97 active+clean; 646 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-15T22:32:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:37 smithi112 ceph-mon[35032]: pgmap v354: 97 pgs: 97 active+clean; 646 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-15T22:32:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:37 smithi110 ceph-mon[35282]: pgmap v354: 97 pgs: 97 active+clean; 646 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-15T22:32:38.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:38 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:32:38.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:38 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:32:38.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:38 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:32:39.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:39 smithi022 ceph-mon[30634]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-15T22:32:39.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:39 smithi112 ceph-mon[35032]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-15T22:32:39.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:39 smithi110 ceph-mon[35282]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: pgmap v356: 97 pgs: 97 active+clean; 653 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:40 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: pgmap v356: 97 pgs: 97 active+clean; 653 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:40.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:40 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: pgmap v356: 97 pgs: 97 active+clean; 653 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:40 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:32:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:32:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:41 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:42.025 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:32:42.025 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:32:42.025 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:41 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:42.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:32:42.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:32:42.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:41 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:32:43.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:42 smithi022 ceph-mon[30634]: pgmap v357: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-15T22:32:43.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:42 smithi112 ceph-mon[35032]: pgmap v357: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-15T22:32:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:42 smithi110 ceph-mon[35282]: pgmap v357: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-15T22:32:45.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:44 smithi022 ceph-mon[30634]: pgmap v358: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-15T22:32:45.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:44 smithi112 ceph-mon[35032]: pgmap v358: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-15T22:32:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.398+0000 7f4be9200640 1 -- 172.21.15.22:0/3484607618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 msgr2=0x7f4be41070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.398+0000 7f4be9200640 1 --2- 172.21.15.22:0/3484607618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41070e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009860 tx=0x7f4bd002a340 comp rx=0 tx=0).stop 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 -- 172.21.15.22:0/3484607618 shutdown_connections 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 --2- 172.21.15.22:0/3484607618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41070e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 --2- 172.21.15.22:0/3484607618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be4107620 0x7f4be4109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 --2- 172.21.15.22:0/3484607618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be41023c0 0x7f4be41047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 -- 172.21.15.22:0/3484607618 >> 172.21.15.22:0/3484607618 conn(0x7f4be40fbfa0 msgr2=0x7f4be40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 -- 172.21.15.22:0/3484607618 shutdown_connections 2024-09-15T22:32:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 -- 172.21.15.22:0/3484607618 wait complete. 2024-09-15T22:32:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.399+0000 7f4be9200640 1 Processor -- start 2024-09-15T22:32:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 -- start start 2024-09-15T22:32:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 0x7f4be4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be4107620 0x7f4be419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410d5f0 con 0x7f4be41023c0 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410d470 con 0x7f4be4107620 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be9200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410d770 con 0x7f4be4104cf0 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 0x7f4be4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 0x7f4be4197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46920/0 (socket says 172.21.15.22:46920) 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be3400640 1 -- 172.21.15.22:0/1251947910 learned_addr learned my addr 172.21.15.22:0/1251947910 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.400+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be4107620 0x7f4be419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be3400640 1 -- 172.21.15.22:0/1251947910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 msgr2=0x7f4be41982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be3400640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be3400640 1 -- 172.21.15.22:0/1251947910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be4107620 msgr2=0x7f4be419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be3400640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be4107620 0x7f4be419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be3400640 1 -- 172.21.15.22:0/1251947910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be419f980 con 0x7f4be41023c0 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be3400640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 0x7f4be4197d60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400e9f0 tx=0x7f4bd400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4bdbe00640 1 -- 172.21.15.22:0/1251947910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400cd80 con 0x7f4be41023c0 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4bdbe00640 1 -- 172.21.15.22:0/1251947910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bd4005500 con 0x7f4be41023c0 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4bdbe00640 1 -- 172.21.15.22:0/1251947910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4010690 con 0x7f4be41023c0 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.401+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be419fc70 con 0x7f4be41023c0 2024-09-15T22:32:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.402+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41a0140 con 0x7f4be41023c0 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 Processor -- start 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 -- start start 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 0x5584b9f35660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35ba0 0x5584b9f3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f3d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5584b9e9a100 con 0x5584b9f35260 2024-09-15T22:32:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5584b9e421b0 con 0x5584b9f3ac30 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.405+0000 7f4bed62d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584b9e960c0 con 0x5584b9f35ba0 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4bdbe00640 1 -- 172.21.15.22:0/1251947910 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f4bd40046c0 con 0x7f4be41023c0 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 0x5584b9f35660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 0x5584b9f35660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46936/0 (socket says 172.21.15.22:46936) 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 -- 172.21.15.22:0/3790703140 learned_addr learned my addr 172.21.15.22:0/3790703140 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be2a00640 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f3d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3400640 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35ba0 0x5584b9f3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 -- 172.21.15.22:0/3790703140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35ba0 msgr2=0x5584b9f3a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35ba0 0x5584b9f3a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 -- 172.21.15.22:0/3790703140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 msgr2=0x5584b9f3d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f3d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3e00640 1 -- 172.21.15.22:0/3790703140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b9bad210 con 0x5584b9f35260 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.406+0000 7f4be3400640 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35ba0 0x5584b9f3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.407+0000 7f4be3e00640 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 0x5584b9f35660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009a40 tx=0x7f4bdc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ab718c3eab790f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.407+0000 7f4bd8c00640 1 -- 172.21.15.22:0/3790703140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc01d070 con 0x5584b9f35260 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.407+0000 7f4bd8c00640 1 -- 172.21.15.22:0/3790703140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc003d80 con 0x5584b9f35260 2024-09-15T22:32:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.407+0000 7f4bd8c00640 1 -- 172.21.15.22:0/3790703140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00dc10 con 0x5584b9f35260 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.407+0000 7f4bdbe00640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4bc80a32d0 0x7f4bc80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.407+0000 7f4bdbe00640 1 -- 172.21.15.22:0/1251947910 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f4bd40cfe80 con 0x7f4be41023c0 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4be3400640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4bc80a32d0 0x7f4bc80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 -- 172.21.15.22:0/3790703140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 msgr2=0x5584b9f35660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 0x5584b9f35660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009a40 tx=0x7f4bdc0095c0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 -- 172.21.15.22:0/3790703140 shutdown_connections 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35ba0 0x5584b9f3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f3d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 --2- 172.21.15.22:0/3790703140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35260 0x5584b9f35660 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 -- 172.21.15.22:0/3790703140 >> 172.21.15.22:0/3790703140 conn(0x5584b9f308d0 msgr2=0x5584b9f30cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 -- 172.21.15.22:0/3790703140 shutdown_connections 2024-09-15T22:32:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4bed62d740 1 -- 172.21.15.22:0/3790703140 wait complete. 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.408+0000 7f4be3400640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4bc80a32d0 0x7f4bc80a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bd409c2d0 tx=0x7f4bd40bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 -- start start 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 Processor -- start 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f3f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35ba0 0x5584b9f3f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 0x5584b9f46960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5584b9f3dc00 con 0x5584b9f3ac30 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5584b9e23090 con 0x5584b9f35ba0 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5584b9f3dd80 con 0x5584b9f35260 2024-09-15T22:32:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.409+0000 7f4bed62d740 10 client.0 _ll_register_callbacks cb 0x5584b9e77f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 0x5584b9f46960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 0x5584b9f46960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46952/0 (socket says 172.21.15.22:46952) 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be3e00640 1 -- 172.21.15.22:0/1803482716 learned_addr learned my addr 172.21.15.22:0/1803482716 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35ba0 0x5584b9f3f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f3f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be2a00640 1 -- 172.21.15.22:0/1803482716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 msgr2=0x5584b9f3f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f3f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be2a00640 1 -- 172.21.15.22:0/1803482716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 msgr2=0x5584b9f46960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 0x5584b9f46960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be2a00640 1 -- 172.21.15.22:0/1803482716 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b9c79620 con 0x5584b9f35ba0 2024-09-15T22:32:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.410+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 0x5584b9f46960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35ba0 0x5584b9f3f920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4bd002a860 tx=0x7f4bd0005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2916410343b4014f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:32:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bcd600640 1 -- 172.21.15.22:0/1803482716 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0037040 con 0x5584b9f35ba0 2024-09-15T22:32:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc003d80 con 0x5584b9f35ba0 2024-09-15T22:32:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bcd600640 1 -- 172.21.15.22:0/1803482716 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f4bd0005030 con 0x5584b9f35ba0 2024-09-15T22:32:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bcd600640 1 -- 172.21.15.22:0/1803482716 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4bd0005230 con 0x5584b9f35ba0 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bed62d740 10 client.25094 fetch_fsmap learned FSMap version 25 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584b9f49810 con 0x5584b9f35ba0 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.411+0000 7f4bcd600640 1 -- 172.21.15.22:0/1803482716 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc003d80 con 0x5584b9f35ba0 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bcd600640 1 -- 172.21.15.22:0/1803482716 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4bd00035f0 con 0x5584b9f35ba0 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bed62d740 10 client.25094 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bed62d740 10 client.25094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bed62d740 20 client.25094 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9f4aee0 0x5584b9f4d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bed62d740 4 client.25094 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584b9ea7830 con 0x5584b9f4aee0 2024-09-15T22:32:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.412+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9f4aee0 0x5584b9f4d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.413+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9f4aee0 0x5584b9f4d2f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c24bb822e9611b server_cookie=39bf82d831515a9e in_seq=0 out_seq=0 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.413+0000 7f4bcd600640 10 client.25094 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bcd600640 1 -- 172.21.15.22:0/1803482716 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584b9ea7830 con 0x5584b9f4aee0 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bcd600640 10 client.25094 handle_command_reply: tid=0 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 client.25094 shutdown 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35ba0 msgr2=0x5584b9f3f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35ba0 0x5584b9f3f920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4bd002a860 tx=0x7f4bd0005c90 comp rx=0 tx=0).stop 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 shutdown_connections 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9f4aee0 0x5584b9f4d2f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f3ac30 0x5584b9f46960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35ba0 0x5584b9f3f920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1803482716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f3f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bcd600640 0 client.25094 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 >> 172.21.15.22:0/1803482716 conn(0x5584b9f308d0 msgr2=0x5584b9f320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 shutdown_connections 2024-09-15T22:32:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.414+0000 7f4bed62d740 1 -- 172.21.15.22:0/1803482716 wait complete. 2024-09-15T22:32:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.415+0000 7f4bed62d740 20 client.25094 trim_cache size 0 max 16384 2024-09-15T22:32:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 Processor -- start 2024-09-15T22:32:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 -- start start 2024-09-15T22:32:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f35640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f46920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f2f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41ab770 con 0x5584b9f35ba0 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41a9040 con 0x5584b9f3ac30 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4bed62d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41a6e70 con 0x5584b9f35260 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f46920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.430+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f46920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46960/0 (socket says 172.21.15.22:46960) 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f2f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be2a00640 1 -- 172.21.15.22:0/777977009 learned_addr learned my addr 172.21.15.22:0/777977009 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f35640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 -- 172.21.15.22:0/777977009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 msgr2=0x5584b9f35640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f35640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 -- 172.21.15.22:0/777977009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 msgr2=0x5584b9f46920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f46920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 -- 172.21.15.22:0/777977009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b9f306f0 con 0x5584b9f3ac30 2024-09-15T22:32:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be2a00640 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f46920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4be3e00640 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f2f900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000f80 tx=0x7f4bdc0099b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af06269dbd8c82bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4bcfe00640 1 -- 172.21.15.22:0/777977009 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc01d040 con 0x5584b9f3ac30 2024-09-15T22:32:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4bcfe00640 1 -- 172.21.15.22:0/777977009 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc004530 con 0x5584b9f3ac30 2024-09-15T22:32:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.431+0000 7f4bcfe00640 1 -- 172.21.15.22:0/777977009 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc018480 con 0x5584b9f3ac30 2024-09-15T22:32:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 -- 172.21.15.22:0/777977009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 msgr2=0x5584b9f2f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f2f900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000f80 tx=0x7f4bdc0099b0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 -- 172.21.15.22:0/777977009 shutdown_connections 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f3ac30 0x5584b9f2f900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f46920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 --2- 172.21.15.22:0/777977009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f35260 0x5584b9f35640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 -- 172.21.15.22:0/777977009 >> 172.21.15.22:0/777977009 conn(0x5584b9f308d0 msgr2=0x5584b9f2f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 -- 172.21.15.22:0/777977009 shutdown_connections 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.432+0000 7f4bed62d740 1 -- 172.21.15.22:0/777977009 wait complete. 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 -- start start 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 Processor -- start 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35260 0x5584b9f43c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f3ac30 0x5584b9f451c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41a7500 con 0x5584b9f35ba0 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41a8970 con 0x5584b9f35260 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41a7bd0 con 0x5584b9f3ac30 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.433+0000 7f4bed62d740 10 client.0 _ll_register_callbacks cb 0x7f4bd4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35260 0x5584b9f43c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46974/0 (socket says 172.21.15.22:46974) 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 -- 172.21.15.22:0/1648723386 learned_addr learned my addr 172.21.15.22:0/1648723386 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f3ac30 0x5584b9f451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 -- 172.21.15.22:0/1648723386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f3ac30 msgr2=0x5584b9f451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f3ac30 0x5584b9f451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 -- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35260 msgr2=0x5584b9f43c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35260 0x5584b9f43c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 -- 172.21.15.22:0/1648723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b9f457d0 con 0x5584b9f35ba0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35260 0x5584b9f43c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4be2a00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f441b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0003c50 tx=0x7f4bd00045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c177c31fb57adc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.434+0000 7f4bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bcd600640 1 -- 172.21.15.22:0/1648723386 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0037070 con 0x5584b9f35ba0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc004530 con 0x5584b9f35ba0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bcd600640 1 -- 172.21.15.22:0/1648723386 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f4bd00037f0 con 0x5584b9f35ba0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bcd600640 1 -- 172.21.15.22:0/1648723386 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4bd00096b0 con 0x5584b9f35ba0 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 10 client.15072 fetch_fsmap learned FSMap version 25 2024-09-15T22:32:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584b9f46ae0 con 0x5584b9f35ba0 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bcd600640 1 -- 172.21.15.22:0/1648723386 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc004530 con 0x5584b9f35ba0 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bcd600640 1 -- 172.21.15.22:0/1648723386 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4bd005b050 con 0x5584b9f35ba0 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 10 client.15072 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 10 client.15072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 20 client.15072 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9fb61f0 0x5584b9fb8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 4 client.15072 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.435+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584b9ea1b80 con 0x5584b9fb61f0 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.436+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9fb61f0 0x5584b9fb8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.436+0000 7f4be3e00640 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9fb61f0 0x5584b9fb8610 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e4eb029a709871 server_cookie=245d0c48202f0d69 in_seq=0 out_seq=0 2024-09-15T22:32:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.436+0000 7f4bcd600640 10 client.15072 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bcd600640 1 -- 172.21.15.22:0/1648723386 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584b9ea1b80 con 0x5584b9fb61f0 2024-09-15T22:32:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bcd600640 10 client.15072 handle_command_reply: tid=0 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 client.15072 shutdown 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 msgr2=0x5584b9f441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f441b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0003c50 tx=0x7f4bd00045c0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 shutdown_connections 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5584b9fb61f0 0x5584b9fb8610 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5584b9f3ac30 0x5584b9f451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5584b9f35ba0 0x5584b9f441b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bcd600640 0 client.15072 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 --2- 172.21.15.22:0/1648723386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5584b9f35260 0x5584b9f43c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.448+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 >> 172.21.15.22:0/1648723386 conn(0x5584b9f308d0 msgr2=0x5584b9f2fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 shutdown_connections 2024-09-15T22:32:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4bed62d740 1 -- 172.21.15.22:0/1648723386 wait complete. 2024-09-15T22:32:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4bed62d740 20 client.15072 trim_cache size 0 max 16384 2024-09-15T22:32:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:32:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:32:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:32:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4bc80a32d0 msgr2=0x7f4bc80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4be9200640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4bc80a32d0 0x7f4bc80a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bd409c2d0 tx=0x7f4bd40bc040 comp rx=0 tx=0).stop 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 msgr2=0x7f4be4197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4be9200640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 0x7f4be4197d60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400e9f0 tx=0x7f4bd400edf0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.449+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 shutdown_connections 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4be4104cf0 0x7f4be41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f4bc80a32d0 0x7f4bc80a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be4107620 0x7f4be419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 --2- 172.21.15.22:0/1251947910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4be41023c0 0x7f4be4197d60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 >> 172.21.15.22:0/1251947910 conn(0x7f4be40fbfa0 msgr2=0x7f4be4102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 shutdown_connections 2024-09-15T22:32:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:45.450+0000 7f4be9200640 1 -- 172.21.15.22:0/1251947910 wait complete. 2024-09-15T22:32:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:44 smithi110 ceph-mon[35282]: pgmap v358: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-15T22:32:47.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:46 smithi022 ceph-mon[30634]: pgmap v359: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-15T22:32:47.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:46 smithi112 ceph-mon[35032]: pgmap v359: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-15T22:32:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:46 smithi110 ceph-mon[35282]: pgmap v359: 97 pgs: 97 active+clean; 655 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-15T22:32:49.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:48 smithi022 ceph-mon[30634]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-15T22:32:49.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:48 smithi112 ceph-mon[35032]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-15T22:32:49.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:48 smithi110 ceph-mon[35282]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-15T22:32:51.257 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:50 smithi110 ceph-mon[35282]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:32:51.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:50 smithi022 ceph-mon[30634]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:32:51.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:50 smithi112 ceph-mon[35032]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:32:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:52 smithi022 ceph-mon[30634]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-15T22:32:53.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:52 smithi112 ceph-mon[35032]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-15T22:32:53.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:52 smithi110 ceph-mon[35282]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-15T22:32:55.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:54 smithi022 ceph-mon[30634]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:32:55.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:54 smithi112 ceph-mon[35032]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:32:55.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:54 smithi110 ceph-mon[35282]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:32:57.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:56 smithi022 ceph-mon[30634]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-15T22:32:57.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:56 smithi112 ceph-mon[35032]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-15T22:32:57.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:56 smithi110 ceph-mon[35282]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 -- 172.21.15.22:0/3922645842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4102d50 msgr2=0x7f79c41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 --2- 172.21.15.22:0/3922645842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4102d50 0x7f79c41031d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009900 tx=0x7f79b002a410 comp rx=0 tx=0).stop 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 -- 172.21.15.22:0/3922645842 shutdown_connections 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 --2- 172.21.15.22:0/3922645842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4103710 0x7f79c4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 --2- 172.21.15.22:0/3922645842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4102d50 0x7f79c41031d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 --2- 172.21.15.22:0/3922645842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c4101b60 0x7f79c4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 -- 172.21.15.22:0/3922645842 >> 172.21.15.22:0/3922645842 conn(0x7f79c40fd2e0 msgr2=0x7f79c40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 -- 172.21.15.22:0/3922645842 shutdown_connections 2024-09-15T22:32:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.569+0000 7f79ca400640 1 -- 172.21.15.22:0/3922645842 wait complete. 2024-09-15T22:32:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 Processor -- start 2024-09-15T22:32:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 -- start start 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 0x7f79c4197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c4102d50 0x7f79c4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4103710 0x7f79c419f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f79c410d830 con 0x7f79c4103710 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79c410d6b0 con 0x7f79c4102d50 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.570+0000 7f79ca400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79c410d9b0 con 0x7f79c4101b60 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 0x7f79c4197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4103710 0x7f79c419f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 0x7f79c4197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:45028/0 (socket says 172.21.15.22:45028) 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 -- 172.21.15.22:0/502840897 learned_addr learned my addr 172.21.15.22:0/502840897 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c2a00640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c4102d50 0x7f79c4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 -- 172.21.15.22:0/502840897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c4102d50 msgr2=0x7f79c4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c4102d50 0x7f79c4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 -- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4103710 msgr2=0x7f79c419f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4103710 0x7f79c419f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 -- 172.21.15.22:0/502840897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c419f9e0 con 0x7f79c4101b60 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.571+0000 7f79c3400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 0x7f79c4197dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79b400d770 tx=0x7f79b400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.572+0000 7f79bbe00640 1 -- 172.21.15.22:0/502840897 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4017070 con 0x7f79c4101b60 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.572+0000 7f79bbe00640 1 -- 172.21.15.22:0/502840897 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b4009c30 con 0x7f79c4101b60 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.572+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c419fcd0 con 0x7f79c4101b60 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.572+0000 7f79bbe00640 1 -- 172.21.15.22:0/502840897 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4003dd0 con 0x7f79c4101b60 2024-09-15T22:32:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.572+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c41a01a0 con 0x7f79c4101b60 2024-09-15T22:32:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 Processor -- start 2024-09-15T22:32:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 -- start start 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f71981e100 con 0x55f7198bdde0 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f7197c61b0 con 0x55f7198bd4a0 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.576+0000 7f79cd29d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f71981a0c0 con 0x55f7198c2e70 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79bbe00640 1 -- 172.21.15.22:0/502840897 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f79b4003fb0 con 0x7f79c4101b60 2024-09-15T22:32:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:45032/0 (socket says 172.21.15.22:45032) 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 -- 172.21.15.22:0/912585409 learned_addr learned my addr 172.21.15.22:0/912585409 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c3400640 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 -- 172.21.15.22:0/912585409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 msgr2=0x55f7198bd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198bd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 -- 172.21.15.22:0/912585409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 msgr2=0x55f7198c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c2a00640 1 -- 172.21.15.22:0/912585409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f719531210 con 0x55f7198c2e70 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.577+0000 7f79c3400640 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:32:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.578+0000 7f79c2a00640 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198c5330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c00 tx=0x7f79b0004170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f054dffae78502 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.578+0000 7f79b8c00640 1 -- 172.21.15.22:0/912585409 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0035040 con 0x55f7198c2e70 2024-09-15T22:32:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.578+0000 7f79b8c00640 1 -- 172.21.15.22:0/912585409 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0005520 con 0x55f7198c2e70 2024-09-15T22:32:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.578+0000 7f79b8c00640 1 -- 172.21.15.22:0/912585409 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0031910 con 0x55f7198c2e70 2024-09-15T22:32:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79bbe00640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f79a80a3390 0x7f79a80a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 -- 172.21.15.22:0/912585409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 msgr2=0x55f7198c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198c5330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c00 tx=0x7f79b0004170 comp rx=0 tx=0).stop 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79bbe00640 1 -- 172.21.15.22:0/502840897 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f79b40cf3c0 con 0x7f79c4101b60 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 -- 172.21.15.22:0/912585409 shutdown_connections 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198c5330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 --2- 172.21.15.22:0/912585409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198bd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 -- 172.21.15.22:0/912585409 >> 172.21.15.22:0/912585409 conn(0x55f7198b4700 msgr2=0x55f7198b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79c3e00640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f79a80a3390 0x7f79a80a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 -- 172.21.15.22:0/912585409 shutdown_connections 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.579+0000 7f79cd29d740 1 -- 172.21.15.22:0/912585409 wait complete. 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 -- start start 2024-09-15T22:32:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 Processor -- start 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79c3e00640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f79a80a3390 0x7f79a80a5850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f7198ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7198c5de0 con 0x55f7198c2e70 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f7197a7090 con 0x55f7198bd4a0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f7198c5f60 con 0x55f7198bdde0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.580+0000 7f79cd29d740 10 client.0 _ll_register_callbacks cb 0x55f7197fbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f7198ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56664/0 (socket says 172.21.15.22:56664) 2024-09-15T22:32:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:45038/0 (socket says 172.21.15.22:45038) 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 -- 172.21.15.22:0/424092106 learned_addr learned my addr 172.21.15.22:0/424092106 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f7198ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37342/0 (socket says 172.21.15.22:37342) 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 -- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 msgr2=0x55f7198c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 -- 172.21.15.22:0/424092106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 msgr2=0x55f7198ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f7198ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 -- 172.21.15.22:0/424092106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7195fd620 con 0x55f7198bdde0 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c3400640 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79c2a00640 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198c7b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f79b0031440 tx=0x7f79b0005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfa72874904474c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.581+0000 7f79ad600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.582+0000 7f79ad600640 1 -- 172.21.15.22:0/424092106 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0053060 con 0x55f7198bdde0 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.582+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b0005520 con 0x55f7198bdde0 2024-09-15T22:32:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.582+0000 7f79ad600640 1 -- 172.21.15.22:0/424092106 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f79b0004980 con 0x55f7198bdde0 2024-09-15T22:32:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.582+0000 7f79ad600640 1 -- 172.21.15.22:0/424092106 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f79b0035050 con 0x55f7198bdde0 2024-09-15T22:32:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.582+0000 7f79cd29d740 10 client.25117 fetch_fsmap learned FSMap version 25 2024-09-15T22:32:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.582+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f7198c5e30 con 0x55f7198bdde0 2024-09-15T22:32:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79ad600640 1 -- 172.21.15.22:0/424092106 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0005520 con 0x55f7198bdde0 2024-09-15T22:32:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79ad600640 1 -- 172.21.15.22:0/424092106 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f79b0058070 con 0x55f7198bdde0 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79cd29d740 10 client.25117 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79cd29d740 10 client.25117 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79cd29d740 20 client.25117 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79cd29d740 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f7198d2b50 0x55f7198d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79cd29d740 4 client.25117 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f71982b830 con 0x55f7198d2b50 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.583+0000 7f79c3400640 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f7198d2b50 0x55f7198d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.584+0000 7f79c3400640 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f7198d2b50 0x55f7198d4f40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21fd687e7feb147 server_cookie=dac96d33511e5c4c in_seq=0 out_seq=0 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.584+0000 7f79ad600640 10 client.25117 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79ad600640 1 -- 172.21.15.22:0/424092106 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f71982b830 con 0x55f7198d2b50 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79ad600640 10 client.25117 handle_command_reply: tid=0 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 client.25117 shutdown 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 msgr2=0x55f7198c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198c7b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f79b0031440 tx=0x7f79b0005d50 comp rx=0 tx=0).stop 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 shutdown_connections 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f7198d2b50 0x55f7198d4f40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198c7b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f7198ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 --2- 172.21.15.22:0/424092106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 >> 172.21.15.22:0/424092106 conn(0x55f7198b4700 msgr2=0x55f7198b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79ad600640 0 client.25117 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 shutdown_connections 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 1 -- 172.21.15.22:0/424092106 wait complete. 2024-09-15T22:32:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.585+0000 7f79cd29d740 20 client.25117 trim_cache size 0 max 16384 2024-09-15T22:32:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 Processor -- start 2024-09-15T22:32:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 -- start start 2024-09-15T22:32:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a95f0 con 0x55f7198bdde0 2024-09-15T22:32:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a6ec0 con 0x55f7198bd4a0 2024-09-15T22:32:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79cd29d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a4cf0 con 0x55f7198c2e70 2024-09-15T22:32:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37356/0 (socket says 172.21.15.22:37356) 2024-09-15T22:32:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79c2a00640 1 -- 172.21.15.22:0/2833215028 learned_addr learned my addr 172.21.15.22:0/2833215028 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79c3400640 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.606+0000 7f79c3e00640 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c2a00640 1 -- 172.21.15.22:0/2833215028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 msgr2=0x55f7198b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c2a00640 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c2a00640 1 -- 172.21.15.22:0/2833215028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 msgr2=0x55f7198af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c2a00640 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c2a00640 1 -- 172.21.15.22:0/2833215028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7198be2c0 con 0x55f7198bdde0 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c3400640 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79c2a00640 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198ceac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c00 tx=0x7f79b00037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe7e552fb659785 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.607+0000 7f79afe00640 1 -- 172.21.15.22:0/2833215028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b005e070 con 0x55f7198bdde0 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79afe00640 1 -- 172.21.15.22:0/2833215028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0003ef0 con 0x55f7198bdde0 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79afe00640 1 -- 172.21.15.22:0/2833215028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0053040 con 0x55f7198bdde0 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 -- 172.21.15.22:0/2833215028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 msgr2=0x55f7198ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198ceac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c00 tx=0x7f79b00037c0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 -- 172.21.15.22:0/2833215028 shutdown_connections 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198c2e70 0x55f7198b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198bdde0 0x55f7198ceac0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 --2- 172.21.15.22:0/2833215028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 -- 172.21.15.22:0/2833215028 >> 172.21.15.22:0/2833215028 conn(0x55f7198b4700 msgr2=0x55f7198bf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 -- 172.21.15.22:0/2833215028 shutdown_connections 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.608+0000 7f79cd29d740 1 -- 172.21.15.22:0/2833215028 wait complete. 2024-09-15T22:32:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 -- start start 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 Processor -- start 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f71993ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a5380 con 0x55f7198c2e70 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a67f0 con 0x55f7198bd4a0 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a5a50 con 0x55f7198bdde0 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.609+0000 7f79cd29d740 10 client.0 _ll_register_callbacks cb 0x7f79bc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:32:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f71993ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:45046/0 (socket says 172.21.15.22:45046) 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 -- 172.21.15.22:0/1649464029 learned_addr learned my addr 172.21.15.22:0/1649464029 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 -- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 msgr2=0x55f7198cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 -- 172.21.15.22:0/1649464029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 msgr2=0x55f71993ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f71993ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 -- 172.21.15.22:0/1649464029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7198bce20 con 0x55f7198bdde0 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c3400640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c3e00640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f71993ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:32:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79c2a00640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198cc140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f79b0031440 tx=0x7f79b0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb3c1ba5e1aca41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.610+0000 7f79ad600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79ad600640 1 -- 172.21.15.22:0/1649464029 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0053070 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79ad600640 1 -- 172.21.15.22:0/1649464029 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f79b004e680 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b0003ef0 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79ad600640 1 -- 172.21.15.22:0/1649464029 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f79b005e070 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79cd29d740 10 client.25123 fetch_fsmap learned FSMap version 25 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f719941490 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79ad600640 1 -- 172.21.15.22:0/1649464029 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0003ef0 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79ad600640 1 -- 172.21.15.22:0/1649464029 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f79b006b050 con 0x55f7198bdde0 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79cd29d740 10 client.25123 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79cd29d740 10 client.25123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:32:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.611+0000 7f79cd29d740 20 client.25123 populate_metadata read hostname 'smithi022' 2024-09-15T22:32:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.612+0000 7f79cd29d740 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f719941d50 0x55f719944170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:32:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.612+0000 7f79cd29d740 4 client.25123 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:32:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.612+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7198afd80 con 0x55f719941d50 2024-09-15T22:32:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.612+0000 7f79c3400640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f719941d50 0x55f719944170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:32:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.612+0000 7f79c3400640 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f719941d50 0x55f719944170 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f4a6871ff18bf2 server_cookie=32d4103a359b57d9 in_seq=0 out_seq=0 2024-09-15T22:32:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.612+0000 7f79ad600640 10 client.25123 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79ad600640 1 -- 172.21.15.22:0/1649464029 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f7198afd80 con 0x55f719941d50 2024-09-15T22:32:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79ad600640 10 client.25123 handle_command_reply: tid=0 2024-09-15T22:32:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 client.25123 shutdown 2024-09-15T22:32:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 msgr2=0x55f7198cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198cc140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f79b0031440 tx=0x7f79b0005fd0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 shutdown_connections 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f719941d50 0x55f719944170 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f7198bdde0 0x55f7198cc140 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7198c2e70 0x55f71993ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 --2- 172.21.15.22:0/1649464029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f7198bd4a0 0x55f7198cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79ad600640 0 client.25123 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 >> 172.21.15.22:0/1649464029 conn(0x55f7198b4700 msgr2=0x55f7198b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 shutdown_connections 2024-09-15T22:32:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 1 -- 172.21.15.22:0/1649464029 wait complete. 2024-09-15T22:32:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.619+0000 7f79cd29d740 20 client.25123 trim_cache size 0 max 16384 2024-09-15T22:32:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:32:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:32:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:32:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:32:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f79a80a3390 msgr2=0x7f79a80a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f79a80a3390 0x7f79a80a5850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc009500 comp rx=0 tx=0).stop 2024-09-15T22:32:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 msgr2=0x7f79c4197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 0x7f79c4197dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79b400d770 tx=0x7f79b400dc30 comp rx=0 tx=0).stop 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 shutdown_connections 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f79a80a3390 0x7f79a80a5850 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79c4103710 0x7f79c419f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c4102d50 0x7f79c4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 --2- 172.21.15.22:0/502840897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79c4101b60 0x7f79c4197dc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 >> 172.21.15.22:0/502840897 conn(0x7f79c40fd2e0 msgr2=0x7f79c4106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 shutdown_connections 2024-09-15T22:32:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:32:58.620+0000 7f79ca400640 1 -- 172.21.15.22:0/502840897 wait complete. 2024-09-15T22:32:59.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:32:58 smithi022 ceph-mon[30634]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-15T22:32:59.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:32:58 smithi112 ceph-mon[35032]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-15T22:32:59.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:32:58 smithi110 ceph-mon[35282]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-15T22:33:01.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:00 smithi022 ceph-mon[30634]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:33:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:00 smithi112 ceph-mon[35032]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:33:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:00 smithi110 ceph-mon[35282]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:33:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:02 smithi022 ceph-mon[30634]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-15T22:33:03.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:02 smithi112 ceph-mon[35032]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-15T22:33:03.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:02 smithi110 ceph-mon[35282]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-15T22:33:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:05 smithi022 ceph-mon[30634]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-15T22:33:05.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:05 smithi112 ceph-mon[35032]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-15T22:33:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:05 smithi110 ceph-mon[35282]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-15T22:33:07.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:07 smithi022 ceph-mon[30634]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-15T22:33:07.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:07 smithi112 ceph-mon[35032]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-15T22:33:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:07 smithi110 ceph-mon[35282]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-15T22:33:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:09 smithi022 ceph-mon[30634]: pgmap v370: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-15T22:33:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:09 smithi112 ceph-mon[35032]: pgmap v370: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-15T22:33:09.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:09 smithi110 ceph-mon[35282]: pgmap v370: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-15T22:33:11.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:11 smithi022 ceph-mon[30634]: pgmap v371: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-15T22:33:11.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:11 smithi112 ceph-mon[35032]: pgmap v371: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-15T22:33:11.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:11 smithi110 ceph-mon[35282]: pgmap v371: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-15T22:33:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 -- 172.21.15.22:0/1777951926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01001b0 msgr2=0x7faed01025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 --2- 172.21.15.22:0/1777951926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01001b0 0x7faed01025c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faec0009900 tx=0x7faec002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 -- 172.21.15.22:0/1777951926 shutdown_connections 2024-09-15T22:33:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 --2- 172.21.15.22:0/1777951926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed01054b0 0x7faed0105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 --2- 172.21.15.22:0/1777951926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed0102b00 0x7faed0104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 --2- 172.21.15.22:0/1777951926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01001b0 0x7faed01025c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 -- 172.21.15.22:0/1777951926 >> 172.21.15.22:0/1777951926 conn(0x7faed00fbfa0 msgr2=0x7faed00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 -- 172.21.15.22:0/1777951926 shutdown_connections 2024-09-15T22:33:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.804+0000 7faecf200640 1 -- 172.21.15.22:0/1777951926 wait complete. 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.805+0000 7faecf200640 1 Processor -- start 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 -- start start 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed01001b0 0x7faed019e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 0x7faed019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01054b0 0x7faed01a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faed0113c10 con 0x7faed01001b0 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faed0113a90 con 0x7faed01054b0 2024-09-15T22:33:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.806+0000 7faecf200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faed0113d90 con 0x7faed0102b00 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 0x7faed019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 0x7faed019e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33688/0 (socket says 172.21.15.22:33688) 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 -- 172.21.15.22:0/674385816 learned_addr learned my addr 172.21.15.22:0/674385816 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecde00640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed01001b0 0x7faed019e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faece800640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01054b0 0x7faed01a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 -- 172.21.15.22:0/674385816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01054b0 msgr2=0x7faed01a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01054b0 0x7faed01a5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 -- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed01001b0 msgr2=0x7faed019e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed01001b0 0x7faed019e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecd400640 1 -- 172.21.15.22:0/674385816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed01a5e90 con 0x7faed0102b00 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.807+0000 7faecde00640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed01001b0 0x7faed019e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.808+0000 7faecd400640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 0x7faed019e7b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faebc00e9f0 tx=0x7faebc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.808+0000 7faec6a00640 1 -- 172.21.15.22:0/674385816 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc00cd80 con 0x7faed0102b00 2024-09-15T22:33:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.808+0000 7faec6a00640 1 -- 172.21.15.22:0/674385816 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faebc010910 con 0x7faed0102b00 2024-09-15T22:33:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.808+0000 7faec6a00640 1 -- 172.21.15.22:0/674385816 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc018980 con 0x7faed0102b00 2024-09-15T22:33:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.808+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed01a6180 con 0x7faed0102b00 2024-09-15T22:33:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.808+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01a6680 con 0x7faed0102b00 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 Processor -- start 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 -- start start 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faec6a00640 1 -- 172.21.15.22:0/674385816 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7faebc010ac0 con 0x7faed0102b00 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c1a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c1f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558771b7f100 con 0x558771c1fc30 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558771b271b0 con 0x558771c1aba0 2024-09-15T22:33:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.813+0000 7faed7c65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558771b7b0c0 con 0x558771c1a260 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c1a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c1a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33692/0 (socket says 172.21.15.22:33692) 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 -- 172.21.15.22:0/1287349534 learned_addr learned my addr 172.21.15.22:0/1287349534 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faecde00640 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c1f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 -- 172.21.15.22:0/1287349534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 msgr2=0x558771c1f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c1f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 -- 172.21.15.22:0/1287349534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 msgr2=0x558771c220f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faecd400640 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.814+0000 7faece800640 1 -- 172.21.15.22:0/1287349534 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558771892210 con 0x558771c1a260 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.815+0000 7faecd400640 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.815+0000 7faece800640 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c1a660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faec8009fd0 tx=0x7faec80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d0097596fdaccb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.815+0000 7faebb000640 1 -- 172.21.15.22:0/1287349534 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8004d20 con 0x558771c1a260 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.815+0000 7faebb000640 1 -- 172.21.15.22:0/1287349534 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec8004050 con 0x558771c1a260 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.815+0000 7faebb000640 1 -- 172.21.15.22:0/1287349534 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8005260 con 0x558771c1a260 2024-09-15T22:33:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.815+0000 7faec6a00640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faeb40a32d0 0x7faeb40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faec6a00640 1 -- 172.21.15.22:0/674385816 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7faebc0cff10 con 0x7faed0102b00 2024-09-15T22:33:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faecde00640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faeb40a32d0 0x7faeb40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 -- 172.21.15.22:0/1287349534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 msgr2=0x558771c1a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c1a660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faec8009fd0 tx=0x7faec80118d0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 -- 172.21.15.22:0/1287349534 shutdown_connections 2024-09-15T22:33:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c1f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 --2- 172.21.15.22:0/1287349534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c1a660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.816+0000 7faed7c65740 1 -- 172.21.15.22:0/1287349534 >> 172.21.15.22:0/1287349534 conn(0x558771c158d0 msgr2=0x558771c15cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.817+0000 7faed7c65740 1 -- 172.21.15.22:0/1287349534 shutdown_connections 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.817+0000 7faecde00640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faeb40a32d0 0x7faeb40a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faec0006010 tx=0x7faec0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.817+0000 7faed7c65740 1 -- 172.21.15.22:0/1287349534 wait complete. 2024-09-15T22:33:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.818+0000 7faed7c65740 1 -- start start 2024-09-15T22:33:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.818+0000 7faed7c65740 1 Processor -- start 2024-09-15T22:33:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c24930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c2b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558771c22c00 con 0x558771c1aba0 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558771b08090 con 0x558771c1a260 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558771c22d80 con 0x558771c1fc30 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faed7c65740 10 client.0 _ll_register_callbacks cb 0x558771b5cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faecde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faecde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c243f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:44132/0 (socket says 172.21.15.22:44132) 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faecde00640 1 -- 172.21.15.22:0/1273085633 learned_addr learned my addr 172.21.15.22:0/1273085633 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faecd400640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c24930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.819+0000 7faece800640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c2b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecde00640 1 -- 172.21.15.22:0/1273085633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 msgr2=0x558771c2b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecde00640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c2b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecde00640 1 -- 172.21.15.22:0/1273085633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 msgr2=0x558771c24930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecde00640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c24930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecde00640 1 -- 172.21.15.22:0/1273085633 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55877195e620 con 0x558771c1a260 2024-09-15T22:33:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecd400640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c24930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faecde00640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c243f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faec0009900 tx=0x7faec0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2edd2650b688f823 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.820+0000 7faeaf400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.821+0000 7faeaf400640 1 -- 172.21.15.22:0/1273085633 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec004d070 con 0x558771c1a260 2024-09-15T22:33:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.821+0000 7faeaf400640 1 -- 172.21.15.22:0/1273085633 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7faec00328c0 con 0x558771c1a260 2024-09-15T22:33:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.821+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec8004050 con 0x558771c1a260 2024-09-15T22:33:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.822+0000 7faeaf400640 1 -- 172.21.15.22:0/1273085633 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faec0057050 con 0x558771c1a260 2024-09-15T22:33:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.822+0000 7faed7c65740 10 client.25130 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.822+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558771c2e740 con 0x558771c1a260 2024-09-15T22:33:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faeaf400640 1 -- 172.21.15.22:0/1273085633 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec8004050 con 0x558771c1a260 2024-09-15T22:33:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faeaf400640 1 -- 172.21.15.22:0/1273085633 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faec0003b80 con 0x558771c1a260 2024-09-15T22:33:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faed7c65740 10 client.25130 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faed7c65740 10 client.25130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faed7c65740 20 client.25130 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faed7c65740 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c2fe60 0x558771c322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faed7c65740 4 client.25130 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.823+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558771b8c830 con 0x558771c2fe60 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.824+0000 7faecd400640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c2fe60 0x558771c322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.825+0000 7faecd400640 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c2fe60 0x558771c322b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54213e89549dcd24 server_cookie=6bc2ad60c500362c in_seq=0 out_seq=0 2024-09-15T22:33:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.825+0000 7faeaf400640 10 client.25130 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.825+0000 7faeaf400640 1 -- 172.21.15.22:0/1273085633 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558771b8c830 con 0x558771c2fe60 2024-09-15T22:33:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.825+0000 7faeaf400640 10 client.25130 handle_command_reply: tid=0 2024-09-15T22:33:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 client.25130 shutdown 2024-09-15T22:33:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 msgr2=0x558771c243f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c243f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faec0009900 tx=0x7faec0009260 comp rx=0 tx=0).stop 2024-09-15T22:33:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 shutdown_connections 2024-09-15T22:33:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c2fe60 0x558771c322b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c2b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c24930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 --2- 172.21.15.22:0/1273085633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c243f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 >> 172.21.15.22:0/1273085633 conn(0x558771c158d0 msgr2=0x558771c170e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faeaf400640 0 client.25130 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.826+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 shutdown_connections 2024-09-15T22:33:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.827+0000 7faed7c65740 1 -- 172.21.15.22:0/1273085633 wait complete. 2024-09-15T22:33:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.827+0000 7faed7c65740 20 client.25130 trim_cache size 0 max 16384 2024-09-15T22:33:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.857+0000 7faed7c65740 1 Processor -- start 2024-09-15T22:33:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.857+0000 7faed7c65740 1 -- start start 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.857+0000 7faed7c65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.857+0000 7faed7c65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c2b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faed7c65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c246e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faed7c65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faed01b1de0 con 0x558771c1aba0 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faed7c65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faed01af6b0 con 0x558771c1a260 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faed7c65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faed01ad4e0 con 0x558771c1fc30 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faecd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c2b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faece800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faecd400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c2b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42254/0 (socket says 172.21.15.22:42254) 2024-09-15T22:33:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faecd400640 1 -- 172.21.15.22:0/1370130773 learned_addr learned my addr 172.21.15.22:0/1370130773 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.858+0000 7faecde00640 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecde00640 1 -- 172.21.15.22:0/1370130773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 msgr2=0x558771c246e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecde00640 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c246e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecde00640 1 -- 172.21.15.22:0/1370130773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 msgr2=0x558771c2b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecde00640 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c2b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecde00640 1 -- 172.21.15.22:0/1370130773 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558771c2bd30 con 0x558771c1a260 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecd400640 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c2b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faecde00640 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c241a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faec002a9e0 tx=0x7faec002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d7cd366c644ebcd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.859+0000 7faeba600640 1 -- 172.21.15.22:0/1370130773 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec004d050 con 0x558771c1a260 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.860+0000 7faeba600640 1 -- 172.21.15.22:0/1370130773 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec0049570 con 0x558771c1a260 2024-09-15T22:33:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.860+0000 7faeba600640 1 -- 172.21.15.22:0/1370130773 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0035040 con 0x558771c1a260 2024-09-15T22:33:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.860+0000 7faed7c65740 1 -- 172.21.15.22:0/1370130773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 msgr2=0x558771c241a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.860+0000 7faed7c65740 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c241a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faec002a9e0 tx=0x7faec002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 -- 172.21.15.22:0/1370130773 shutdown_connections 2024-09-15T22:33:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1fc30 0x558771c246e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1aba0 0x558771c2b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 --2- 172.21.15.22:0/1370130773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1a260 0x558771c241a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 -- 172.21.15.22:0/1370130773 >> 172.21.15.22:0/1370130773 conn(0x558771c158d0 msgr2=0x558771c1bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 -- 172.21.15.22:0/1370130773 shutdown_connections 2024-09-15T22:33:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 -- 172.21.15.22:0/1370130773 wait complete. 2024-09-15T22:33:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.861+0000 7faed7c65740 1 -- start start 2024-09-15T22:33:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 Processor -- start 2024-09-15T22:33:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c2b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c28750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faed01adb70 con 0x558771c1fc30 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faed01aefe0 con 0x558771c1aba0 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faed01ae240 con 0x558771c1a260 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.862+0000 7faed7c65740 10 client.0 _ll_register_callbacks cb 0x7faec80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c2b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c2b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33734/0 (socket says 172.21.15.22:33734) 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecde00640 1 -- 172.21.15.22:0/1440498291 learned_addr learned my addr 172.21.15.22:0/1440498291 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecd400640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faece800640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c28750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecd400640 1 -- 172.21.15.22:0/1440498291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 msgr2=0x558771c2b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecd400640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c2b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecd400640 1 -- 172.21.15.22:0/1440498291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 msgr2=0x558771c28750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecd400640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c28750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.863+0000 7faecd400640 1 -- 172.21.15.22:0/1440498291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558771c98bb0 con 0x558771c1aba0 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faecde00640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c2b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faece800640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c28750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faecd400640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c281b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faebc0987f0 tx=0x7faebc0d2360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3bfa72ec7f6ca47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faeaf400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faeaf400640 1 -- 172.21.15.22:0/1440498291 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc09b7e0 con 0x558771c1aba0 2024-09-15T22:33:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faeaf400640 1 -- 172.21.15.22:0/1440498291 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7faebc09b980 con 0x558771c1aba0 2024-09-15T22:33:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.864+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec0049570 con 0x558771c1aba0 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faeaf400640 1 -- 172.21.15.22:0/1440498291 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faebc0b5190 con 0x558771c1aba0 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 10 client.25136 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558771c99f70 con 0x558771c1aba0 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faeaf400640 1 -- 172.21.15.22:0/1440498291 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec0049570 con 0x558771c1aba0 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faeaf400640 1 -- 172.21.15.22:0/1440498291 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faebc0980e0 con 0x558771c1aba0 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 10 client.25136 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 10 client.25136 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 20 client.25136 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c9a8f0 0x558771c9cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 4 client.25136 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.865+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558771b86b80 con 0x558771c9a8f0 2024-09-15T22:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.866+0000 7faecde00640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c9a8f0 0x558771c9cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.866+0000 7faecde00640 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c9a8f0 0x558771c9cd10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f278794bbced1ae server_cookie=182a186686a7db91 in_seq=0 out_seq=0 2024-09-15T22:33:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.866+0000 7faeaf400640 10 client.25136 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faeaf400640 1 -- 172.21.15.22:0/1440498291 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558771b86b80 con 0x558771c9a8f0 2024-09-15T22:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faeaf400640 10 client.25136 handle_command_reply: tid=0 2024-09-15T22:33:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 client.25136 shutdown 2024-09-15T22:33:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 msgr2=0x558771c281b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c281b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faebc0987f0 tx=0x7faebc0d2360 comp rx=0 tx=0).stop 2024-09-15T22:33:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 shutdown_connections 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x558771c9a8f0 0x558771c9cd10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558771c1fc30 0x558771c28750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558771c1aba0 0x558771c281b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 --2- 172.21.15.22:0/1440498291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558771c1a260 0x558771c2b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 >> 172.21.15.22:0/1440498291 conn(0x558771c158d0 msgr2=0x558771c24120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faeaf400640 0 client.25136 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 shutdown_connections 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.875+0000 7faed7c65740 1 -- 172.21.15.22:0/1440498291 wait complete. 2024-09-15T22:33:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.876+0000 7faed7c65740 20 client.25136 trim_cache size 0 max 16384 2024-09-15T22:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:33:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.876+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faeb40a32d0 msgr2=0x7faeb40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.876+0000 7faecf200640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faeb40a32d0 0x7faeb40a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faec0006010 tx=0x7faec0005a20 comp rx=0 tx=0).stop 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.876+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 msgr2=0x7faed019e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.876+0000 7faecf200640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 0x7faed019e7b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faebc00e9f0 tx=0x7faebc00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 shutdown_connections 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faed0102b00 0x7faed019e7b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7faeb40a32d0 0x7faeb40a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed01054b0 0x7faed01a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 --2- 172.21.15.22:0/674385816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faed01001b0 0x7faed019e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 >> 172.21.15.22:0/674385816 conn(0x7faed00fbfa0 msgr2=0x7faed0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 shutdown_connections 2024-09-15T22:33:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:11.877+0000 7faecf200640 1 -- 172.21.15.22:0/674385816 wait complete. 2024-09-15T22:33:13.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:13 smithi022 ceph-mon[30634]: pgmap v372: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-15T22:33:13.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:13 smithi112 ceph-mon[35032]: pgmap v372: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-15T22:33:13.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:13 smithi110 ceph-mon[35282]: pgmap v372: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-15T22:33:15.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:15 smithi022 ceph-mon[30634]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-15T22:33:15.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:15 smithi112 ceph-mon[35032]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-15T22:33:15.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:15 smithi110 ceph-mon[35282]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-15T22:33:17.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:17 smithi022 ceph-mon[30634]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-15T22:33:17.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:17 smithi112 ceph-mon[35032]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-15T22:33:17.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:17 smithi110 ceph-mon[35282]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-15T22:33:19.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:19 smithi022 ceph-mon[30634]: pgmap v375: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-15T22:33:19.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:19 smithi112 ceph-mon[35032]: pgmap v375: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-15T22:33:19.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:19 smithi110 ceph-mon[35282]: pgmap v375: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-15T22:33:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:21 smithi022 ceph-mon[30634]: pgmap v376: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:33:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:21 smithi112 ceph-mon[35032]: pgmap v376: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:33:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:21 smithi110 ceph-mon[35282]: pgmap v376: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:33:23.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:23 smithi022 ceph-mon[30634]: pgmap v377: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:33:23.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:23 smithi112 ceph-mon[35032]: pgmap v377: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:33:23.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:23 smithi110 ceph-mon[35282]: pgmap v377: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 -- 172.21.15.22:0/572789977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 msgr2=0x7f52c41097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 --2- 172.21.15.22:0/572789977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c41097b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009900 tx=0x7f52b402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 -- 172.21.15.22:0/572789977 shutdown_connections 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 --2- 172.21.15.22:0/572789977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c41097b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 --2- 172.21.15.22:0/572789977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4109cf0 0x7f52c410c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 --2- 172.21.15.22:0/572789977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c4074620 0x7f52c4074a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 -- 172.21.15.22:0/572789977 >> 172.21.15.22:0/572789977 conn(0x7f52c40fd0d0 msgr2=0x7f52c40ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:25.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 -- 172.21.15.22:0/572789977 shutdown_connections 2024-09-15T22:33:25.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.070+0000 7f52cb200640 1 -- 172.21.15.22:0/572789977 wait complete. 2024-09-15T22:33:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.071+0000 7f52cb200640 1 Processor -- start 2024-09-15T22:33:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 -- start start 2024-09-15T22:33:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4074620 0x7f52c4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c4109cf0 0x7f52c41a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52c410f930 con 0x7f52c4074620 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52c410f7b0 con 0x7f52c4109cf0 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52cb200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52c410fab0 con 0x7f52c4074f60 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37478/0 (socket says 172.21.15.22:37478) 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52c9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4074620 0x7f52c4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.072+0000 7f52c9400640 1 -- 172.21.15.22:0/3431969809 learned_addr learned my addr 172.21.15.22:0/3431969809 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52ca800640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c4109cf0 0x7f52c41a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52c9400640 1 -- 172.21.15.22:0/3431969809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c4109cf0 msgr2=0x7f52c41a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52c9400640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c4109cf0 0x7f52c41a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52c9400640 1 -- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4074620 msgr2=0x7f52c4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52c9400640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4074620 0x7f52c4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52c9400640 1 -- 172.21.15.22:0/3431969809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c41a1bd0 con 0x7f52c4074f60 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.073+0000 7f52c9e00640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4074620 0x7f52c4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.074+0000 7f52c9400640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c419a4f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f52b4031440 tx=0x7f52b4032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.074+0000 7f52bea00640 1 -- 172.21.15.22:0/3431969809 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b403f030 con 0x7f52c4074f60 2024-09-15T22:33:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.074+0000 7f52bea00640 1 -- 172.21.15.22:0/3431969809 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52b4003ce0 con 0x7f52c4074f60 2024-09-15T22:33:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.074+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c41a1e60 con 0x7f52c4074f60 2024-09-15T22:33:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.074+0000 7f52bea00640 1 -- 172.21.15.22:0/3431969809 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4035070 con 0x7f52c4074f60 2024-09-15T22:33:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.074+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c41a2270 con 0x7f52c4074f60 2024-09-15T22:33:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 Processor -- start 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 -- start start 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846560660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x555846565660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x5558465680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5558464c5100 con 0x555846565c30 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55584646d1b0 con 0x555846560ba0 2024-09-15T22:33:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52cf847740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5558464c10c0 con 0x555846560260 2024-09-15T22:33:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.079+0000 7f52bea00640 1 -- 172.21.15.22:0/3431969809 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f52b4042030 con 0x7f52c4074f60 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.080+0000 7f52ca800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846560660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.080+0000 7f52c9400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x5558465680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.080+0000 7f52ca800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846560660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37492/0 (socket says 172.21.15.22:37492) 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.080+0000 7f52ca800640 1 -- 172.21.15.22:0/3228135876 learned_addr learned my addr 172.21.15.22:0/3228135876 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52ca800640 1 -- 172.21.15.22:0/3228135876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 msgr2=0x555846565660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.080+0000 7f52c9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x555846565660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52ca800640 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x555846565660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52ca800640 1 -- 172.21.15.22:0/3228135876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 msgr2=0x5558465680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52ca800640 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x5558465680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52ca800640 1 -- 172.21.15.22:0/3228135876 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558461d8210 con 0x555846560260 2024-09-15T22:33:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52c9400640 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x5558465680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.081+0000 7f52c9e00640 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x555846565660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.082+0000 7f52ca800640 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846560660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009fd0 tx=0x7f52c00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=943607527d60bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.082+0000 7f52bea00640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f52ac0a32d0 0x7f52ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.082+0000 7f52bea00640 1 -- 172.21.15.22:0/3431969809 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f52b40f02d0 con 0x7f52c4074f60 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.082+0000 7f52b3000640 1 -- 172.21.15.22:0/3228135876 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c0004d20 con 0x555846560260 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.083+0000 7f52b3000640 1 -- 172.21.15.22:0/3228135876 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52c0004050 con 0x555846560260 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.083+0000 7f52b3000640 1 -- 172.21.15.22:0/3228135876 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c0005260 con 0x555846560260 2024-09-15T22:33:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.083+0000 7f52c9e00640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f52ac0a32d0 0x7f52ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.083+0000 7f52cf847740 1 -- 172.21.15.22:0/3228135876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 msgr2=0x555846560660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.083+0000 7f52cf847740 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846560660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009fd0 tx=0x7f52c00118d0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.083+0000 7f52c9e00640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f52ac0a32d0 0x7f52ac0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5558465615d0 tx=0x7f52b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 -- 172.21.15.22:0/3228135876 shutdown_connections 2024-09-15T22:33:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x5558465680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x555846565660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 --2- 172.21.15.22:0/3228135876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846560660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 -- 172.21.15.22:0/3228135876 >> 172.21.15.22:0/3228135876 conn(0x55584655b8d0 msgr2=0x55584655bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 -- 172.21.15.22:0/3228135876 shutdown_connections 2024-09-15T22:33:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.084+0000 7f52cf847740 1 -- 172.21.15.22:0/3228135876 wait complete. 2024-09-15T22:33:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.085+0000 7f52cf847740 1 -- start start 2024-09-15T22:33:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.085+0000 7f52cf847740 1 Processor -- start 2024-09-15T22:33:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.086+0000 7f52cf847740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560260 0x55584656a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.086+0000 7f52cf847740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560ba0 0x55584656a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.086+0000 7f52cf847740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846565c30 0x555846571a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.086+0000 7f52cf847740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555846568c00 con 0x555846560260 2024-09-15T22:33:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.086+0000 7f52cf847740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55584644e090 con 0x555846565c30 2024-09-15T22:33:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.086+0000 7f52cf847740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555846568d80 con 0x555846560ba0 2024-09-15T22:33:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52cf847740 10 client.0 _ll_register_callbacks cb 0x5558464a2f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:25.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560ba0 0x55584656a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560ba0 0x55584656a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:37506/0 (socket says 172.21.15.22:37506) 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52c9400640 1 -- 172.21.15.22:0/687109916 learned_addr learned my addr 172.21.15.22:0/687109916 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52ca800640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846565c30 0x555846571a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52c9e00640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560260 0x55584656a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52ca800640 1 -- 172.21.15.22:0/687109916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560ba0 msgr2=0x55584656a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52ca800640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560ba0 0x55584656a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52ca800640 1 -- 172.21.15.22:0/687109916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560260 msgr2=0x55584656a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52ca800640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560260 0x55584656a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.087+0000 7f52ca800640 1 -- 172.21.15.22:0/687109916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558462a4620 con 0x555846565c30 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.088+0000 7f52c9e00640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560260 0x55584656a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.088+0000 7f52ca800640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846565c30 0x555846571a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f52c0011dd0 tx=0x7f52c0004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a32e24d5c9a630 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.088+0000 7f52a7400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.088+0000 7f52a7400640 1 -- 172.21.15.22:0/687109916 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c0028020 con 0x555846565c30 2024-09-15T22:33:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.088+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52c0004050 con 0x555846565c30 2024-09-15T22:33:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.088+0000 7f52a7400640 1 -- 172.21.15.22:0/687109916 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f52c0004410 con 0x555846565c30 2024-09-15T22:33:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.089+0000 7f52a7400640 1 -- 172.21.15.22:0/687109916 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f52c0004e60 con 0x555846565c30 2024-09-15T22:33:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.089+0000 7f52cf847740 10 client.25145 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.089+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55584657cfe0 con 0x555846565c30 2024-09-15T22:33:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.089+0000 7f52a7400640 1 -- 172.21.15.22:0/687109916 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52c0004050 con 0x555846565c30 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52a7400640 1 -- 172.21.15.22:0/687109916 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f52c000f550 con 0x555846565c30 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52cf847740 10 client.25145 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52cf847740 10 client.25145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52cf847740 20 client.25145 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52cf847740 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55584657e450 0x555846580840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52cf847740 4 client.25145 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558464d2830 con 0x55584657e450 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.090+0000 7f52c9e00640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55584657e450 0x555846580840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.091+0000 7f52c9e00640 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55584657e450 0x555846580840 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21847ec0fd2a0c78 server_cookie=a7f72267840da1e6 in_seq=0 out_seq=0 2024-09-15T22:33:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.091+0000 7f52a7400640 10 client.25145 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52a7400640 1 -- 172.21.15.22:0/687109916 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558464d2830 con 0x55584657e450 2024-09-15T22:33:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52a7400640 10 client.25145 handle_command_reply: tid=0 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 client.25145 shutdown 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846565c30 msgr2=0x555846571a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846565c30 0x555846571a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f52c0011dd0 tx=0x7f52c0004c70 comp rx=0 tx=0).stop 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 shutdown_connections 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55584657e450 0x555846580840 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560ba0 0x55584656a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846565c30 0x555846571a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 --2- 172.21.15.22:0/687109916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560260 0x55584656a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.092+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 >> 172.21.15.22:0/687109916 conn(0x55584655b8d0 msgr2=0x55584655d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.093+0000 7f52a7400640 0 client.25145 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.094+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 shutdown_connections 2024-09-15T22:33:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.094+0000 7f52cf847740 1 -- 172.21.15.22:0/687109916 wait complete. 2024-09-15T22:33:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.094+0000 7f52cf847740 20 client.25145 trim_cache size 0 max 16384 2024-09-15T22:33:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.110+0000 7f52cf847740 1 Processor -- start 2024-09-15T22:33:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.110+0000 7f52cf847740 1 -- start start 2024-09-15T22:33:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52cf847740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846569720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52cf847740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x5558465719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52cf847740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x55584655c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52cf847740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52c41a95d0 con 0x555846565c30 2024-09-15T22:33:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52cf847740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52c41a6ea0 con 0x555846560ba0 2024-09-15T22:33:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52cf847740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52c41a4cd0 con 0x555846560260 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52c9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x5558465719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52c9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846569720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52ca800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x55584655c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52c9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x5558465719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:54314/0 (socket says 172.21.15.22:54314) 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.111+0000 7f52c9400640 1 -- 172.21.15.22:0/1470071979 learned_addr learned my addr 172.21.15.22:0/1470071979 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9e00640 1 -- 172.21.15.22:0/1470071979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 msgr2=0x5558465719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9e00640 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x5558465719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9e00640 1 -- 172.21.15.22:0/1470071979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 msgr2=0x55584655c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9e00640 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x55584655c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9e00640 1 -- 172.21.15.22:0/1470071979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555846561970 con 0x555846560260 2024-09-15T22:33:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9400640 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x5558465719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52ca800640 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x55584655c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52c9e00640 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846569720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x555846581090 tx=0x7f52b8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b5702c6ad946949 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.112+0000 7f52b2600640 1 -- 172.21.15.22:0/1470071979 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b802a5b0 con 0x555846560260 2024-09-15T22:33:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52b2600640 1 -- 172.21.15.22:0/1470071979 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52b8011e90 con 0x555846560260 2024-09-15T22:33:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52b2600640 1 -- 172.21.15.22:0/1470071979 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8029cc0 con 0x555846560260 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 -- 172.21.15.22:0/1470071979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 msgr2=0x555846569720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846569720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x555846581090 tx=0x7f52b8016000 comp rx=0 tx=0).stop 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 -- 172.21.15.22:0/1470071979 shutdown_connections 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846565c30 0x55584655c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560ba0 0x5558465719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 --2- 172.21.15.22:0/1470071979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846560260 0x555846569720 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.113+0000 7f52cf847740 1 -- 172.21.15.22:0/1470071979 >> 172.21.15.22:0/1470071979 conn(0x55584655b8d0 msgr2=0x55584656a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.114+0000 7f52cf847740 1 -- 172.21.15.22:0/1470071979 shutdown_connections 2024-09-15T22:33:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.114+0000 7f52cf847740 1 -- 172.21.15.22:0/1470071979 wait complete. 2024-09-15T22:33:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.114+0000 7f52cf847740 1 -- start start 2024-09-15T22:33:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.114+0000 7f52cf847740 1 Processor -- start 2024-09-15T22:33:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 0x55584656e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560ba0 0x55584656ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846565c30 0x5558465e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52c41a5360 con 0x555846560ba0 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52c41a67d0 con 0x555846560260 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52c41a5a30 con 0x555846565c30 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52cf847740 10 client.0 _ll_register_callbacks cb 0x7f52b40f3c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52c9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 0x55584656e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52c9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 0x55584656e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:54326/0 (socket says 172.21.15.22:54326) 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52c9e00640 1 -- 172.21.15.22:0/2213038980 learned_addr learned my addr 172.21.15.22:0/2213038980 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52c9400640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560ba0 0x55584656ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.115+0000 7f52ca800640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846565c30 0x5558465e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52ca800640 1 -- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 msgr2=0x55584656e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52ca800640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 0x55584656e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52ca800640 1 -- 172.21.15.22:0/2213038980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560ba0 msgr2=0x55584656ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52ca800640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560ba0 0x55584656ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52ca800640 1 -- 172.21.15.22:0/2213038980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558465e7680 con 0x555846565c30 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52c9e00640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 0x55584656e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52c9400640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560ba0 0x55584656ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52ca800640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846565c30 0x5558465e7110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52c000f8f0 tx=0x7f52c0004d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49bb605ab2797be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52a7400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52a7400640 1 -- 172.21.15.22:0/2213038980 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c003c060 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52b8011e90 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.116+0000 7f52a7400640 1 -- 172.21.15.22:0/2213038980 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f52c000f4e0 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52a7400640 1 -- 172.21.15.22:0/2213038980 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f52c0028070 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 10 client.25159 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5558465e89d0 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52a7400640 1 -- 172.21.15.22:0/2213038980 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52b8011e90 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52a7400640 1 -- 172.21.15.22:0/2213038980 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f52c0041070 con 0x555846565c30 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 10 client.25159 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 10 client.25159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 20 client.25159 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:25.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5558465e9380 0x5558465eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:25.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.117+0000 7f52cf847740 4 client.25159 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:33:25.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.118+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558464ccb80 con 0x5558465e9380 2024-09-15T22:33:25.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.118+0000 7f52c9e00640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5558465e9380 0x5558465eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:25.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.118+0000 7f52a7400640 10 client.25159 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:25.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.118+0000 7f52c9e00640 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5558465e9380 0x5558465eb7a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa1467e81b147cb6 server_cookie=d55f470e6eea610c in_seq=0 out_seq=0 2024-09-15T22:33:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.122+0000 7f52a7400640 1 -- 172.21.15.22:0/2213038980 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558464ccb80 con 0x5558465e9380 2024-09-15T22:33:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.122+0000 7f52a7400640 10 client.25159 handle_command_reply: tid=0 2024-09-15T22:33:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.122+0000 7f52cf847740 1 client.25159 shutdown 2024-09-15T22:33:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.123+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846565c30 msgr2=0x5558465e7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.123+0000 7f52cf847740 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846565c30 0x5558465e7110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52c000f8f0 tx=0x7f52c0004d50 comp rx=0 tx=0).stop 2024-09-15T22:33:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 shutdown_connections 2024-09-15T22:33:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5558465e9380 0x5558465eb7a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52a7400640 0 client.25159 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555846565c30 0x5558465e7110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555846560ba0 0x55584656ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 --2- 172.21.15.22:0/2213038980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555846560260 0x55584656e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 >> 172.21.15.22:0/2213038980 conn(0x55584655b8d0 msgr2=0x55584655a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 shutdown_connections 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.124+0000 7f52cf847740 1 -- 172.21.15.22:0/2213038980 wait complete. 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.125+0000 7f52cf847740 20 client.25159 trim_cache size 0 max 16384 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:33:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.125+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f52ac0a32d0 msgr2=0x7f52ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.125+0000 7f52cb200640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f52ac0a32d0 0x7f52ac0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5558465615d0 tx=0x7f52b8005f90 comp rx=0 tx=0).stop 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.125+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 msgr2=0x7f52c419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.125+0000 7f52cb200640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c419a4f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f52b4031440 tx=0x7f52b4032ce0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 shutdown_connections 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52c4074f60 0x7f52c419a4f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f52ac0a32d0 0x7f52ac0a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c4109cf0 0x7f52c41a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 --2- 172.21.15.22:0/3431969809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52c4074620 0x7f52c4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 >> 172.21.15.22:0/3431969809 conn(0x7f52c40fd0d0 msgr2=0x7f52c4105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 shutdown_connections 2024-09-15T22:33:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:25.126+0000 7f52cb200640 1 -- 172.21.15.22:0/3431969809 wait complete. 2024-09-15T22:33:25.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:25 smithi112 ceph-mon[35032]: pgmap v378: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-15T22:33:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:25 smithi110 ceph-mon[35282]: pgmap v378: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-15T22:33:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:25 smithi022 ceph-mon[30634]: pgmap v378: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-15T22:33:27.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:27 smithi112 ceph-mon[35032]: pgmap v379: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:33:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:27 smithi110 ceph-mon[35282]: pgmap v379: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:33:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:27 smithi022 ceph-mon[30634]: pgmap v379: 97 pgs: 97 active+clean; 670 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-15T22:33:29.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:29 smithi112 ceph-mon[35032]: pgmap v380: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:33:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:29 smithi110 ceph-mon[35282]: pgmap v380: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:33:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:29 smithi022 ceph-mon[30634]: pgmap v380: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-15T22:33:31.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:31 smithi112 ceph-mon[35032]: pgmap v381: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:33:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:31 smithi110 ceph-mon[35282]: pgmap v381: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:33:31.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:31 smithi022 ceph-mon[30634]: pgmap v381: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:33:33.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:33 smithi112 ceph-mon[35032]: pgmap v382: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:33:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:33 smithi110 ceph-mon[35282]: pgmap v382: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:33:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:33 smithi022 ceph-mon[30634]: pgmap v382: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:33:34.918 INFO:tasks.workunit.client.0.smithi022.stderr:Updating files: 62% (8091/12889) Updating files: 63% (8121/12889) Updating files: 64% (8249/12889) Updating files: 65% (8378/12889) Updating files: 66% (8507/12889) Updating files: 67% (8636/12889) Updating files: 68% (8765/12889) Updating files: 69% (8894/12889) Updating files: 70% (9023/12889) Updating files: 71% (9152/12889) Updating files: 72% (9281/12889) Updating files: 73% (9409/12889) Updating files: 74% (9538/12889) Updating files: 75% (9667/12889) Updating files: 76% (9796/12889) Updating files: 77% (9925/12889) Updating files: 78% (10054/12889) Updating files: 79% (10183/12889) Updating files: 80% (10312/12889) Updating files: 81% (10441/12889) Updating files: 82% (10569/12889) Updating files: 83% (10698/12889) Updating files: 84% (10827/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 98% (12745/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-15T22:33:35.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:35 smithi112 ceph-mon[35032]: pgmap v383: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:33:35.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:35 smithi110 ceph-mon[35282]: pgmap v383: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:33:35.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:35 smithi022 ceph-mon[30634]: pgmap v383: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-15T22:33:36.026 INFO:tasks.workunit.client.0.smithi022.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T22:33:36.026 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: git switch -c 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:Or undo this operation with: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: git switch - 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.027 INFO:tasks.workunit.client.0.smithi022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T22:33:36.028 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:36.028 INFO:tasks.workunit.client.0.smithi022.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T22:33:36.041 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T22:33:36.139 INFO:tasks.workunit.client.0.smithi022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T22:33:36.143 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:33:36.144 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T22:33:36.875 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T22:33:36.964 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T22:33:37.031 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:33:37.035 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:33:37.035 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T22:33:37.102 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:33:37.109 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:33:37.109 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T22:33:37.144 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-15T22:33:37.145 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-15T22:33:37.145 DEBUG:teuthology.orchestra.run.smithi022:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-15T22:33:37.233 INFO:tasks.workunit.client.0.smithi022.stdout:getting iogen 2024-09-15T22:33:37.233 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'getting iogen' 2024-09-15T22:33:37.233 INFO:tasks.workunit.client.0.smithi022.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-15T22:33:37.271 INFO:tasks.workunit.client.0.smithi022.stderr:--2024-09-15 22:33:37-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-15T22:33:37.271 INFO:tasks.workunit.client.0.smithi022.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-15T22:33:37.293 INFO:tasks.workunit.client.0.smithi022.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-15T22:33:37.314 INFO:tasks.workunit.client.0.smithi022.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-15T22:33:37.314 INFO:tasks.workunit.client.0.smithi022.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-15T22:33:37.316 INFO:tasks.workunit.client.0.smithi022.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-15T22:33:37.320 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:37.320 INFO:tasks.workunit.client.0.smithi022.stderr: 0K ....... 100% 662M=0s 2024-09-15T22:33:37.320 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:37.320 INFO:tasks.workunit.client.0.smithi022.stderr:2024-09-15 22:33:37 (662 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-15T22:33:37.320 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-15T22:33:37.321 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-15T22:33:37.337 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0 2024-09-15T22:33:37.339 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/src 2024-09-15T22:33:37.340 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/src/iogen.8 2024-09-15T22:33:37.341 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/src/iogen.c 2024-09-15T22:33:37.342 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/README 2024-09-15T22:33:37.343 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/Makefile.bsd 2024-09-15T22:33:37.344 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/Makefile 2024-09-15T22:33:37.346 INFO:tasks.workunit.client.0.smithi022.stderr:+ cd iogen_3.1p0 2024-09-15T22:33:37.346 INFO:tasks.workunit.client.0.smithi022.stdout:making iogen 2024-09-15T22:33:37.346 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'making iogen' 2024-09-15T22:33:37.347 INFO:tasks.workunit.client.0.smithi022.stderr:+ make 2024-09-15T22:33:37.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:37 smithi112 ceph-mon[35032]: pgmap v384: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:33:37.356 INFO:tasks.workunit.client.0.smithi022.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-15T22:33:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:37 smithi110 ceph-mon[35282]: pgmap v384: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:33:37.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:37 smithi022 ceph-mon[30634]: pgmap v384: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-15T22:33:37.628 INFO:tasks.workunit.client.0.smithi022.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-15T22:33:37.753 INFO:tasks.workunit.client.0.smithi022.stdout:running iogen 2024-09-15T22:33:37.753 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'running iogen' 2024-09-15T22:33:37.753 INFO:tasks.workunit.client.0.smithi022.stderr:+ ./iogen -n 5 -s 2g 2024-09-15T22:33:37.754 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82821 2024-09-15T22:33:37.755 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82822 2024-09-15T22:33:37.755 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82823 2024-09-15T22:33:37.755 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82824 2024-09-15T22:33:37.756 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82825 2024-09-15T22:33:37.756 INFO:tasks.workunit.client.0.smithi022.stdout:sleep for 10 min 2024-09-15T22:33:37.756 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'sleep for 10 min' 2024-09-15T22:33:37.756 INFO:tasks.workunit.client.0.smithi022.stderr:+ sleep 600 2024-09-15T22:33:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 -- 172.21.15.22:0/830099128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101f40 msgr2=0x7f3c04109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/830099128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101f40 0x7f3c04109db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009ca0 tx=0x7f3bfc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 -- 172.21.15.22:0/830099128 shutdown_connections 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/830099128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04101580 0x7f3c04101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/830099128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101f40 0x7f3c04109db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/830099128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04103050 0x7f3c04103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.326+0000 7f3c0ac00640 1 -- 172.21.15.22:0/830099128 >> 172.21.15.22:0/830099128 conn(0x7f3c040fd0d0 msgr2=0x7f3c040ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.327+0000 7f3c0ac00640 1 -- 172.21.15.22:0/830099128 shutdown_connections 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.327+0000 7f3c0ac00640 1 -- 172.21.15.22:0/830099128 wait complete. 2024-09-15T22:33:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.328+0000 7f3c0ac00640 1 Processor -- start 2024-09-15T22:33:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.328+0000 7f3c0ac00640 1 -- start start 2024-09-15T22:33:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 0x7f3c04197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0ac00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04101f40 0x7f3c04198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0ac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04103050 0x7f3c0419f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0ac00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0410d720 con 0x7f3c04101f40 2024-09-15T22:33:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0410d5a0 con 0x7f3c04101580 2024-09-15T22:33:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0ac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0410d8a0 con 0x7f3c04103050 2024-09-15T22:33:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 0x7f3c04197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 0x7f3c04197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58712/0 (socket says 172.21.15.22:58712) 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c09800640 1 -- 172.21.15.22:0/1572336635 learned_addr learned my addr 172.21.15.22:0/1572336635 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04101f40 0x7f3c04198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.329+0000 7f3c0a200640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04103050 0x7f3c0419f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c09800640 1 -- 172.21.15.22:0/1572336635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04103050 msgr2=0x7f3c0419f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c09800640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04103050 0x7f3c0419f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c09800640 1 -- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04101f40 msgr2=0x7f3c04198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c09800640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04101f40 0x7f3c04198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c09800640 1 -- 172.21.15.22:0/1572336635 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0419f970 con 0x7f3c04101580 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c0a200640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04103050 0x7f3c0419f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04101f40 0x7f3c04198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.330+0000 7f3c09800640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 0x7f3c04197d50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800d950 tx=0x7f3bf800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.331+0000 7f3c02000640 1 -- 172.21.15.22:0/1572336635 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8017020 con 0x7f3c04101580 2024-09-15T22:33:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.331+0000 7f3c02000640 1 -- 172.21.15.22:0/1572336635 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8009c30 con 0x7f3c04101580 2024-09-15T22:33:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.331+0000 7f3c02000640 1 -- 172.21.15.22:0/1572336635 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800f720 con 0x7f3c04101580 2024-09-15T22:33:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.331+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c04074480 con 0x7f3c04101580 2024-09-15T22:33:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.331+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c04074980 con 0x7f3c04101580 2024-09-15T22:33:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.336+0000 7f3c0f1f7740 1 Processor -- start 2024-09-15T22:33:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 -- start start 2024-09-15T22:33:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c02000640 1 -- 172.21.15.22:0/1572336635 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f3bf801a020 con 0x7f3c04101580 2024-09-15T22:33:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddab260 0x5596cddab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddb0c30 0x5596cddb30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596cdd10100 con 0x5596cddab260 2024-09-15T22:33:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5596cdcb81b0 con 0x5596cddb0c30 2024-09-15T22:33:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.337+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5596cdd0c0c0 con 0x5596cddabba0 2024-09-15T22:33:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.339+0000 7f3c02000640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3bec0a3420 0x7f3bec0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.340+0000 7f3c09800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.340+0000 7f3c09800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50372/0 (socket says 172.21.15.22:50372) 2024-09-15T22:33:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.340+0000 7f3c09800640 1 -- 172.21.15.22:0/3657319699 learned_addr learned my addr 172.21.15.22:0/3657319699 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c0a200640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3bec0a3420 0x7f3bec0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c09800640 1 -- 172.21.15.22:0/3657319699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddb0c30 msgr2=0x5596cddb30f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c09800640 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddb0c30 0x5596cddb30f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c09800640 1 -- 172.21.15.22:0/3657319699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddab260 msgr2=0x5596cddab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c09800640 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddab260 0x5596cddab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c09800640 1 -- 172.21.15.22:0/3657319699 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596cda23210 con 0x5596cddabba0 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.341+0000 7f3c09800640 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb0660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8098270 tx=0x7f3bf80a12e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b27a2d601caee24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.342+0000 7f3bf6a00640 1 -- 172.21.15.22:0/3657319699 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8098840 con 0x5596cddabba0 2024-09-15T22:33:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.342+0000 7f3bf6a00640 1 -- 172.21.15.22:0/3657319699 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8005640 con 0x5596cddabba0 2024-09-15T22:33:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.342+0000 7f3bf6a00640 1 -- 172.21.15.22:0/3657319699 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80989e0 con 0x5596cddabba0 2024-09-15T22:33:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.342+0000 7f3c02000640 1 -- 172.21.15.22:0/1572336635 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f3bf8099eb0 con 0x7f3c04101580 2024-09-15T22:33:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/3657319699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 msgr2=0x5596cddb0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb0660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8098270 tx=0x7f3bf80a12e0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0a200640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3bec0a3420 0x7f3bec0a58e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc005e30 tx=0x7f3bfc005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/3657319699 shutdown_connections 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb0660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddb0c30 0x5596cddb30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/3657319699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddab260 0x5596cddab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/3657319699 >> 172.21.15.22:0/3657319699 conn(0x5596cdda68d0 msgr2=0x5596cdda6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/3657319699 shutdown_connections 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.343+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/3657319699 wait complete. 2024-09-15T22:33:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.344+0000 7f3c0f1f7740 1 -- start start 2024-09-15T22:33:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.345+0000 7f3c0f1f7740 1 Processor -- start 2024-09-15T22:33:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.345+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.345+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddabba0 0x5596cddb59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddb0c30 0x5596cddbca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596cddb3b10 con 0x5596cddabba0 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5596cdc99090 con 0x5596cddab260 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5596cddb3c90 con 0x5596cddb0c30 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58724/0 (socket says 172.21.15.22:58724) 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c09800640 1 -- 172.21.15.22:0/571919946 learned_addr learned my addr 172.21.15.22:0/571919946 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c0f1f7740 10 client.0 _ll_register_callbacks cb 0x5596cdcedf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c08e00640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddabba0 0x5596cddb59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.346+0000 7f3c0a200640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddb0c30 0x5596cddbca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c09800640 1 -- 172.21.15.22:0/571919946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddb0c30 msgr2=0x5596cddbca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c09800640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddb0c30 0x5596cddbca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c09800640 1 -- 172.21.15.22:0/571919946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddabba0 msgr2=0x5596cddb59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c09800640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddabba0 0x5596cddb59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c09800640 1 -- 172.21.15.22:0/571919946 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596cdaef620 con 0x5596cddab260 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c0a200640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddb0c30 0x5596cddbca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3c09800640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8023ff0 tx=0x7f3bf8010d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fdf6a1389de4eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3beb400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.347+0000 7f3beb400640 1 -- 172.21.15.22:0/571919946 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8098b80 con 0x5596cddab260 2024-09-15T22:33:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.348+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bf8005640 con 0x5596cddab260 2024-09-15T22:33:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.348+0000 7f3beb400640 1 -- 172.21.15.22:0/571919946 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f3bf8097b60 con 0x5596cddab260 2024-09-15T22:33:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.348+0000 7f3beb400640 1 -- 172.21.15.22:0/571919946 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bf8098d50 con 0x5596cddab260 2024-09-15T22:33:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.348+0000 7f3c0f1f7740 10 client.25160 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.348+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596cddc7fe0 con 0x5596cddab260 2024-09-15T22:33:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.348+0000 7f3beb400640 1 -- 172.21.15.22:0/571919946 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8005640 con 0x5596cddab260 2024-09-15T22:33:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3beb400640 1 -- 172.21.15.22:0/571919946 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3bf80ad020 con 0x5596cddab260 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c0f1f7740 10 client.25160 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c0f1f7740 10 client.25160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c0f1f7740 20 client.25160 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cddc9330 0x5596cddcb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c0f1f7740 4 client.25160 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596cdd1d830 con 0x5596cddc9330 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.349+0000 7f3c08e00640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cddc9330 0x5596cddcb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.350+0000 7f3c08e00640 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cddc9330 0x5596cddcb720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a5dccaf9edc9e2b server_cookie=e1ae7d2986802420 in_seq=0 out_seq=0 2024-09-15T22:33:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.350+0000 7f3beb400640 10 client.25160 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.351+0000 7f3beb400640 1 -- 172.21.15.22:0/571919946 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596cdd1d830 con 0x5596cddc9330 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.351+0000 7f3beb400640 10 client.25160 handle_command_reply: tid=0 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 client.25160 shutdown 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 msgr2=0x5596cddb5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8023ff0 tx=0x7f3bf8010d30 comp rx=0 tx=0).stop 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 shutdown_connections 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cddc9330 0x5596cddcb720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddb0c30 0x5596cddbca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddabba0 0x5596cddb59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3beb400640 0 client.25160 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/571919946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 >> 172.21.15.22:0/571919946 conn(0x5596cdda68d0 msgr2=0x5596cdda80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 shutdown_connections 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.352+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/571919946 wait complete. 2024-09-15T22:33:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.353+0000 7f3c0f1f7740 20 client.25160 trim_cache size 0 max 16384 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 Processor -- start 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 -- start start 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddbc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddb5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c041a94d0 con 0x5596cddb0c30 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c041a6da0 con 0x5596cddab260 2024-09-15T22:33:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.385+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c041a4bd0 con 0x5596cddabba0 2024-09-15T22:33:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddbc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddbc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50400/0 (socket says 172.21.15.22:50400) 2024-09-15T22:33:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 -- 172.21.15.22:0/1670438955 learned_addr learned my addr 172.21.15.22:0/1670438955 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58732/0 (socket says 172.21.15.22:58732) 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 -- 172.21.15.22:0/1670438955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 msgr2=0x5596cddb5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 -- 172.21.15.22:0/1670438955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 msgr2=0x5596cddb5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddb5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.386+0000 7f3c08e00640 1 -- 172.21.15.22:0/1670438955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596cdda66f0 con 0x5596cddabba0 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.387+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddbc9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009ac0 tx=0x7f3bf000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=518cdaaf26a01dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.387+0000 7f3bf6000640 1 -- 172.21.15.22:0/1670438955 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0004230 con 0x5596cddabba0 2024-09-15T22:33:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.387+0000 7f3bf6000640 1 -- 172.21.15.22:0/1670438955 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf00043d0 con 0x5596cddabba0 2024-09-15T22:33:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.387+0000 7f3bf6000640 1 -- 172.21.15.22:0/1670438955 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00035f0 con 0x5596cddabba0 2024-09-15T22:33:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1670438955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 msgr2=0x5596cddbc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddbc9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009ac0 tx=0x7f3bf000f790 comp rx=0 tx=0).stop 2024-09-15T22:33:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1670438955 shutdown_connections 2024-09-15T22:33:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddbc9c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddb5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1670438955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.388+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1670438955 >> 172.21.15.22:0/1670438955 conn(0x5596cdda68d0 msgr2=0x5596cddace80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.389+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1670438955 shutdown_connections 2024-09-15T22:33:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.390+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1670438955 wait complete. 2024-09-15T22:33:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.390+0000 7f3c0f1f7740 1 -- start start 2024-09-15T22:33:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.390+0000 7f3c0f1f7740 1 Processor -- start 2024-09-15T22:33:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddbafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c041a5260 con 0x5596cddb0c30 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c041a66d0 con 0x5596cddab260 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c041a5930 con 0x5596cddabba0 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c0f1f7740 10 client.0 _ll_register_callbacks cb 0x7f3bf8066f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.391+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c08e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:58742/0 (socket says 172.21.15.22:58742) 2024-09-15T22:33:38.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 -- 172.21.15.22:0/1048511186 learned_addr learned my addr 172.21.15.22:0/1048511186 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:38.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c0a200640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddbafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 -- 172.21.15.22:0/1048511186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 msgr2=0x5596cddb9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 -- 172.21.15.22:0/1048511186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 msgr2=0x5596cddbafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddbafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c09800640 1 -- 172.21.15.22:0/1048511186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596cddbb5e0 con 0x5596cddab260 2024-09-15T22:33:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.392+0000 7f3c0a200640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddbafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.393+0000 7f3c09800640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb9a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8005b60 tx=0x7f3bf8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c4c8059b3cd41d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.393+0000 7f3beb400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.393+0000 7f3beb400640 1 -- 172.21.15.22:0/1048511186 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf807e070 con 0x5596cddab260 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.394+0000 7f3beb400640 1 -- 172.21.15.22:0/1048511186 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f3bf809b260 con 0x5596cddab260 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.394+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bf00043d0 con 0x5596cddab260 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.394+0000 7f3beb400640 1 -- 172.21.15.22:0/1048511186 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bf8098ef0 con 0x5596cddab260 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.394+0000 7f3c0f1f7740 10 client.25166 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.394+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596cddbb5e0 con 0x5596cddab260 2024-09-15T22:33:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.394+0000 7f3beb400640 1 -- 172.21.15.22:0/1048511186 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf00043d0 con 0x5596cddab260 2024-09-15T22:33:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3beb400640 1 -- 172.21.15.22:0/1048511186 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3bf80ad040 con 0x5596cddab260 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c0f1f7740 10 client.25166 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c0f1f7740 10 client.25166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c0f1f7740 20 client.25166 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cde33eb0 0x5596cde362a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c0f1f7740 4 client.25166 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596cdd17b80 con 0x5596cde33eb0 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.395+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cde33eb0 0x5596cde362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.396+0000 7f3c08e00640 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cde33eb0 0x5596cde362a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b646c216e5c8a7cf server_cookie=d02366ecc7ea6d7f in_seq=0 out_seq=0 2024-09-15T22:33:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.396+0000 7f3beb400640 10 client.25166 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.413+0000 7f3beb400640 1 -- 172.21.15.22:0/1048511186 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596cdd17b80 con 0x5596cde33eb0 2024-09-15T22:33:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.413+0000 7f3beb400640 10 client.25166 handle_command_reply: tid=0 2024-09-15T22:33:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.413+0000 7f3c0f1f7740 1 client.25166 shutdown 2024-09-15T22:33:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.413+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 msgr2=0x5596cddb9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.413+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb9a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8005b60 tx=0x7f3bf8000bc0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.413+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 shutdown_connections 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5596cde33eb0 0x5596cde362a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5596cddabba0 0x5596cddb9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596cddb0c30 0x5596cddbafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 --2- 172.21.15.22:0/1048511186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5596cddab260 0x5596cddb9a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 >> 172.21.15.22:0/1048511186 conn(0x5596cdda68d0 msgr2=0x5596cddb5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3beb400640 0 client.25166 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 shutdown_connections 2024-09-15T22:33:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 1 -- 172.21.15.22:0/1048511186 wait complete. 2024-09-15T22:33:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.414+0000 7f3c0f1f7740 20 client.25166 trim_cache size 0 max 16384 2024-09-15T22:33:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:33:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:33:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:33:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:33:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.415+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3bec0a3420 msgr2=0x7f3bec0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.415+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3bec0a3420 0x7f3bec0a58e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc005e30 tx=0x7f3bfc005dc0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.415+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 msgr2=0x7f3c04197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.415+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 0x7f3c04197d50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800d950 tx=0x7f3bf800de10 comp rx=0 tx=0).stop 2024-09-15T22:33:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.415+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 shutdown_connections 2024-09-15T22:33:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.415+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c04103050 0x7f3c0419f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.416+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3bec0a3420 0x7f3bec0a58e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.416+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c04101f40 0x7f3c04198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.416+0000 7f3c0ac00640 1 --2- 172.21.15.22:0/1572336635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04101580 0x7f3c04197d50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.416+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 >> 172.21.15.22:0/1572336635 conn(0x7f3c040fd0d0 msgr2=0x7f3c04105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.416+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 shutdown_connections 2024-09-15T22:33:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:38.416+0000 7f3c0ac00640 1 -- 172.21.15.22:0/1572336635 wait complete. 2024-09-15T22:33:39.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:39 smithi112 ceph-mon[35032]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:33:39.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:39 smithi110 ceph-mon[35282]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:33:39.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:39 smithi022 ceph-mon[30634]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-15T22:33:41.338 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:41 smithi022 ceph-mon[30634]: pgmap v386: 97 pgs: 97 active+clean; 17 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-15T22:33:41.338 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:41 smithi022 ceph-mon[30634]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-15T22:33:41.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:41 smithi112 ceph-mon[35032]: pgmap v386: 97 pgs: 97 active+clean; 17 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-15T22:33:41.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:41 smithi112 ceph-mon[35032]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-15T22:33:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:41 smithi110 ceph-mon[35282]: pgmap v386: 97 pgs: 97 active+clean; 17 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-15T22:33:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:41 smithi110 ceph-mon[35282]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-15T22:33:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:33:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:42 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:33:42.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:42 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:33:42.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:42.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:42 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:43.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:43 smithi022 ceph-mon[30634]: pgmap v387: 97 pgs: 97 active+clean; 221 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 23 op/s 2024-09-15T22:33:43.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:43.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:43 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:43.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:43 smithi112 ceph-mon[35032]: pgmap v387: 97 pgs: 97 active+clean; 221 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 23 op/s 2024-09-15T22:33:43.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:43.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:43 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:43 smithi110 ceph-mon[35282]: pgmap v387: 97 pgs: 97 active+clean; 221 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 23 op/s 2024-09-15T22:33:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:43 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:44.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:33:44.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:33:44.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:44 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:44.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:33:44.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:33:44.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:44 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:44.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:33:44.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:33:44.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:44 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:33:45.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:45 smithi022 ceph-mon[30634]: pgmap v388: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 50 MiB/s wr, 31 op/s 2024-09-15T22:33:45.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:45 smithi112 ceph-mon[35032]: pgmap v388: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 50 MiB/s wr, 31 op/s 2024-09-15T22:33:45.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:45 smithi110 ceph-mon[35282]: pgmap v388: 97 pgs: 97 active+clean; 601 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 50 MiB/s wr, 31 op/s 2024-09-15T22:33:47.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:47 smithi022 ceph-mon[30634]: pgmap v389: 97 pgs: 97 active+clean; 989 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 82 MiB/s wr, 41 op/s 2024-09-15T22:33:47.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:47 smithi112 ceph-mon[35032]: pgmap v389: 97 pgs: 97 active+clean; 989 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 82 MiB/s wr, 41 op/s 2024-09-15T22:33:47.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:47 smithi110 ceph-mon[35282]: pgmap v389: 97 pgs: 97 active+clean; 989 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 82 MiB/s wr, 41 op/s 2024-09-15T22:33:49.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:49 smithi022 ceph-mon[30634]: pgmap v390: 97 pgs: 97 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 145 MiB/s wr, 59 op/s 2024-09-15T22:33:49.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:49 smithi112 ceph-mon[35032]: pgmap v390: 97 pgs: 97 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 145 MiB/s wr, 59 op/s 2024-09-15T22:33:49.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:49 smithi110 ceph-mon[35282]: pgmap v390: 97 pgs: 97 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 145 MiB/s wr, 59 op/s 2024-09-15T22:33:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 -- 172.21.15.22:0/3413250533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34102d50 msgr2=0x7fcd341031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 --2- 172.21.15.22:0/3413250533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34102d50 0x7fcd341031d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009860 tx=0x7fcd2002a360 comp rx=0 tx=0).stop 2024-09-15T22:33:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 -- 172.21.15.22:0/3413250533 shutdown_connections 2024-09-15T22:33:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 --2- 172.21.15.22:0/3413250533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd34103710 0x7fcd34109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 --2- 172.21.15.22:0/3413250533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34102d50 0x7fcd341031d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 --2- 172.21.15.22:0/3413250533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34101b60 0x7fcd34101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.612+0000 7fcd39400640 1 -- 172.21.15.22:0/3413250533 >> 172.21.15.22:0/3413250533 conn(0x7fcd340fd2e0 msgr2=0x7fcd340ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.614+0000 7fcd39400640 1 -- 172.21.15.22:0/3413250533 shutdown_connections 2024-09-15T22:33:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.614+0000 7fcd39400640 1 -- 172.21.15.22:0/3413250533 wait complete. 2024-09-15T22:33:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.615+0000 7fcd39400640 1 Processor -- start 2024-09-15T22:33:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.615+0000 7fcd39400640 1 -- start start 2024-09-15T22:33:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd39400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd34101b60 0x7fcd34075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd39400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34102d50 0x7fcd340745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd39400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34103710 0x7fcd34074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd39400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3410d7c0 con 0x7fcd34102d50 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd39400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3410d640 con 0x7fcd34103710 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd39400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3410d940 con 0x7fcd34101b60 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.616+0000 7fcd31e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34102d50 0x7fcd340745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.617+0000 7fcd33200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34103710 0x7fcd34074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.617+0000 7fcd33200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34103710 0x7fcd34074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37060/0 (socket says 172.21.15.22:37060) 2024-09-15T22:33:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.617+0000 7fcd33200640 1 -- 172.21.15.22:0/828400549 learned_addr learned my addr 172.21.15.22:0/828400549 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.617+0000 7fcd32800640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd34101b60 0x7fcd34075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.618+0000 7fcd31e00640 1 -- 172.21.15.22:0/828400549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd34101b60 msgr2=0x7fcd34075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.618+0000 7fcd31e00640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd34101b60 0x7fcd34075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.618+0000 7fcd31e00640 1 -- 172.21.15.22:0/828400549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34103710 msgr2=0x7fcd34074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.618+0000 7fcd31e00640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34103710 0x7fcd34074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.619+0000 7fcd31e00640 1 -- 172.21.15.22:0/828400549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd34075060 con 0x7fcd34102d50 2024-09-15T22:33:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.620+0000 7fcd31e00640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34102d50 0x7fcd340745e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcd20035040 tx=0x7fcd20033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:51.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.623+0000 7fcd2b400640 1 -- 172.21.15.22:0/828400549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2003f030 con 0x7fcd34102d50 2024-09-15T22:33:51.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.623+0000 7fcd2b400640 1 -- 172.21.15.22:0/828400549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd20004020 con 0x7fcd34102d50 2024-09-15T22:33:51.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.623+0000 7fcd2b400640 1 -- 172.21.15.22:0/828400549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20037040 con 0x7fcd34102d50 2024-09-15T22:33:51.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.623+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd340752f0 con 0x7fcd34102d50 2024-09-15T22:33:51.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.624+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd341a6810 con 0x7fcd34102d50 2024-09-15T22:33:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.641+0000 7fcd3c44a740 1 Processor -- start 2024-09-15T22:33:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 -- start start 2024-09-15T22:33:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f6091490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f6096490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f6098f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5ff6100 con 0x55a2f6096a60 2024-09-15T22:33:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5f9e1b0 con 0x55a2f6091090 2024-09-15T22:33:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.644+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5ff20c0 con 0x55a2f60919d0 2024-09-15T22:33:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.645+0000 7fcd33200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f6091490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.645+0000 7fcd2b400640 1 -- 172.21.15.22:0/828400549 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fcd20042070 con 0x7fcd34102d50 2024-09-15T22:33:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.645+0000 7fcd33200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f6091490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37064/0 (socket says 172.21.15.22:37064) 2024-09-15T22:33:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.645+0000 7fcd33200640 1 -- 172.21.15.22:0/1927099654 learned_addr learned my addr 172.21.15.22:0/1927099654 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.646+0000 7fcd32800640 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f6096490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.646+0000 7fcd33200640 1 -- 172.21.15.22:0/1927099654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 msgr2=0x55a2f6096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.646+0000 7fcd33200640 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f6096490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.646+0000 7fcd33200640 1 -- 172.21.15.22:0/1927099654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 msgr2=0x55a2f6098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.646+0000 7fcd33200640 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f6098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.646+0000 7fcd33200640 1 -- 172.21.15.22:0/1927099654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f5d09210 con 0x55a2f6091090 2024-09-15T22:33:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.647+0000 7fcd33200640 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f6091490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009fb0 tx=0x7fcd2c011870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d81c5f74fd23625 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.647+0000 7fcd1f400640 1 -- 172.21.15.22:0/1927099654 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0127d0 con 0x55a2f6091090 2024-09-15T22:33:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.647+0000 7fcd1f400640 1 -- 172.21.15.22:0/1927099654 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2c012e50 con 0x55a2f6091090 2024-09-15T22:33:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.648+0000 7fcd2b400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcd180a34e0 0x7fcd180a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.648+0000 7fcd3c44a740 1 -- 172.21.15.22:0/1927099654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 msgr2=0x55a2f6091490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.648+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f6091490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009fb0 tx=0x7fcd2c011870 comp rx=0 tx=0).stop 2024-09-15T22:33:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd2b400640 1 -- 172.21.15.22:0/828400549 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fcd200eecd0 con 0x7fcd34102d50 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd3c44a740 1 -- 172.21.15.22:0/1927099654 shutdown_connections 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f6096490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f6098f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/1927099654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f6091490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd3c44a740 1 -- 172.21.15.22:0/1927099654 >> 172.21.15.22:0/1927099654 conn(0x55a2f608c700 msgr2=0x55a2f608cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd32800640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcd180a34e0 0x7fcd180a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.649+0000 7fcd3c44a740 1 -- 172.21.15.22:0/1927099654 shutdown_connections 2024-09-15T22:33:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.651+0000 7fcd3c44a740 1 -- 172.21.15.22:0/1927099654 wait complete. 2024-09-15T22:33:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.651+0000 7fcd32800640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcd180a34e0 0x7fcd180a59a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55a2f608d580 tx=0x7fcd2400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.651+0000 7fcd3c44a740 1 -- start start 2024-09-15T22:33:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.653+0000 7fcd3c44a740 1 Processor -- start 2024-09-15T22:33:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.653+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f609b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.653+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f609b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a2f6099ad0 con 0x55a2f6096a60 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a2f5f7f090 con 0x55a2f60919d0 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a2f6099c50 con 0x55a2f6091090 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd3c44a740 10 client.0 _ll_register_callbacks cb 0x55a2f5fd3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd32800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f609b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd31e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f609b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd31e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f609b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37076/0 (socket says 172.21.15.22:37076) 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd31e00640 1 -- 172.21.15.22:0/873067718 learned_addr learned my addr 172.21.15.22:0/873067718 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.654+0000 7fcd33200640 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd31e00640 1 -- 172.21.15.22:0/873067718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 msgr2=0x55a2f609b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd31e00640 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f609b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd31e00640 1 -- 172.21.15.22:0/873067718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 msgr2=0x55a2f60a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd31e00640 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd31e00640 1 -- 172.21.15.22:0/873067718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f5dd5620 con 0x55a2f60919d0 2024-09-15T22:33:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd31e00640 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f609b7b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd200b7c80 tx=0x7fcd200bac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8571051d684ba5cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.655+0000 7fcd13e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.657+0000 7fcd13e00640 1 -- 172.21.15.22:0/873067718 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200bb710 con 0x55a2f60919d0 2024-09-15T22:33:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.657+0000 7fcd13e00640 1 -- 172.21.15.22:0/873067718 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fcd200c3a90 con 0x55a2f60919d0 2024-09-15T22:33:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.657+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd2c012e50 con 0x55a2f60919d0 2024-09-15T22:33:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd13e00640 1 -- 172.21.15.22:0/873067718 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd200c3d10 con 0x55a2f60919d0 2024-09-15T22:33:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 10 client.25178 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2f60b65f0 con 0x55a2f60919d0 2024-09-15T22:33:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd13e00640 1 -- 172.21.15.22:0/873067718 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2c012e50 con 0x55a2f60919d0 2024-09-15T22:33:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd13e00640 1 -- 172.21.15.22:0/873067718 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcd2003a030 con 0x55a2f60919d0 2024-09-15T22:33:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 10 client.25178 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 10 client.25178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 20 client.25178 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f60b7d20 0x55a2f60ba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 4 client.25178 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.658+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2f6003830 con 0x55a2f60b7d20 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.659+0000 7fcd32800640 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f60b7d20 0x55a2f60ba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.659+0000 7fcd13e00640 10 client.25178 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.660+0000 7fcd32800640 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f60b7d20 0x55a2f60ba110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33bc66bedd0a2894 server_cookie=958337d25d813f41 in_seq=0 out_seq=0 2024-09-15T22:33:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd13e00640 1 -- 172.21.15.22:0/873067718 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2f6003830 con 0x55a2f60b7d20 2024-09-15T22:33:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd13e00640 10 client.25178 handle_command_reply: tid=0 2024-09-15T22:33:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 client.25178 shutdown 2024-09-15T22:33:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 msgr2=0x55a2f609b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f609b7b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd200b7c80 tx=0x7fcd200bac10 comp rx=0 tx=0).stop 2024-09-15T22:33:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 shutdown_connections 2024-09-15T22:33:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f60b7d20 0x55a2f60ba110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f609b7b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/873067718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f609b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd13e00640 0 client.25178 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.661+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 >> 172.21.15.22:0/873067718 conn(0x55a2f608c700 msgr2=0x55a2f608df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.662+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 shutdown_connections 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.662+0000 7fcd3c44a740 1 -- 172.21.15.22:0/873067718 wait complete. 2024-09-15T22:33:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.662+0000 7fcd3c44a740 20 client.25178 trim_cache size 0 max 16384 2024-09-15T22:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 Processor -- start 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 -- start start 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f608dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f608e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd341a96d0 con 0x55a2f6096a60 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcd341a6fa0 con 0x55a2f60919d0 2024-09-15T22:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd34072740 con 0x55a2f6091090 2024-09-15T22:33:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.692+0000 7fcd31e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f608e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f608e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37078/0 (socket says 172.21.15.22:37078) 2024-09-15T22:33:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 -- 172.21.15.22:0/2197718831 learned_addr learned my addr 172.21.15.22:0/2197718831 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd32800640 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f608dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd33200640 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 -- 172.21.15.22:0/2197718831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 msgr2=0x55a2f608dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f608dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 -- 172.21.15.22:0/2197718831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 msgr2=0x55a2f60a27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 -- 172.21.15.22:0/2197718831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f608d3b0 con 0x55a2f60919d0 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd31e00640 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f608e200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcd20030450 tx=0x7fcd200bad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a48cde33a9b078 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.693+0000 7fcd1ea00640 1 -- 172.21.15.22:0/2197718831 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200c5070 con 0x55a2f60919d0 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd1ea00640 1 -- 172.21.15.22:0/2197718831 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd200bb2b0 con 0x55a2f60919d0 2024-09-15T22:33:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd1ea00640 1 -- 172.21.15.22:0/2197718831 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200d8070 con 0x55a2f60919d0 2024-09-15T22:33:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 -- 172.21.15.22:0/2197718831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 msgr2=0x55a2f608e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f608e200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcd20030450 tx=0x7fcd200bad40 comp rx=0 tx=0).stop 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 -- 172.21.15.22:0/2197718831 shutdown_connections 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f60919d0 0x55a2f608e200 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/2197718831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f6091090 0x55a2f608dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 -- 172.21.15.22:0/2197718831 >> 172.21.15.22:0/2197718831 conn(0x55a2f608c700 msgr2=0x55a2f608d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.694+0000 7fcd3c44a740 1 -- 172.21.15.22:0/2197718831 shutdown_connections 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 -- 172.21.15.22:0/2197718831 wait complete. 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 -- start start 2024-09-15T22:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 Processor -- start 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f60a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f60a0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd34072dd0 con 0x55a2f6096a60 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcd34074240 con 0x55a2f6091090 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340734a0 con 0x55a2f60919d0 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.695+0000 7fcd3c44a740 10 client.0 _ll_register_callbacks cb 0x7fcd200bb080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f60a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f60a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37086/0 (socket says 172.21.15.22:37086) 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 -- 172.21.15.22:0/3990486003 learned_addr learned my addr 172.21.15.22:0/3990486003 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd33200640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd31e00640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f60a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 -- 172.21.15.22:0/3990486003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 msgr2=0x55a2f60a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f60a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 -- 172.21.15.22:0/3990486003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 msgr2=0x55a2f60a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 -- 172.21.15.22:0/3990486003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f6092660 con 0x55a2f6091090 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd31e00640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f60a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd33200640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd32800640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f60a01f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd24005940 tx=0x7fcd240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d364362f62be5b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.696+0000 7fcd13e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd13e00640 1 -- 172.21.15.22:0/3990486003 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2401eb30 con 0x55a2f6091090 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd13e00640 1 -- 172.21.15.22:0/3990486003 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fcd2401ecd0 con 0x55a2f6091090 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd200bb2b0 con 0x55a2f6091090 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd13e00640 1 -- 172.21.15.22:0/3990486003 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd24005020 con 0x55a2f6091090 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd3c44a740 10 client.25184 fetch_fsmap learned FSMap version 25 2024-09-15T22:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2f6122c10 con 0x55a2f6091090 2024-09-15T22:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd13e00640 1 -- 172.21.15.22:0/3990486003 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd200bb2b0 con 0x55a2f6091090 2024-09-15T22:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.697+0000 7fcd13e00640 1 -- 172.21.15.22:0/3990486003 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcd2402a380 con 0x55a2f6091090 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd3c44a740 10 client.25184 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd3c44a740 10 client.25184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd3c44a740 20 client.25184 populate_metadata read hostname 'smithi022' 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f61235f0 0x55a2f6125a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd3c44a740 4 client.25184 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2f5ffdb80 con 0x55a2f61235f0 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd31e00640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f61235f0 0x55a2f6125a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd13e00640 10 client.25184 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.698+0000 7fcd31e00640 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f61235f0 0x55a2f6125a10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329e29c311179296 server_cookie=80b111c2cf47f945 in_seq=0 out_seq=0 2024-09-15T22:33:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.709+0000 7fcd13e00640 1 -- 172.21.15.22:0/3990486003 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2f5ffdb80 con 0x55a2f61235f0 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.709+0000 7fcd13e00640 10 client.25184 handle_command_reply: tid=0 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.709+0000 7fcd3c44a740 1 client.25184 shutdown 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 msgr2=0x55a2f60a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f60a01f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd24005940 tx=0x7fcd240046c0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 shutdown_connections 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55a2f61235f0 0x55a2f6125a10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a2f60919d0 0x55a2f60a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2f6096a60 0x55a2f60a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd13e00640 0 client.25184 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 --2- 172.21.15.22:0/3990486003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a2f6091090 0x55a2f60a01f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 >> 172.21.15.22:0/3990486003 conn(0x55a2f608c700 msgr2=0x55a2f608ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 shutdown_connections 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 1 -- 172.21.15.22:0/3990486003 wait complete. 2024-09-15T22:33:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.710+0000 7fcd3c44a740 20 client.25184 trim_cache size 0 max 16384 2024-09-15T22:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcd180a34e0 msgr2=0x7fcd180a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcd180a34e0 0x7fcd180a59a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55a2f608d580 tx=0x7fcd2400b410 comp rx=0 tx=0).stop 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34102d50 msgr2=0x7fcd340745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34102d50 0x7fcd340745e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcd20035040 tx=0x7fcd20033d90 comp rx=0 tx=0).stop 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 shutdown_connections 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcd180a34e0 0x7fcd180a59a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd34103710 0x7fcd34074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd34102d50 0x7fcd340745e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 --2- 172.21.15.22:0/828400549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd34101b60 0x7fcd34075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 >> 172.21.15.22:0/828400549 conn(0x7fcd340fd2e0 msgr2=0x7fcd34106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:33:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 shutdown_connections 2024-09-15T22:33:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:33:51.711+0000 7fcd39400640 1 -- 172.21.15.22:0/828400549 wait complete. 2024-09-15T22:33:51.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:51 smithi022 ceph-mon[30634]: pgmap v391: 97 pgs: 97 active+clean; 2.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 185 MiB/s wr, 68 op/s 2024-09-15T22:33:51.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:51 smithi112 ceph-mon[35032]: pgmap v391: 97 pgs: 97 active+clean; 2.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 185 MiB/s wr, 68 op/s 2024-09-15T22:33:51.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:51 smithi110 ceph-mon[35282]: pgmap v391: 97 pgs: 97 active+clean; 2.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 185 MiB/s wr, 68 op/s 2024-09-15T22:33:53.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:53 smithi022 ceph-mon[30634]: pgmap v392: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 231 MiB/s wr, 81 op/s 2024-09-15T22:33:53.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:53 smithi112 ceph-mon[35032]: pgmap v392: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 231 MiB/s wr, 81 op/s 2024-09-15T22:33:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:53 smithi110 ceph-mon[35282]: pgmap v392: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 231 MiB/s wr, 81 op/s 2024-09-15T22:33:54.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:54 smithi110 ceph-mon[35282]: pgmap v393: 97 pgs: 97 active+clean; 3.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 77 op/s 2024-09-15T22:33:55.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:54 smithi022 ceph-mon[30634]: pgmap v393: 97 pgs: 97 active+clean; 3.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 77 op/s 2024-09-15T22:33:55.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:54 smithi112 ceph-mon[35032]: pgmap v393: 97 pgs: 97 active+clean; 3.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 77 op/s 2024-09-15T22:33:56.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:56 smithi110 ceph-mon[35282]: pgmap v394: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 261 MiB/s wr, 76 op/s 2024-09-15T22:33:57.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:56 smithi022 ceph-mon[30634]: pgmap v394: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 261 MiB/s wr, 76 op/s 2024-09-15T22:33:57.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:56 smithi112 ceph-mon[35032]: pgmap v394: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 261 MiB/s wr, 76 op/s 2024-09-15T22:33:58.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:33:58 smithi110 ceph-mon[35282]: pgmap v395: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 286 MiB/s wr, 86 op/s 2024-09-15T22:33:59.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:33:58 smithi022 ceph-mon[30634]: pgmap v395: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 286 MiB/s wr, 86 op/s 2024-09-15T22:33:59.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:33:58 smithi112 ceph-mon[35032]: pgmap v395: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 286 MiB/s wr, 86 op/s 2024-09-15T22:34:00.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:00 smithi110 ceph-mon[35282]: pgmap v396: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 265 MiB/s wr, 77 op/s 2024-09-15T22:34:01.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:00 smithi022 ceph-mon[30634]: pgmap v396: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 265 MiB/s wr, 77 op/s 2024-09-15T22:34:01.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:00 smithi112 ceph-mon[35032]: pgmap v396: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 265 MiB/s wr, 77 op/s 2024-09-15T22:34:02.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:02 smithi110 ceph-mon[35282]: pgmap v397: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 271 MiB/s wr, 82 op/s 2024-09-15T22:34:03.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:02 smithi022 ceph-mon[30634]: pgmap v397: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 271 MiB/s wr, 82 op/s 2024-09-15T22:34:03.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:02 smithi112 ceph-mon[35032]: pgmap v397: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 271 MiB/s wr, 82 op/s 2024-09-15T22:34:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.934+0000 7fe7aca00640 1 -- 172.21.15.22:0/1433061393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073390 msgr2=0x7fe7a8073810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.934+0000 7fe7aca00640 1 --2- 172.21.15.22:0/1433061393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073390 0x7fe7a8073810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe794009900 tx=0x7fe79402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.935+0000 7fe7aca00640 1 -- 172.21.15.22:0/1433061393 shutdown_connections 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.935+0000 7fe7aca00640 1 --2- 172.21.15.22:0/1433061393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073390 0x7fe7a8073810 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.935+0000 7fe7aca00640 1 --2- 172.21.15.22:0/1433061393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a8073d50 0x7fe7a8114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.935+0000 7fe7aca00640 1 --2- 172.21.15.22:0/1433061393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a81094f0 0x7fe7a81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.935+0000 7fe7aca00640 1 -- 172.21.15.22:0/1433061393 >> 172.21.15.22:0/1433061393 conn(0x7fe7a806ed10 msgr2=0x7fe7a8071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.936+0000 7fe7aca00640 1 -- 172.21.15.22:0/1433061393 shutdown_connections 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.936+0000 7fe7aca00640 1 -- 172.21.15.22:0/1433061393 wait complete. 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.937+0000 7fe7aca00640 1 Processor -- start 2024-09-15T22:34:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.937+0000 7fe7aca00640 1 -- start start 2024-09-15T22:34:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.938+0000 7fe7aca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 0x7fe7a81a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.938+0000 7fe7aca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 0x7fe7a81a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7aca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a81094f0 0x7fe7a81ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 0x7fe7a81a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 0x7fe7a81a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:45584/0 (socket says 172.21.15.22:45584) 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 0x7fe7a81a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 0x7fe7a81a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33594/0 (socket says 172.21.15.22:33594) 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a810f700 con 0x7fe7a81094f0 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a810f580 con 0x7fe7a8073390 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a810f880 con 0x7fe7a8073d50 2024-09-15T22:34:04.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a5e00640 1 -- 172.21.15.22:0/2301710546 learned_addr learned my addr 172.21.15.22:0/2301710546 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 -- 172.21.15.22:0/2301710546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 msgr2=0x7fe7a81a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 0x7fe7a81a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 -- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a81094f0 msgr2=0x7fe7a81ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a81094f0 0x7fe7a81ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a6800640 1 -- 172.21.15.22:0/2301710546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a81ae730 con 0x7fe7a8073390 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.939+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 0x7fe7a81a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:04.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.940+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 0x7fe7a81a6b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8073320 tx=0x7fe79800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:04.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.940+0000 7fe79f400640 1 -- 172.21.15.22:0/2301710546 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798017070 con 0x7fe7a8073390 2024-09-15T22:34:04.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.940+0000 7fe79f400640 1 -- 172.21.15.22:0/2301710546 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe798009c30 con 0x7fe7a8073390 2024-09-15T22:34:04.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.940+0000 7fe79f400640 1 -- 172.21.15.22:0/2301710546 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79800f620 con 0x7fe7a8073390 2024-09-15T22:34:04.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.940+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a81aea20 con 0x7fe7a8073390 2024-09-15T22:34:04.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.940+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a81aef20 con 0x7fe7a8073390 2024-09-15T22:34:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 Processor -- start 2024-09-15T22:34:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 -- start start 2024-09-15T22:34:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaeb6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaebb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 0x55dccaebe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dccae1b100 con 0x55dccaebbc30 2024-09-15T22:34:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dccadc31b0 con 0x55dccaeb6260 2024-09-15T22:34:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.945+0000 7fe7b03db740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dccae170c0 con 0x55dccaeb6ba0 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.946+0000 7fe7a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 0x55dccaebe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.946+0000 7fe7a6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaebb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.946+0000 7fe7a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 0x55dccaebe0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41908/0 (socket says 172.21.15.22:41908) 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.946+0000 7fe7a5e00640 1 -- 172.21.15.22:0/2537820602 learned_addr learned my addr 172.21.15.22:0/2537820602 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.946+0000 7fe79f400640 1 -- 172.21.15.22:0/2301710546 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe79801a070 con 0x7fe7a8073390 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.947+0000 7fe7a6800640 1 -- 172.21.15.22:0/2537820602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 msgr2=0x55dccaeb6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.946+0000 7fe7a7200640 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaeb6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.947+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaeb6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.947+0000 7fe7a6800640 1 -- 172.21.15.22:0/2537820602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 msgr2=0x55dccaebe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.947+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 0x55dccaebe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.947+0000 7fe7a6800640 1 -- 172.21.15.22:0/2537820602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccab2e210 con 0x55dccaeb6ba0 2024-09-15T22:34:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.947+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 0x55dccaebe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.948+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaebb660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7980cc900 tx=0x7fe7980d74b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c785ac8613efcde2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.948+0000 7fe793400640 1 -- 172.21.15.22:0/2537820602 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980e3070 con 0x55dccaeb6ba0 2024-09-15T22:34:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.948+0000 7fe793400640 1 -- 172.21.15.22:0/2537820602 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7980d1aa0 con 0x55dccaeb6ba0 2024-09-15T22:34:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.948+0000 7fe793400640 1 -- 172.21.15.22:0/2537820602 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980dbaf0 con 0x55dccaeb6ba0 2024-09-15T22:34:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.950+0000 7fe7a7200640 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaeb6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 -- 172.21.15.22:0/2537820602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 msgr2=0x55dccaebb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaebb660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7980cc900 tx=0x7fe7980d74b0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 -- 172.21.15.22:0/2537820602 shutdown_connections 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaebb660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaebbc30 0x55dccaebe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2537820602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaeb6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.951+0000 7fe7b03db740 1 -- 172.21.15.22:0/2537820602 >> 172.21.15.22:0/2537820602 conn(0x55dccaeb18d0 msgr2=0x55dccaeb1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.952+0000 7fe7b03db740 1 -- 172.21.15.22:0/2537820602 shutdown_connections 2024-09-15T22:34:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.952+0000 7fe79f400640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe78c0a3320 0x7fe78c0a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:04 smithi110 ceph-mon[35282]: pgmap v398: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 273 MiB/s wr, 79 op/s 2024-09-15T22:34:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.953+0000 7fe79f400640 1 -- 172.21.15.22:0/2301710546 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe7980ceea0 con 0x7fe7a8073390 2024-09-15T22:34:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.953+0000 7fe7b03db740 1 -- 172.21.15.22:0/2537820602 wait complete. 2024-09-15T22:34:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.954+0000 7fe7b03db740 1 -- start start 2024-09-15T22:34:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.954+0000 7fe7b03db740 1 Processor -- start 2024-09-15T22:34:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.954+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe78c0a3320 0x7fe78c0a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.956+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe78c0a3320 0x7fe78c0a57e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe794006010 tx=0x7fe7940315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.957+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaed14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.957+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6ba0 0x55dccaed1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaed8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7b03db740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dccaecfc10 con 0x55dccaeb6ba0 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7b03db740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dccada4090 con 0x55dccaeb6260 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaed14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7b03db740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dccaecfd90 con 0x55dccaebbc30 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaed14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:45594/0 (socket says 172.21.15.22:45594) 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.958+0000 7fe7a6800640 1 -- 172.21.15.22:0/2964788480 learned_addr learned my addr 172.21.15.22:0/2964788480 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a7200640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaed8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7b03db740 10 client.0 _ll_register_callbacks cb 0x55dccadf8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6ba0 0x55dccaed1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a6800640 1 -- 172.21.15.22:0/2964788480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 msgr2=0x55dccaed8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaed8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a6800640 1 -- 172.21.15.22:0/2964788480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6ba0 msgr2=0x55dccaed1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6ba0 0x55dccaed1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a6800640 1 -- 172.21.15.22:0/2964788480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dccabfa620 con 0x55dccaeb6260 2024-09-15T22:34:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.959+0000 7fe7a7200640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaed8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.960+0000 7fe7a6800640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaed14e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe798097e50 tx=0x7fe7980cc930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7be98a9a577747 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.960+0000 7fe787e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.960+0000 7fe787e00640 1 -- 172.21.15.22:0/2964788480 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798021070 con 0x55dccaeb6260 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.960+0000 7fe787e00640 1 -- 172.21.15.22:0/2964788480 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe798097af0 con 0x55dccaeb6260 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.961+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7980d1aa0 con 0x55dccaeb6260 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.961+0000 7fe787e00640 1 -- 172.21.15.22:0/2964788480 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe798097720 con 0x55dccaeb6260 2024-09-15T22:34:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.961+0000 7fe7b03db740 10 client.25193 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.961+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dccaecfc10 con 0x55dccaeb6260 2024-09-15T22:34:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.962+0000 7fe787e00640 1 -- 172.21.15.22:0/2964788480 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7980d1aa0 con 0x55dccaeb6260 2024-09-15T22:34:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.963+0000 7fe787e00640 1 -- 172.21.15.22:0/2964788480 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe798024060 con 0x55dccaeb6260 2024-09-15T22:34:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.963+0000 7fe7b03db740 10 client.25193 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.963+0000 7fe7b03db740 10 client.25193 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.964+0000 7fe7b03db740 20 client.25193 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.964+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaedc920 0x55dccaeded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.964+0000 7fe7b03db740 4 client.25193 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:34:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.964+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dccae28830 con 0x55dccaedc920 2024-09-15T22:34:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.964+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaedc920 0x55dccaeded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.965+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaedc920 0x55dccaeded10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ade8dd2c6e8073f1 server_cookie=63d09117948aa5ec in_seq=0 out_seq=0 2024-09-15T22:34:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.965+0000 7fe787e00640 10 client.25193 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.966+0000 7fe787e00640 1 -- 172.21.15.22:0/2964788480 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dccae28830 con 0x55dccaedc920 2024-09-15T22:34:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.966+0000 7fe787e00640 10 client.25193 handle_command_reply: tid=0 2024-09-15T22:34:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.966+0000 7fe7b03db740 1 client.25193 shutdown 2024-09-15T22:34:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.967+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 msgr2=0x55dccaed14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.967+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaed14e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe798097e50 tx=0x7fe7980cc930 comp rx=0 tx=0).stop 2024-09-15T22:34:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.968+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 shutdown_connections 2024-09-15T22:34:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.968+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaedc920 0x55dccaeded10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.968+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaed8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.968+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6ba0 0x55dccaed1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.968+0000 7fe7b03db740 1 --2- 172.21.15.22:0/2964788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6260 0x55dccaed14e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.969+0000 7fe787e00640 0 client.25193 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.969+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 >> 172.21.15.22:0/2964788480 conn(0x55dccaeb18d0 msgr2=0x55dccaeb30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.969+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 shutdown_connections 2024-09-15T22:34:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.971+0000 7fe7b03db740 1 -- 172.21.15.22:0/2964788480 wait complete. 2024-09-15T22:34:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.971+0000 7fe7b03db740 20 client.25193 trim_cache size 0 max 16384 2024-09-15T22:34:04.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.995+0000 7fe7b03db740 1 Processor -- start 2024-09-15T22:34:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.995+0000 7fe7b03db740 1 -- start start 2024-09-15T22:34:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaeb2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6ba0 0x55dccaed89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaeb2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7b03db740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a81b1eb0 con 0x55dccaeb6260 2024-09-15T22:34:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7b03db740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a81af780 con 0x55dccaeb6ba0 2024-09-15T22:34:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7b03db740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a811bc60 con 0x55dccaebbc30 2024-09-15T22:34:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7a7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaeb2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7a7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaeb2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33630/0 (socket says 172.21.15.22:33630) 2024-09-15T22:34:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.996+0000 7fe7a7200640 1 -- 172.21.15.22:0/3014437527 learned_addr learned my addr 172.21.15.22:0/3014437527 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.997+0000 7fe7a7200640 1 -- 172.21.15.22:0/3014437527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6ba0 msgr2=0x55dccaed89f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:34:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.997+0000 7fe7a7200640 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6ba0 0x55dccaed89f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.997+0000 7fe7a7200640 1 -- 172.21.15.22:0/3014437527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 msgr2=0x55dccaeb2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.997+0000 7fe7a7200640 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaeb2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.997+0000 7fe7a7200640 1 -- 172.21.15.22:0/3014437527 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccaedf080 con 0x55dccaebbc30 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.997+0000 7fe7a7200640 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaeb2cc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0007f50 tx=0x7fe7a000e790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8dd29cffc564087 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe792a00640 1 -- 172.21.15.22:0/3014437527 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0015030 con 0x55dccaebbc30 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe792a00640 1 -- 172.21.15.22:0/3014437527 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7a0011960 con 0x55dccaebbc30 2024-09-15T22:34:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe792a00640 1 -- 172.21.15.22:0/3014437527 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0008040 con 0x55dccaebbc30 2024-09-15T22:34:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 -- 172.21.15.22:0/3014437527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 msgr2=0x55dccaeb2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaeb2cc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0007f50 tx=0x7fe7a000e790 comp rx=0 tx=0).stop 2024-09-15T22:34:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 -- 172.21.15.22:0/3014437527 shutdown_connections 2024-09-15T22:34:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaebbc30 0x55dccaeb2cc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaeb6ba0 0x55dccaed89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3014437527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaeb2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.998+0000 7fe7b03db740 1 -- 172.21.15.22:0/3014437527 >> 172.21.15.22:0/3014437527 conn(0x55dccaeb18d0 msgr2=0x55dccaed1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.999+0000 7fe7b03db740 1 -- 172.21.15.22:0/3014437527 shutdown_connections 2024-09-15T22:34:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.999+0000 7fe7b03db740 1 -- 172.21.15.22:0/3014437527 wait complete. 2024-09-15T22:34:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.999+0000 7fe7b03db740 1 -- start start 2024-09-15T22:34:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:04.999+0000 7fe7b03db740 1 Processor -- start 2024-09-15T22:34:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaed5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaed6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaebbc30 0x55dccaed7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a811c2d0 con 0x55dccaeb6260 2024-09-15T22:34:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a81af210 con 0x55dccaebbc30 2024-09-15T22:34:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a811c9a0 con 0x55dccaeb6ba0 2024-09-15T22:34:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7b03db740 10 client.0 _ll_register_callbacks cb 0x7fe7980e1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7a5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaed6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7a5e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaed6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33642/0 (socket says 172.21.15.22:33642) 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.000+0000 7fe7a5e00640 1 -- 172.21.15.22:0/3347536618 learned_addr learned my addr 172.21.15.22:0/3347536618 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a7200640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaebbc30 0x55dccaed7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a6800640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaed5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a5e00640 1 -- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaebbc30 msgr2=0x55dccaed7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaebbc30 0x55dccaed7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a5e00640 1 -- 172.21.15.22:0/3347536618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 msgr2=0x55dccaed5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaed5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.001+0000 7fe7a5e00640 1 -- 172.21.15.22:0/3347536618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dccaebe610 con 0x55dccaeb6ba0 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.002+0000 7fe7a5e00640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaed6330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe79402a9e0 tx=0x7fe794009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a444f670c63128e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.002+0000 7fe787e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:34:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.002+0000 7fe787e00640 1 -- 172.21.15.22:0/3347536618 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794057060 con 0x55dccaeb6ba0 2024-09-15T22:34:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.002+0000 7fe787e00640 1 -- 172.21.15.22:0/3347536618 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe794004dd0 con 0x55dccaeb6ba0 2024-09-15T22:34:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.002+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7a0011960 con 0x55dccaeb6ba0 2024-09-15T22:34:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.003+0000 7fe787e00640 1 -- 172.21.15.22:0/3347536618 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe794035040 con 0x55dccaeb6ba0 2024-09-15T22:34:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.003+0000 7fe7b03db740 10 client.25213 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.003+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dccaed8b90 con 0x55dccaeb6ba0 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.003+0000 7fe787e00640 1 -- 172.21.15.22:0/3347536618 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7a0011960 con 0x55dccaeb6ba0 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe787e00640 1 -- 172.21.15.22:0/3347536618 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe794044040 con 0x55dccaeb6ba0 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe7b03db740 10 client.25213 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe7b03db740 10 client.25213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe7b03db740 20 client.25213 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaf47b20 0x55dccaf49f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe7b03db740 4 client.25213 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:34:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.004+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dccae22b80 con 0x55dccaf47b20 2024-09-15T22:34:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.005+0000 7fe7a6800640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaf47b20 0x55dccaf49f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.007+0000 7fe7a6800640 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaf47b20 0x55dccaf49f40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a586e8ebe2328d8d server_cookie=c24a1ed09734f18d in_seq=0 out_seq=0 2024-09-15T22:34:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.007+0000 7fe787e00640 10 client.25213 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:05.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:04 smithi022 ceph-mon[30634]: pgmap v398: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 273 MiB/s wr, 79 op/s 2024-09-15T22:34:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.031+0000 7fe787e00640 1 -- 172.21.15.22:0/3347536618 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dccae22b80 con 0x55dccaf47b20 2024-09-15T22:34:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.031+0000 7fe787e00640 10 client.25213 handle_command_reply: tid=0 2024-09-15T22:34:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.032+0000 7fe7b03db740 1 client.25213 shutdown 2024-09-15T22:34:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.032+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 msgr2=0x55dccaed6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.032+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaed6330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe79402a9e0 tx=0x7fe794009260 comp rx=0 tx=0).stop 2024-09-15T22:34:05.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 shutdown_connections 2024-09-15T22:34:05.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55dccaf47b20 0x55dccaf49f40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dccaeb6ba0 0x55dccaed6330 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe79402a9e0 tx=0x7fe794009260 comp rx=0 tx=0).stop 2024-09-15T22:34:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dccaebbc30 0x55dccaed7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe7b03db740 1 --2- 172.21.15.22:0/3347536618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dccaeb6260 0x55dccaed5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 >> 172.21.15.22:0/3347536618 conn(0x55dccaeb18d0 msgr2=0x55dccaeb2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.035+0000 7fe787e00640 0 client.25213 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.037+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 shutdown_connections 2024-09-15T22:34:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.037+0000 7fe7b03db740 1 -- 172.21.15.22:0/3347536618 wait complete. 2024-09-15T22:34:05.039 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.038+0000 7fe7b03db740 20 client.25213 trim_cache size 0 max 16384 2024-09-15T22:34:05.042 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:34:05.042 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:34:05.042 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:34:05.042 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:34:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe78c0a3320 msgr2=0x7fe78c0a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe78c0a3320 0x7fe78c0a57e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe794006010 tx=0x7fe7940315b0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 msgr2=0x7fe7a81a6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 0x7fe7a81a6b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8073320 tx=0x7fe79800dde0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 shutdown_connections 2024-09-15T22:34:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a8073d50 0x7fe7a81a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe78c0a3320 0x7fe78c0a57e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a81094f0 0x7fe7a81ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 --2- 172.21.15.22:0/2301710546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7a8073390 0x7fe7a81a6b10 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8073320 tx=0x7fe79800dde0 comp rx=0 tx=0).stop 2024-09-15T22:34:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.042+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 >> 172.21.15.22:0/2301710546 conn(0x7fe7a806ed10 msgr2=0x7fe7a806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.044+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 shutdown_connections 2024-09-15T22:34:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:05.044+0000 7fe7aca00640 1 -- 172.21.15.22:0/2301710546 wait complete. 2024-09-15T22:34:05.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:04 smithi112 ceph-mon[35032]: pgmap v398: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 273 MiB/s wr, 79 op/s 2024-09-15T22:34:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:06 smithi022 ceph-mon[30634]: pgmap v399: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 262 MiB/s wr, 76 op/s 2024-09-15T22:34:07.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:06 smithi112 ceph-mon[35032]: pgmap v399: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 262 MiB/s wr, 76 op/s 2024-09-15T22:34:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:06 smithi110 ceph-mon[35282]: pgmap v399: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 262 MiB/s wr, 76 op/s 2024-09-15T22:34:09.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:08 smithi022 ceph-mon[30634]: pgmap v400: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 82 op/s 2024-09-15T22:34:09.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:08 smithi112 ceph-mon[35032]: pgmap v400: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 82 op/s 2024-09-15T22:34:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:08 smithi110 ceph-mon[35282]: pgmap v400: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 82 op/s 2024-09-15T22:34:11.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:10 smithi022 ceph-mon[30634]: pgmap v401: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 258 MiB/s wr, 74 op/s 2024-09-15T22:34:11.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:10 smithi112 ceph-mon[35032]: pgmap v401: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 258 MiB/s wr, 74 op/s 2024-09-15T22:34:11.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:10 smithi110 ceph-mon[35282]: pgmap v401: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 258 MiB/s wr, 74 op/s 2024-09-15T22:34:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:12 smithi022 ceph-mon[30634]: pgmap v402: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 273 MiB/s wr, 80 op/s 2024-09-15T22:34:13.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:12 smithi112 ceph-mon[35032]: pgmap v402: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 273 MiB/s wr, 80 op/s 2024-09-15T22:34:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:12 smithi110 ceph-mon[35282]: pgmap v402: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 273 MiB/s wr, 80 op/s 2024-09-15T22:34:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:14 smithi022 ceph-mon[30634]: pgmap v403: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 269 MiB/s wr, 75 op/s 2024-09-15T22:34:15.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:14 smithi112 ceph-mon[35032]: pgmap v403: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 269 MiB/s wr, 75 op/s 2024-09-15T22:34:15.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:14 smithi110 ceph-mon[35282]: pgmap v403: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 269 MiB/s wr, 75 op/s 2024-09-15T22:34:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:16 smithi022 ceph-mon[30634]: pgmap v404: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 262 MiB/s wr, 75 op/s 2024-09-15T22:34:17.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:16 smithi112 ceph-mon[35032]: pgmap v404: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 262 MiB/s wr, 75 op/s 2024-09-15T22:34:17.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:16 smithi110 ceph-mon[35282]: pgmap v404: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 262 MiB/s wr, 75 op/s 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 -- 172.21.15.22:0/1584974123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 msgr2=0x7fd090104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 --2- 172.21.15.22:0/1584974123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090104160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd080009860 tx=0x7fd08002a340 comp rx=0 tx=0).stop 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 -- 172.21.15.22:0/1584974123 shutdown_connections 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 --2- 172.21.15.22:0/1584974123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd090105910 0x7fd09010c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 --2- 172.21.15.22:0/1584974123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd090104f50 0x7fd0901053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 --2- 172.21.15.22:0/1584974123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090104160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 -- 172.21.15.22:0/1584974123 >> 172.21.15.22:0/1584974123 conn(0x7fd0900ff4e0 msgr2=0x7fd090101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 -- 172.21.15.22:0/1584974123 shutdown_connections 2024-09-15T22:34:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.356+0000 7fd096c00640 1 -- 172.21.15.22:0/1584974123 wait complete. 2024-09-15T22:34:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.357+0000 7fd096c00640 1 Processor -- start 2024-09-15T22:34:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 -- start start 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd090104f50 0x7fd09019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd090105910 0x7fd0901a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd09010f9c0 con 0x7fd090105910 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd09010f840 con 0x7fd090104f50 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd096c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd09010fb40 con 0x7fd090103d60 2024-09-15T22:34:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:42200/0 (socket says 172.21.15.22:42200) 2024-09-15T22:34:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.358+0000 7fd08fe00640 1 -- 172.21.15.22:0/3320279009 learned_addr learned my addr 172.21.15.22:0/3320279009 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08f400640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd090104f50 0x7fd09019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08fe00640 1 -- 172.21.15.22:0/3320279009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd090104f50 msgr2=0x7fd09019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08fe00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd090104f50 0x7fd09019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08fe00640 1 -- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd090105910 msgr2=0x7fd0901a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08fe00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd090105910 0x7fd0901a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08fe00640 1 -- 172.21.15.22:0/3320279009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0901a1bd0 con 0x7fd090103d60 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.359+0000 7fd08fe00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090199fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd080035040 tx=0x7fd080033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.360+0000 7fd08cc00640 1 -- 172.21.15.22:0/3320279009 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080037040 con 0x7fd090103d60 2024-09-15T22:34:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.360+0000 7fd08cc00640 1 -- 172.21.15.22:0/3320279009 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd080030850 con 0x7fd090103d60 2024-09-15T22:34:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.360+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0901a1e60 con 0x7fd090103d60 2024-09-15T22:34:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.360+0000 7fd08cc00640 1 -- 172.21.15.22:0/3320279009 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080004920 con 0x7fd090103d60 2024-09-15T22:34:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.360+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0901a22c0 con 0x7fd090103d60 2024-09-15T22:34:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.363+0000 7fd08cc00640 1 -- 172.21.15.22:0/3320279009 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd080004050 con 0x7fd090103d60 2024-09-15T22:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.364+0000 7fd08cc00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd0740a3460 0x7fd0740a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.364+0000 7fd099bd0740 1 Processor -- start 2024-09-15T22:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.364+0000 7fd08cc00640 1 -- 172.21.15.22:0/3320279009 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd0800ef810 con 0x7fd090103d60 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 -- start start 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd08f400640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd0740a3460 0x7fd0740a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1263490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa1263a60 0x562aa1265f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562aa11c3100 con 0x562aa1263a60 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562aa116b1b0 con 0x562aa125e090 2024-09-15T22:34:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd099bd0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562aa11bf0c0 con 0x562aa125e9d0 2024-09-15T22:34:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd08f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1263490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd08f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1263490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:42212/0 (socket says 172.21.15.22:42212) 2024-09-15T22:34:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd08f400640 1 -- 172.21.15.22:0/3516402217 learned_addr learned my addr 172.21.15.22:0/3516402217 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd08fe00640 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.365+0000 7fd094c00640 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa1263a60 0x562aa1265f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 -- 172.21.15.22:0/3516402217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 msgr2=0x562aa125e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 -- 172.21.15.22:0/3516402217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa1263a60 msgr2=0x562aa1265f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa1263a60 0x562aa1265f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 -- 172.21.15.22:0/3516402217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa0ed6210 con 0x562aa125e9d0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd0740a3460 0x7fd0740a5920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd07c015590 tx=0x7fd07c009f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd08f400640 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1263490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd07c015e20 tx=0x7fd07c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccb2aad71914c99b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd085200640 1 -- 172.21.15.22:0/3516402217 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c015170 con 0x562aa125e9d0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd085200640 1 -- 172.21.15.22:0/3516402217 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd07c00fc80 con 0x562aa125e9d0 2024-09-15T22:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.366+0000 7fd085200640 1 -- 172.21.15.22:0/3516402217 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c012bb0 con 0x562aa125e9d0 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 -- 172.21.15.22:0/3516402217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 msgr2=0x562aa1263490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1263490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd07c015e20 tx=0x7fd07c01f000 comp rx=0 tx=0).stop 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 -- 172.21.15.22:0/3516402217 shutdown_connections 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1263490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa1263a60 0x562aa1265f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3516402217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 -- 172.21.15.22:0/3516402217 >> 172.21.15.22:0/3516402217 conn(0x562aa1259700 msgr2=0x562aa1259b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 -- 172.21.15.22:0/3516402217 shutdown_connections 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.367+0000 7fd099bd0740 1 -- 172.21.15.22:0/3516402217 wait complete. 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 -- start start 2024-09-15T22:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 Processor -- start 2024-09-15T22:34:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e090 0x562aa1268240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1268780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1263a60 0x562aa126f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562aa12669d0 con 0x562aa125e090 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562aa114c090 con 0x562aa1263a60 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562aa1266b50 con 0x562aa125e9d0 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.368+0000 7fd099bd0740 10 client.0 _ll_register_callbacks cb 0x562aa11a0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1268780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e090 0x562aa1268240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1268780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:42220/0 (socket says 172.21.15.22:42220) 2024-09-15T22:34:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 -- 172.21.15.22:0/1882909763 learned_addr learned my addr 172.21.15.22:0/1882909763 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd094c00640 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1263a60 0x562aa126f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 -- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1263a60 msgr2=0x562aa126f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1263a60 0x562aa126f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 -- 172.21.15.22:0/1882909763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e090 msgr2=0x562aa1268240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e090 0x562aa1268240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 -- 172.21.15.22:0/1882909763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa0fa2620 con 0x562aa125e9d0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd08f400640 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1268780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006010 tx=0x7fd07c005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b0994b1d7ddc77e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.369+0000 7fd079600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd079600640 1 -- 172.21.15.22:0/1882909763 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c02d030 con 0x562aa125e9d0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd079600640 1 -- 172.21.15.22:0/1882909763 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd07c026040 con 0x562aa125e9d0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd07c00fc80 con 0x562aa125e9d0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd079600640 1 -- 172.21.15.22:0/1882909763 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd07c0098b0 con 0x562aa125e9d0 2024-09-15T22:34:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd099bd0740 10 client.25225 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562aa12725b0 con 0x562aa125e9d0 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.370+0000 7fd079600640 1 -- 172.21.15.22:0/1882909763 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd07c00fc80 con 0x562aa125e9d0 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd079600640 1 -- 172.21.15.22:0/1882909763 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd07c012bd0 con 0x562aa125e9d0 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd099bd0740 10 client.25225 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd099bd0740 10 client.25225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd099bd0740 20 client.25225 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1273a70 0x562aa1275e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd099bd0740 4 client.25225 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aa11d0830 con 0x562aa1273a70 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.371+0000 7fd08fe00640 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1273a70 0x562aa1275e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.372+0000 7fd079600640 10 client.25225 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.372+0000 7fd08fe00640 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1273a70 0x562aa1275e60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb3d371e531e9e1 server_cookie=eaf8786891740add in_seq=0 out_seq=0 2024-09-15T22:34:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.372+0000 7fd079600640 1 -- 172.21.15.22:0/1882909763 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562aa11d0830 con 0x562aa1273a70 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.372+0000 7fd079600640 10 client.25225 handle_command_reply: tid=0 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.372+0000 7fd099bd0740 1 client.25225 shutdown 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 msgr2=0x562aa1268780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1268780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006010 tx=0x7fd07c005760 comp rx=0 tx=0).stop 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 shutdown_connections 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1273a70 0x562aa1275e60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e9d0 0x562aa1268780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1263a60 0x562aa126f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1882909763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e090 0x562aa1268240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd079600640 0 client.25225 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 >> 172.21.15.22:0/1882909763 conn(0x562aa1259700 msgr2=0x562aa125af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 shutdown_connections 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 1 -- 172.21.15.22:0/1882909763 wait complete. 2024-09-15T22:34:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.373+0000 7fd099bd0740 20 client.25225 trim_cache size 0 max 16384 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.390+0000 7fd099bd0740 1 Processor -- start 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.390+0000 7fd099bd0740 1 -- start start 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa1259700 0x562aa125acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd099bd0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901ad960 con 0x562aa125e9d0 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd099bd0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901ab230 con 0x562aa125e090 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd099bd0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901a9060 con 0x562aa1259700 2024-09-15T22:34:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38716/0 (socket says 172.21.15.22:38716) 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 -- 172.21.15.22:0/3011287279 learned_addr learned my addr 172.21.15.22:0/3011287279 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd094c00640 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08fe00640 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa1259700 0x562aa125acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 -- 172.21.15.22:0/3011287279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa1259700 msgr2=0x562aa125acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa1259700 0x562aa125acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 -- 172.21.15.22:0/3011287279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 msgr2=0x562aa126f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.391+0000 7fd08f400640 1 -- 172.21.15.22:0/3011287279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa1259520 con 0x562aa125e090 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.392+0000 7fd08f400640 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125b200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0092a0 tx=0x7fd07c005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c8b5ef291f886d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.392+0000 7fd07be00640 1 -- 172.21.15.22:0/3011287279 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c02d070 con 0x562aa125e090 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.392+0000 7fd07be00640 1 -- 172.21.15.22:0/3011287279 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd07c012450 con 0x562aa125e090 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.392+0000 7fd07be00640 1 -- 172.21.15.22:0/3011287279 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0216a0 con 0x562aa125e090 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 -- 172.21.15.22:0/3011287279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 msgr2=0x562aa125b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125b200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0092a0 tx=0x7fd07c005970 comp rx=0 tx=0).stop 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 -- 172.21.15.22:0/3011287279 shutdown_connections 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa125e090 0x562aa125b200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 --2- 172.21.15.22:0/3011287279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa1259700 0x562aa125acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 -- 172.21.15.22:0/3011287279 >> 172.21.15.22:0/3011287279 conn(0x562aa12635f0 msgr2=0x562aa125a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 -- 172.21.15.22:0/3011287279 shutdown_connections 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 -- 172.21.15.22:0/3011287279 wait complete. 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.393+0000 7fd099bd0740 1 -- start start 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 Processor -- start 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 0x562aa126d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e090 0x562aa126d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901a96f0 con 0x562aa125e9d0 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901aab60 con 0x562aa1259700 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901a9dc0 con 0x562aa125e090 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd099bd0740 10 client.0 _ll_register_callbacks cb 0x7fd07c018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 0x562aa126d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd08f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e090 0x562aa126d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd08fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 0x562aa126d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38722/0 (socket says 172.21.15.22:38722) 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd08fe00640 1 -- 172.21.15.22:0/1775536145 learned_addr learned my addr 172.21.15.22:0/1775536145 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.394+0000 7fd094c00640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08fe00640 1 -- 172.21.15.22:0/1775536145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e090 msgr2=0x562aa126d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08fe00640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e090 0x562aa126d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08fe00640 1 -- 172.21.15.22:0/1775536145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 msgr2=0x562aa126e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08fe00640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08fe00640 1 -- 172.21.15.22:0/1775536145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa126ee00 con 0x562aa1259700 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08f400640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e090 0x562aa126d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd094c00640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd08fe00640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 0x562aa126d2a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b87c0 tx=0x7fd08002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f65dfe29527d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd079600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd079600640 1 -- 172.21.15.22:0/1775536145 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0800ba0f0 con 0x562aa1259700 2024-09-15T22:34:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd079600640 1 -- 172.21.15.22:0/1775536145 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd0800b8460 con 0x562aa1259700 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd07c012450 con 0x562aa1259700 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.395+0000 7fd079600640 1 -- 172.21.15.22:0/1775536145 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd080042300 con 0x562aa1259700 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 10 client.25214 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562aa12dea20 con 0x562aa1259700 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd079600640 1 -- 172.21.15.22:0/1775536145 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd07c012450 con 0x562aa1259700 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd079600640 1 -- 172.21.15.22:0/1775536145 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd08003a070 con 0x562aa1259700 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 10 client.25214 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 10 client.25214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 20 client.25214 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1263a60 0x562aa12e1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 4 client.25214 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562aa11cab80 con 0x562aa1263a60 2024-09-15T22:34:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.396+0000 7fd08f400640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1263a60 0x562aa12e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.397+0000 7fd08f400640 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1263a60 0x562aa12e1380 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=428505714c3db07e server_cookie=e5b584134911a440 in_seq=0 out_seq=0 2024-09-15T22:34:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.397+0000 7fd079600640 10 client.25214 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd079600640 1 -- 172.21.15.22:0/1775536145 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aa11cab80 con 0x562aa1263a60 2024-09-15T22:34:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd079600640 10 client.25214 handle_command_reply: tid=0 2024-09-15T22:34:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 client.25214 shutdown 2024-09-15T22:34:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 msgr2=0x562aa126d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 0x562aa126d2a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b87c0 tx=0x7fd08002a340 comp rx=0 tx=0).stop 2024-09-15T22:34:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 shutdown_connections 2024-09-15T22:34:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562aa1263a60 0x562aa12e1380 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562aa125e090 0x562aa126d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562aa125e9d0 0x562aa126e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 --2- 172.21.15.22:0/1775536145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562aa1259700 0x562aa126d2a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.411+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 >> 172.21.15.22:0/1775536145 conn(0x562aa12635f0 msgr2=0x562aa125add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.412+0000 7fd079600640 0 client.25214 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.412+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 shutdown_connections 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.412+0000 7fd099bd0740 1 -- 172.21.15.22:0/1775536145 wait complete. 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.412+0000 7fd099bd0740 20 client.25214 trim_cache size 0 max 16384 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:34:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:34:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd0740a3460 msgr2=0x7fd0740a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd0740a3460 0x7fd0740a5920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd07c015590 tx=0x7fd07c009f90 comp rx=0 tx=0).stop 2024-09-15T22:34:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 msgr2=0x7fd090199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090199fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd080035040 tx=0x7fd080033d90 comp rx=0 tx=0).stop 2024-09-15T22:34:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 shutdown_connections 2024-09-15T22:34:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd0740a3460 0x7fd0740a5920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd090105910 0x7fd0901a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd090104f50 0x7fd09019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 --2- 172.21.15.22:0/3320279009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd090103d60 0x7fd090199fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.413+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 >> 172.21.15.22:0/3320279009 conn(0x7fd0900ff4e0 msgr2=0x7fd0901082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.414+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 shutdown_connections 2024-09-15T22:34:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:18.414+0000 7fd096c00640 1 -- 172.21.15.22:0/3320279009 wait complete. 2024-09-15T22:34:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:18 smithi110 ceph-mon[35282]: pgmap v405: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 285 MiB/s wr, 104 op/s 2024-09-15T22:34:19.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:18 smithi022 ceph-mon[30634]: pgmap v405: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 285 MiB/s wr, 104 op/s 2024-09-15T22:34:19.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:18 smithi112 ceph-mon[35032]: pgmap v405: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 285 MiB/s wr, 104 op/s 2024-09-15T22:34:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:20 smithi022 ceph-mon[30634]: pgmap v406: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 139 op/s 2024-09-15T22:34:21.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:20 smithi112 ceph-mon[35032]: pgmap v406: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 139 op/s 2024-09-15T22:34:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:20 smithi110 ceph-mon[35282]: pgmap v406: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 139 op/s 2024-09-15T22:34:23.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:22 smithi022 ceph-mon[30634]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 276 MiB/s wr, 301 op/s 2024-09-15T22:34:23.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:22 smithi112 ceph-mon[35032]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 276 MiB/s wr, 301 op/s 2024-09-15T22:34:23.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:22 smithi110 ceph-mon[35282]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 276 MiB/s wr, 301 op/s 2024-09-15T22:34:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:25 smithi022 ceph-mon[30634]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 264 MiB/s wr, 471 op/s 2024-09-15T22:34:25.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:25 smithi112 ceph-mon[35032]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 264 MiB/s wr, 471 op/s 2024-09-15T22:34:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:25 smithi110 ceph-mon[35282]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 264 MiB/s wr, 471 op/s 2024-09-15T22:34:27.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:27 smithi022 ceph-mon[30634]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 591 op/s 2024-09-15T22:34:27.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:27 smithi112 ceph-mon[35032]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 591 op/s 2024-09-15T22:34:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:27 smithi110 ceph-mon[35282]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 591 op/s 2024-09-15T22:34:29.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:29 smithi022 ceph-mon[30634]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 784 op/s 2024-09-15T22:34:29.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:29 smithi112 ceph-mon[35032]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 784 op/s 2024-09-15T22:34:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:29 smithi110 ceph-mon[35282]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 784 op/s 2024-09-15T22:34:31.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:31 smithi112 ceph-mon[35032]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 240 MiB/s wr, 857 op/s 2024-09-15T22:34:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:31 smithi110 ceph-mon[35282]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 240 MiB/s wr, 857 op/s 2024-09-15T22:34:31.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:31 smithi022 ceph-mon[30634]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 240 MiB/s wr, 857 op/s 2024-09-15T22:34:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.617+0000 7f170fa00640 1 -- 172.21.15.22:0/2853330629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17080ffab0 msgr2=0x7f17080ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.617+0000 7f170fa00640 1 --2- 172.21.15.22:0/2853330629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17080ffab0 0x7f17080ffeb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009900 tx=0x7f16f802a410 comp rx=0 tx=0).stop 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.618+0000 7f170fa00640 1 -- 172.21.15.22:0/2853330629 shutdown_connections 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.618+0000 7f170fa00640 1 --2- 172.21.15.22:0/2853330629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 0x7f1708101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.618+0000 7f170fa00640 1 --2- 172.21.15.22:0/2853330629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1708100b20 0x7f1708100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.618+0000 7f170fa00640 1 --2- 172.21.15.22:0/2853330629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17080ffab0 0x7f17080ffeb0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009900 tx=0x7f16f802a410 comp rx=0 tx=0).stop 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.618+0000 7f170fa00640 1 -- 172.21.15.22:0/2853330629 >> 172.21.15.22:0/2853330629 conn(0x7f17080fb500 msgr2=0x7f17080fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.619+0000 7f170fa00640 1 -- 172.21.15.22:0/2853330629 shutdown_connections 2024-09-15T22:34:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.619+0000 7f170fa00640 1 -- 172.21.15.22:0/2853330629 wait complete. 2024-09-15T22:34:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.621+0000 7f170fa00640 1 Processor -- start 2024-09-15T22:34:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.621+0000 7f170fa00640 1 -- start start 2024-09-15T22:34:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.621+0000 7f170fa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1708100b20 0x7f170819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1708100b20 0x7f170819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1708100b20 0x7f170819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58362/0 (socket says 172.21.15.22:58362) 2024-09-15T22:34:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170d000640 1 -- 172.21.15.22:0/2549574095 learned_addr learned my addr 172.21.15.22:0/2549574095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 0x7f170819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17081a3bb0 0x7f17081a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17081044c0 con 0x7f17081a3bb0 2024-09-15T22:34:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1708104340 con 0x7f17081014c0 2024-09-15T22:34:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.622+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1708104640 con 0x7f1708100b20 2024-09-15T22:34:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.623+0000 7f1707e00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 0x7f170819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.623+0000 7f170da00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17081a3bb0 0x7f17081a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.623+0000 7f1707e00640 1 -- 172.21.15.22:0/2549574095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1708100b20 msgr2=0x7f170819e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.623+0000 7f1707e00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1708100b20 0x7f170819e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.623+0000 7f1707e00640 1 -- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17081a3bb0 msgr2=0x7f17081a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f1707e00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17081a3bb0 0x7f17081a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f1707e00640 1 -- 172.21.15.22:0/2549574095 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17081a6610 con 0x7f17081014c0 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f1707e00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 0x7f170819eb50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f170000bd50 tx=0x7f170000be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f1705600640 1 -- 172.21.15.22:0/2549574095 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700019070 con 0x7f17081014c0 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f170da00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17081a3bb0 0x7f17081a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f1705600640 1 -- 172.21.15.22:0/2549574095 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1700014920 con 0x7f17081014c0 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.624+0000 7f1705600640 1 -- 172.21.15.22:0/2549574095 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700012a00 con 0x7f17081014c0 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.625+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17081a6900 con 0x7f17081014c0 2024-09-15T22:34:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.625+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17081a6e80 con 0x7f17081014c0 2024-09-15T22:34:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.629+0000 7f1705600640 1 -- 172.21.15.22:0/2549574095 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f170001c070 con 0x7f17081014c0 2024-09-15T22:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.632+0000 7f1705600640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16ec0a34e0 0x7f16ec0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.632+0000 7f1705600640 1 -- 172.21.15.22:0/2549574095 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f17000cf120 con 0x7f17081014c0 2024-09-15T22:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.636+0000 7f171288b740 1 Processor -- start 2024-09-15T22:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.636+0000 7f171288b740 1 -- start start 2024-09-15T22:34:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f171288b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e64490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f171288b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e69490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f171288b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e6bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f171288b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e58dc9100 con 0x555e58e64090 2024-09-15T22:34:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f171288b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e58d711b0 con 0x555e58e69a60 2024-09-15T22:34:31.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f171288b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555e58dc50c0 con 0x555e58e649d0 2024-09-15T22:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f1707e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e69490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f1707e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e69490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58368/0 (socket says 172.21.15.22:58368) 2024-09-15T22:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.637+0000 7f1707e00640 1 -- 172.21.15.22:0/437718879 learned_addr learned my addr 172.21.15.22:0/437718879 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.638+0000 7f170da00640 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e6bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.638+0000 7f170d000640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16ec0a34e0 0x7f16ec0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.638+0000 7f1707e00640 1 -- 172.21.15.22:0/437718879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 msgr2=0x555e58e6bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.639+0000 7f1707e00640 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e6bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.640+0000 7f170d000640 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e64490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.640+0000 7f1707e00640 1 -- 172.21.15.22:0/437718879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 msgr2=0x555e58e64490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.640+0000 7f1707e00640 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e64490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.640+0000 7f1707e00640 1 -- 172.21.15.22:0/437718879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e58adc210 con 0x555e58e649d0 2024-09-15T22:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.641+0000 7f170d000640 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e64490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.642+0000 7f170d000640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16ec0a34e0 0x7f16ec0a59a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f16f8031440 tx=0x7f16f8005b90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.643+0000 7f1707e00640 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e69490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1700098180 tx=0x7f170000cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc3ea879ba83328 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.643+0000 7f16fe000640 1 -- 172.21.15.22:0/437718879 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170009fab0 con 0x555e58e649d0 2024-09-15T22:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.643+0000 7f16fe000640 1 -- 172.21.15.22:0/437718879 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17000a4370 con 0x555e58e649d0 2024-09-15T22:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.643+0000 7f16fe000640 1 -- 172.21.15.22:0/437718879 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000a3ee0 con 0x555e58e649d0 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 -- 172.21.15.22:0/437718879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 msgr2=0x555e58e69490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e69490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1700098180 tx=0x7f170000cf40 comp rx=0 tx=0).stop 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 -- 172.21.15.22:0/437718879 shutdown_connections 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e69490 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e6bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 --2- 172.21.15.22:0/437718879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e64490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 -- 172.21.15.22:0/437718879 >> 172.21.15.22:0/437718879 conn(0x555e58e5f700 msgr2=0x555e58e5fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 -- 172.21.15.22:0/437718879 shutdown_connections 2024-09-15T22:34:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.645+0000 7f171288b740 1 -- 172.21.15.22:0/437718879 wait complete. 2024-09-15T22:34:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.646+0000 7f171288b740 1 -- start start 2024-09-15T22:34:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.646+0000 7f171288b740 1 Processor -- start 2024-09-15T22:34:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e7f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e7f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58e867d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e58e7da40 con 0x555e58e69a60 2024-09-15T22:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e58d52090 con 0x555e58e64090 2024-09-15T22:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555e58e7dbc0 con 0x555e58e649d0 2024-09-15T22:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f171288b740 10 client.0 _ll_register_callbacks cb 0x555e58da6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.647+0000 7f170d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e7f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e7f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39074/0 (socket says 172.21.15.22:39074) 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 -- 172.21.15.22:0/2188649319 learned_addr learned my addr 172.21.15.22:0/2188649319 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170da00640 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58e867d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 -- 172.21.15.22:0/2188649319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 msgr2=0x555e58e7f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e7f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 -- 172.21.15.22:0/2188649319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 msgr2=0x555e58e867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58e867d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 -- 172.21.15.22:0/2188649319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e58ba8620 con 0x555e58e64090 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.648+0000 7f170d000640 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e7f250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f16f8033000 tx=0x7f16f80315d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cae8fc4be08d406 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f16f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f16f2a00640 1 -- 172.21.15.22:0/2188649319 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f804d020 con 0x555e58e64090 2024-09-15T22:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f16f2a00640 1 -- 172.21.15.22:0/2188649319 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f16f80035f0 con 0x555e58e64090 2024-09-15T22:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17000a4370 con 0x555e58e64090 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f16f2a00640 1 -- 172.21.15.22:0/2188649319 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16f8035040 con 0x555e58e64090 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f171288b740 10 client.25223 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.649+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555e58e895f0 con 0x555e58e64090 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f16f2a00640 1 -- 172.21.15.22:0/2188649319 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17000a4370 con 0x555e58e64090 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f16f2a00640 1 -- 172.21.15.22:0/2188649319 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f16f803b9d0 con 0x555e58e64090 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f171288b740 10 client.25223 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f171288b740 10 client.25223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f171288b740 20 client.25223 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f171288b740 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58e8ace0 0x555e58e8d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f171288b740 4 client.25223 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.650+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e58dd6830 con 0x555e58e8ace0 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.651+0000 7f1707e00640 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58e8ace0 0x555e58e8d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.651+0000 7f1707e00640 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58e8ace0 0x555e58e8d180 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61f1ee911d3f8f2 server_cookie=f6b2b184c0822ea2 in_seq=0 out_seq=0 2024-09-15T22:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.651+0000 7f16f2a00640 10 client.25223 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f16f2a00640 1 -- 172.21.15.22:0/2188649319 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e58dd6830 con 0x555e58e8ace0 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f16f2a00640 10 client.25223 handle_command_reply: tid=0 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 client.25223 shutdown 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 msgr2=0x555e58e7f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e7f250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f16f8033000 tx=0x7f16f80315d0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 shutdown_connections 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58e8ace0 0x555e58e8d180 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f16f2a00640 0 client.25223 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e7f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58e867d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 --2- 172.21.15.22:0/2188649319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e7f250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.652+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 >> 172.21.15.22:0/2188649319 conn(0x555e58e5f700 msgr2=0x555e58e60f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.653+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 shutdown_connections 2024-09-15T22:34:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.653+0000 7f171288b740 1 -- 172.21.15.22:0/2188649319 wait complete. 2024-09-15T22:34:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.653+0000 7f171288b740 20 client.25223 trim_cache size 0 max 16384 2024-09-15T22:34:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 Processor -- start 2024-09-15T22:34:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 -- start start 2024-09-15T22:34:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e7f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e86790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e7f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17081a9b20 con 0x555e58e64090 2024-09-15T22:34:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17081a73f0 con 0x555e58e69a60 2024-09-15T22:34:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.686+0000 7f171288b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1708115140 con 0x555e58e649d0 2024-09-15T22:34:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.687+0000 7f170da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e7f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.687+0000 7f170da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e7f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39084/0 (socket says 172.21.15.22:39084) 2024-09-15T22:34:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.687+0000 7f170da00640 1 -- 172.21.15.22:0/3266011736 learned_addr learned my addr 172.21.15.22:0/3266011736 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.687+0000 7f170d000640 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e7f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.687+0000 7f1707e00640 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e86790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.688+0000 7f170d000640 1 -- 172.21.15.22:0/3266011736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 msgr2=0x555e58e86790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.688+0000 7f170d000640 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e86790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.688+0000 7f170d000640 1 -- 172.21.15.22:0/3266011736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 msgr2=0x555e58e7f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.688+0000 7f170d000640 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e7f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.689+0000 7f170d000640 1 -- 172.21.15.22:0/3266011736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e58e5f520 con 0x555e58e64090 2024-09-15T22:34:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.692+0000 7f170d000640 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e7f000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f16f8005e30 tx=0x7f16f80494c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4945cadae4fc0610 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.696+0000 7f16fd600640 1 -- 172.21.15.22:0/3266011736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f805e020 con 0x555e58e64090 2024-09-15T22:34:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.697+0000 7f16fd600640 1 -- 172.21.15.22:0/3266011736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f8042030 con 0x555e58e64090 2024-09-15T22:34:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.697+0000 7f16fd600640 1 -- 172.21.15.22:0/3266011736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f804d040 con 0x555e58e64090 2024-09-15T22:34:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.698+0000 7f171288b740 1 -- 172.21.15.22:0/3266011736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 msgr2=0x555e58e7f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.698+0000 7f171288b740 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e7f000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f16f8005e30 tx=0x7f16f80494c0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 -- 172.21.15.22:0/3266011736 shutdown_connections 2024-09-15T22:34:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e86790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e69a60 0x555e58e7f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 --2- 172.21.15.22:0/3266011736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e64090 0x555e58e7f000 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 -- 172.21.15.22:0/3266011736 >> 172.21.15.22:0/3266011736 conn(0x555e58e5f700 msgr2=0x555e58e65b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 -- 172.21.15.22:0/3266011736 shutdown_connections 2024-09-15T22:34:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 -- 172.21.15.22:0/3266011736 wait complete. 2024-09-15T22:34:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.699+0000 7f171288b740 1 -- start start 2024-09-15T22:34:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.701+0000 7f171288b740 1 Processor -- start 2024-09-15T22:34:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.702+0000 7f171288b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e835f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f171288b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e83b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f171288b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58ef3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f171288b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17081157d0 con 0x555e58e69a60 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f171288b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1708116c40 con 0x555e58e64090 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f171288b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1708115ea0 con 0x555e58e649d0 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f171288b740 10 client.0 _ll_register_callbacks cb 0x7f16f8004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f1707e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e83b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f1707e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e83b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58402/0 (socket says 172.21.15.22:58402) 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f1707e00640 1 -- 172.21.15.22:0/3782537461 learned_addr learned my addr 172.21.15.22:0/3782537461 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.703+0000 7f170d000640 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f1707e00640 1 -- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 msgr2=0x555e58e835f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f1707e00640 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e835f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f1707e00640 1 -- 172.21.15.22:0/3782537461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 msgr2=0x555e58ef3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f1707e00640 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58ef3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f1707e00640 1 -- 172.21.15.22:0/3782537461 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e58ef3f90 con 0x555e58e649d0 2024-09-15T22:34:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f1707e00640 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e83b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1700099a60 tx=0x7f170000ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22403b1cc51234 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f16f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f16f2a00640 1 -- 172.21.15.22:0/3782537461 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000a9060 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.704+0000 7f16f2a00640 1 -- 172.21.15.22:0/3782537461 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f17000ccc60 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.705+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f8042030 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.705+0000 7f16f2a00640 1 -- 172.21.15.22:0/3782537461 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f17000ba070 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.705+0000 7f171288b740 10 client.25246 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.705+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555e58ef5260 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.705+0000 7f16f2a00640 1 -- 172.21.15.22:0/3782537461 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f8042030 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.706+0000 7f16f2a00640 1 -- 172.21.15.22:0/3782537461 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f17000a3fe0 con 0x555e58e649d0 2024-09-15T22:34:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.706+0000 7f171288b740 10 client.25246 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.706+0000 7f171288b740 10 client.25246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.707+0000 7f171288b740 20 client.25246 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.707+0000 7f171288b740 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58ef56f0 0x555e58ef7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.707+0000 7f171288b740 4 client.25246 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:34:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.707+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555e58dd0b80 con 0x555e58ef56f0 2024-09-15T22:34:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.707+0000 7f170d000640 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58ef56f0 0x555e58ef7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.708+0000 7f170d000640 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58ef56f0 0x555e58ef7ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8cb88bd31d19c16 server_cookie=c12b1225e0bfc5f8 in_seq=0 out_seq=0 2024-09-15T22:34:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.708+0000 7f16f2a00640 10 client.25246 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.721+0000 7f16f2a00640 1 -- 172.21.15.22:0/3782537461 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555e58dd0b80 con 0x555e58ef56f0 2024-09-15T22:34:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f16f2a00640 10 client.25246 handle_command_reply: tid=0 2024-09-15T22:34:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 client.25246 shutdown 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 msgr2=0x555e58e83b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e83b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1700099a60 tx=0x7f170000ce90 comp rx=0 tx=0).stop 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 shutdown_connections 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555e58ef56f0 0x555e58ef7ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555e58e649d0 0x555e58e83b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e58e69a60 0x555e58ef3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 --2- 172.21.15.22:0/3782537461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e58e64090 0x555e58e835f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 >> 172.21.15.22:0/3782537461 conn(0x555e58e5f700 msgr2=0x555e58e7ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.722+0000 7f16f2a00640 0 client.25246 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.723+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 shutdown_connections 2024-09-15T22:34:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.723+0000 7f171288b740 1 -- 172.21.15.22:0/3782537461 wait complete. 2024-09-15T22:34:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.723+0000 7f171288b740 20 client.25246 trim_cache size 0 max 16384 2024-09-15T22:34:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:34:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:34:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:34:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:34:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16ec0a34e0 msgr2=0x7f16ec0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16ec0a34e0 0x7f16ec0a59a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f16f8031440 tx=0x7f16f8005b90 comp rx=0 tx=0).stop 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 msgr2=0x7f170819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 0x7f170819eb50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f170000bd50 tx=0x7f170000be40 comp rx=0 tx=0).stop 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 shutdown_connections 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f16ec0a34e0 0x7f16ec0a59a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17081a3bb0 0x7f17081a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17081014c0 0x7f170819eb50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 --2- 172.21.15.22:0/2549574095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1708100b20 0x7f170819e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 >> 172.21.15.22:0/2549574095 conn(0x7f17080fb500 msgr2=0x7f17080fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.726+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 shutdown_connections 2024-09-15T22:34:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:31.727+0000 7f170fa00640 1 -- 172.21.15.22:0/2549574095 wait complete. 2024-09-15T22:34:33.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:33 smithi112 ceph-mon[35032]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 260 MiB/s wr, 966 op/s 2024-09-15T22:34:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:33 smithi110 ceph-mon[35282]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 260 MiB/s wr, 966 op/s 2024-09-15T22:34:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:33 smithi022 ceph-mon[30634]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 260 MiB/s wr, 966 op/s 2024-09-15T22:34:35.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:35 smithi112 ceph-mon[35032]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 254 MiB/s wr, 921 op/s 2024-09-15T22:34:35.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:35 smithi110 ceph-mon[35282]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 254 MiB/s wr, 921 op/s 2024-09-15T22:34:35.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:35 smithi022 ceph-mon[30634]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 254 MiB/s wr, 921 op/s 2024-09-15T22:34:37.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:37 smithi112 ceph-mon[35032]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 247 MiB/s wr, 846 op/s 2024-09-15T22:34:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:37 smithi110 ceph-mon[35282]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 247 MiB/s wr, 846 op/s 2024-09-15T22:34:37.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:37 smithi022 ceph-mon[30634]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 247 MiB/s wr, 846 op/s 2024-09-15T22:34:39.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:39 smithi110 ceph-mon[35282]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 268 MiB/s wr, 867 op/s 2024-09-15T22:34:39.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:39 smithi022 ceph-mon[30634]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 268 MiB/s wr, 867 op/s 2024-09-15T22:34:39.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:39 smithi112 ceph-mon[35032]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 268 MiB/s wr, 867 op/s 2024-09-15T22:34:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:41 smithi110 ceph-mon[35282]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 788 op/s 2024-09-15T22:34:41.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:41 smithi022 ceph-mon[30634]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 788 op/s 2024-09-15T22:34:41.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:41 smithi112 ceph-mon[35032]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 788 op/s 2024-09-15T22:34:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:43 smithi110 ceph-mon[35282]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 274 MiB/s wr, 840 op/s 2024-09-15T22:34:43.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:43 smithi022 ceph-mon[30634]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 274 MiB/s wr, 840 op/s 2024-09-15T22:34:43.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:43 smithi112 ceph-mon[35032]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 274 MiB/s wr, 840 op/s 2024-09-15T22:34:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 -- 172.21.15.22:0/1206067605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0103050 msgr2=0x7f33e0103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 --2- 172.21.15.22:0/1206067605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0103050 0x7f33e0103450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009900 tx=0x7f33c802e850 comp rx=0 tx=0).stop 2024-09-15T22:34:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 -- 172.21.15.22:0/1206067605 shutdown_connections 2024-09-15T22:34:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 --2- 172.21.15.22:0/1206067605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33e0101f40 0x7f33e0109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 --2- 172.21.15.22:0/1206067605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33e0101580 0x7f33e0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 --2- 172.21.15.22:0/1206067605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0103050 0x7f33e0103450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 -- 172.21.15.22:0/1206067605 >> 172.21.15.22:0/1206067605 conn(0x7f33e00fd0d0 msgr2=0x7f33e00ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 -- 172.21.15.22:0/1206067605 shutdown_connections 2024-09-15T22:34:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.974+0000 7f33e4a00640 1 -- 172.21.15.22:0/1206067605 wait complete. 2024-09-15T22:34:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.975+0000 7f33e4a00640 1 Processor -- start 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 -- start start 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33e0101580 0x7f33e0195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 0x7f33e0196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33e0103050 0x7f33e019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33e010b630 con 0x7f33e0101580 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f33e010b4b0 con 0x7f33e0103050 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33e4a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33e010b7b0 con 0x7f33e0101f40 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33dea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 0x7f33e0196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.976+0000 7f33dea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 0x7f33e0196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48424/0 (socket says 172.21.15.22:48424) 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33e0103050 0x7f33e019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 -- 172.21.15.22:0/3413253473 learned_addr learned my addr 172.21.15.22:0/3413253473 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33df400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33e0101580 0x7f33e0195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 -- 172.21.15.22:0/3413253473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33e0103050 msgr2=0x7f33e019d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33e0103050 0x7f33e019d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 -- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33e0101580 msgr2=0x7f33e0195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33e0101580 0x7f33e0195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 -- 172.21.15.22:0/3413253473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e019d940 con 0x7f33e0101f40 2024-09-15T22:34:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.977+0000 7f33dea00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 0x7f33e0196270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33d000b4a0 tx=0x7f33d000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.978+0000 7f33d7e00640 1 -- 172.21.15.22:0/3413253473 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0014070 con 0x7f33e0101f40 2024-09-15T22:34:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.978+0000 7f33d7e00640 1 -- 172.21.15.22:0/3413253473 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d0010af0 con 0x7f33e0101f40 2024-09-15T22:34:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.978+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e019dc30 con 0x7f33e0101f40 2024-09-15T22:34:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.978+0000 7f33d7e00640 1 -- 172.21.15.22:0/3413253473 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0017d10 con 0x7f33e0101f40 2024-09-15T22:34:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.978+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e019e1d0 con 0x7f33e0101f40 2024-09-15T22:34:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.982+0000 7f33e8e08740 1 Processor -- start 2024-09-15T22:34:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 -- start start 2024-09-15T22:34:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33d7e00640 1 -- 172.21.15.22:0/3413253473 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f33d0017070 con 0x7f33e0101f40 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2fee7260 0x562b2fee7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7ba0 0x562b2feec660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2feecc30 0x562b2feef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b2fe4c100 con 0x562b2feecc30 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562b2fdf41b0 con 0x562b2fee7260 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.983+0000 7f33e8e08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562b2fe480c0 con 0x562b2fee7ba0 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33df400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7ba0 0x562b2feec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33df400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7ba0 0x562b2feec660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48438/0 (socket says 172.21.15.22:48438) 2024-09-15T22:34:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33df400640 1 -- 172.21.15.22:0/3732805930 learned_addr learned my addr 172.21.15.22:0/3732805930 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dfe00640 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2fee7260 0x562b2fee7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dea00640 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2feecc30 0x562b2feef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dfe00640 1 -- 172.21.15.22:0/3732805930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7ba0 msgr2=0x562b2feec660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dfe00640 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7ba0 0x562b2feec660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dfe00640 1 -- 172.21.15.22:0/3732805930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2feecc30 msgr2=0x562b2feef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dfe00640 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2feecc30 0x562b2feef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.984+0000 7f33dfe00640 1 -- 172.21.15.22:0/3732805930 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2fb5f210 con 0x562b2fee7260 2024-09-15T22:34:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.985+0000 7f33d7e00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f33c40a3340 0x7f33c40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.985+0000 7f33d7e00640 1 -- 172.21.15.22:0/3413253473 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f33d00cecd0 con 0x7f33e0101f40 2024-09-15T22:34:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.985+0000 7f33dfe00640 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2fee7260 0x562b2fee7660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009fb0 tx=0x7f33d8009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ddd9692461d8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.986+0000 7f33cfe00640 1 -- 172.21.15.22:0/3732805930 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8013790 con 0x562b2fee7260 2024-09-15T22:34:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.986+0000 7f33cfe00640 1 -- 172.21.15.22:0/3732805930 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d8019070 con 0x562b2fee7260 2024-09-15T22:34:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.986+0000 7f33cfe00640 1 -- 172.21.15.22:0/3732805930 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8014dc0 con 0x562b2fee7260 2024-09-15T22:34:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.986+0000 7f33df400640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f33c40a3340 0x7f33c40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 -- 172.21.15.22:0/3732805930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2fee7260 msgr2=0x562b2fee7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2fee7260 0x562b2fee7660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009fb0 tx=0x7f33d8009650 comp rx=0 tx=0).stop 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33df400640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f33c40a3340 0x7f33c40a5800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006010 tx=0x7f33c8009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 -- 172.21.15.22:0/3732805930 shutdown_connections 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7ba0 0x562b2feec660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2feecc30 0x562b2feef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 --2- 172.21.15.22:0/3732805930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2fee7260 0x562b2fee7660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 -- 172.21.15.22:0/3732805930 >> 172.21.15.22:0/3732805930 conn(0x562b2fee28d0 msgr2=0x562b2fee2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.987+0000 7f33e8e08740 1 -- 172.21.15.22:0/3732805930 shutdown_connections 2024-09-15T22:34:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.988+0000 7f33e8e08740 1 -- 172.21.15.22:0/3732805930 wait complete. 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.988+0000 7f33e8e08740 1 -- start start 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.988+0000 7f33e8e08740 1 Processor -- start 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff01230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b2feefc00 con 0x562b2fee7ba0 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562b2fdd5090 con 0x562b2feecc30 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562b2feefd80 con 0x562b2fee7260 2024-09-15T22:34:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.989+0000 7f33e8e08740 10 client.0 _ll_register_callbacks cb 0x562b2fe29f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.990+0000 7f33dea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.990+0000 7f33dea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44320/0 (socket says 172.21.15.22:44320) 2024-09-15T22:34:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.990+0000 7f33dea00640 1 -- 172.21.15.22:0/1846245859 learned_addr learned my addr 172.21.15.22:0/1846245859 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.990+0000 7f33dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff01230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.990+0000 7f33df400640 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33dfe00640 1 -- 172.21.15.22:0/1846245859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 msgr2=0x562b2fef9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33dfe00640 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33dfe00640 1 -- 172.21.15.22:0/1846245859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 msgr2=0x562b2fefa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33dfe00640 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33dfe00640 1 -- 172.21.15.22:0/1846245859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2fc2b620 con 0x562b2feecc30 2024-09-15T22:34:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:34:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33dfe00640 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff01230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33d800ad20 tx=0x7f33d8015b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c1e5735a76c1c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.991+0000 7f33ccc00640 1 -- 172.21.15.22:0/1846245859 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8015e80 con 0x562b2feecc30 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33ccc00640 1 -- 172.21.15.22:0/1846245859 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f33d8013590 con 0x562b2feecc30 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33d8019070 con 0x562b2feecc30 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33ccc00640 1 -- 172.21.15.22:0/1846245859 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f33d8013790 con 0x562b2feecc30 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33e8e08740 10 client.25238 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b2fef3a40 con 0x562b2feecc30 2024-09-15T22:34:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33ccc00640 1 -- 172.21.15.22:0/1846245859 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d8019070 con 0x562b2feecc30 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.992+0000 7f33ccc00640 1 -- 172.21.15.22:0/1846245859 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f33d8027a30 con 0x562b2feecc30 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33e8e08740 10 client.25238 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33e8e08740 10 client.25238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33e8e08740 20 client.25238 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33e8e08740 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2fef4f70 0x562b2fef7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33e8e08740 4 client.25238 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b2fe59830 con 0x562b2fef4f70 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.993+0000 7f33df400640 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2fef4f70 0x562b2fef7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.994+0000 7f33df400640 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2fef4f70 0x562b2fef7360 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c695cc990f02cb6a server_cookie=2c0df2135ee8a4a0 in_seq=0 out_seq=0 2024-09-15T22:34:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.994+0000 7f33ccc00640 10 client.25238 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33ccc00640 1 -- 172.21.15.22:0/1846245859 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b2fe59830 con 0x562b2fef4f70 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33ccc00640 10 client.25238 handle_command_reply: tid=0 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 client.25238 shutdown 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 msgr2=0x562b2ff01230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff01230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33d800ad20 tx=0x7f33d8015b10 comp rx=0 tx=0).stop 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 shutdown_connections 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2fef4f70 0x562b2fef7360 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff01230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 --2- 172.21.15.22:0/1846245859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33ccc00640 0 client.25238 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 >> 172.21.15.22:0/1846245859 conn(0x562b2fee28d0 msgr2=0x562b2fee40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 shutdown_connections 2024-09-15T22:34:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.995+0000 7f33e8e08740 1 -- 172.21.15.22:0/1846245859 wait complete. 2024-09-15T22:34:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:44.996+0000 7f33e8e08740 20 client.25238 trim_cache size 0 max 16384 2024-09-15T22:34:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.027+0000 7f33e8e08740 1 Processor -- start 2024-09-15T22:34:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.033+0000 7f33e8e08740 1 -- start start 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.033+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.033+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2ff011f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.033+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2fefa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33e8e08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01a96e0 con 0x562b2fee7ba0 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33e8e08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01a6fb0 con 0x562b2feecc30 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33e8e08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01a4de0 con 0x562b2fee7260 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2fefa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2fefa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:43086/0 (socket says 172.21.15.22:43086) 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 -- 172.21.15.22:0/779352477 learned_addr learned my addr 172.21.15.22:0/779352477 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 -- 172.21.15.22:0/779352477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 msgr2=0x562b2fef9cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 -- 172.21.15.22:0/779352477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 msgr2=0x562b2ff011f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:34:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2ff011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.034+0000 7f33dfe00640 1 -- 172.21.15.22:0/779352477 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2fef1040 con 0x562b2feecc30 2024-09-15T22:34:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.035+0000 7f33dfe00640 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2fefa1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33d8014a20 tx=0x7f33d800af30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59d0d839d505917e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.037+0000 7f33cf400640 1 -- 172.21.15.22:0/779352477 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8013590 con 0x562b2feecc30 2024-09-15T22:34:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.037+0000 7f33cf400640 1 -- 172.21.15.22:0/779352477 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d8019070 con 0x562b2feecc30 2024-09-15T22:34:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.037+0000 7f33cf400640 1 -- 172.21.15.22:0/779352477 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8003a10 con 0x562b2feecc30 2024-09-15T22:34:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.041+0000 7f33e8e08740 1 -- 172.21.15.22:0/779352477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 msgr2=0x562b2fefa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.041+0000 7f33e8e08740 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2fefa1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33d8014a20 tx=0x7f33d800af30 comp rx=0 tx=0).stop 2024-09-15T22:34:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.045+0000 7f33e8e08740 1 -- 172.21.15.22:0/779352477 shutdown_connections 2024-09-15T22:34:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.045+0000 7f33e8e08740 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2fefa1f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.045+0000 7f33e8e08740 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2ff011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.045+0000 7f33e8e08740 1 --2- 172.21.15.22:0/779352477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fef9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.045+0000 7f33e8e08740 1 -- 172.21.15.22:0/779352477 >> 172.21.15.22:0/779352477 conn(0x562b2fee28d0 msgr2=0x562b2fee8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.049+0000 7f33e8e08740 1 -- 172.21.15.22:0/779352477 shutdown_connections 2024-09-15T22:34:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.049+0000 7f33e8e08740 1 -- 172.21.15.22:0/779352477 wait complete. 2024-09-15T22:34:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.049+0000 7f33e8e08740 1 -- start start 2024-09-15T22:34:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.050+0000 7f33e8e08740 1 Processor -- start 2024-09-15T22:34:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fefbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33e8e08740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff76760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33df400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fefbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33e8e08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01a5470 con 0x562b2fee7ba0 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33e8e08740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01a68e0 con 0x562b2feecc30 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33e8e08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33e01a5b40 con 0x562b2fee7260 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33df400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fefbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48472/0 (socket says 172.21.15.22:48472) 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.052+0000 7f33df400640 1 -- 172.21.15.22:0/4195002568 learned_addr learned my addr 172.21.15.22:0/4195002568 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.053+0000 7f33e8e08740 10 client.0 _ll_register_callbacks cb 0x7f33c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.053+0000 7f33dfe00640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff76760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.053+0000 7f33dea00640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.053+0000 7f33dfe00640 1 -- 172.21.15.22:0/4195002568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 msgr2=0x562b2fefbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.053+0000 7f33dfe00640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fefbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33dfe00640 1 -- 172.21.15.22:0/4195002568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 msgr2=0x562b2fefc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33dfe00640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33dfe00640 1 -- 172.21.15.22:0/4195002568 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2fefcaf0 con 0x562b2feecc30 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33df400640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fefbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33dfe00640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff76760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33d8027e80 tx=0x7f33d80144f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85e8573a9a0c06f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.054+0000 7f33ccc00640 1 -- 172.21.15.22:0/4195002568 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8052060 con 0x562b2feecc30 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.055+0000 7f33ccc00640 1 -- 172.21.15.22:0/4195002568 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f33d8013590 con 0x562b2feecc30 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.055+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33d8019070 con 0x562b2feecc30 2024-09-15T22:34:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.055+0000 7f33ccc00640 1 -- 172.21.15.22:0/4195002568 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f33d8003c20 con 0x562b2feecc30 2024-09-15T22:34:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.055+0000 7f33e8e08740 10 client.25244 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.056+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b2ff77dc0 con 0x562b2feecc30 2024-09-15T22:34:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.056+0000 7f33ccc00640 1 -- 172.21.15.22:0/4195002568 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d8019070 con 0x562b2feecc30 2024-09-15T22:34:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.056+0000 7f33ccc00640 1 -- 172.21.15.22:0/4195002568 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f33d8013cd0 con 0x562b2feecc30 2024-09-15T22:34:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33e8e08740 10 client.25244 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33e8e08740 10 client.25244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33e8e08740 20 client.25244 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33e8e08740 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2ff78650 0x562b2ff7aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33e8e08740 4 client.25244 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:34:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b2fe53b80 con 0x562b2ff78650 2024-09-15T22:34:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.057+0000 7f33df400640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2ff78650 0x562b2ff7aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.065+0000 7f33df400640 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2ff78650 0x562b2ff7aa40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f88fba5968be21 server_cookie=5469265ab507047d in_seq=0 out_seq=0 2024-09-15T22:34:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.065+0000 7f33ccc00640 10 client.25244 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:45.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.126+0000 7f33ccc00640 1 -- 172.21.15.22:0/4195002568 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b2fe53b80 con 0x562b2ff78650 2024-09-15T22:34:45.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.126+0000 7f33ccc00640 10 client.25244 handle_command_reply: tid=0 2024-09-15T22:34:45.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.127+0000 7f33e8e08740 1 client.25244 shutdown 2024-09-15T22:34:45.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.128+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 msgr2=0x562b2ff76760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:45.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.128+0000 7f33e8e08740 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff76760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33d8027e80 tx=0x7f33d80144f0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.130+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 shutdown_connections 2024-09-15T22:34:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.131+0000 7f33e8e08740 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x562b2ff78650 0x562b2ff7aa40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.131+0000 7f33e8e08740 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562b2feecc30 0x562b2ff76760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.131+0000 7f33e8e08740 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2fee7ba0 0x562b2fefc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.131+0000 7f33ccc00640 0 client.25244 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.131+0000 7f33e8e08740 1 --2- 172.21.15.22:0/4195002568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b2fee7260 0x562b2fefbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.131+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 >> 172.21.15.22:0/4195002568 conn(0x562b2fee28d0 msgr2=0x562b2fee8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.132+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 shutdown_connections 2024-09-15T22:34:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.132+0000 7f33e8e08740 1 -- 172.21.15.22:0/4195002568 wait complete. 2024-09-15T22:34:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.133+0000 7f33e8e08740 20 client.25244 trim_cache size 0 max 16384 2024-09-15T22:34:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:34:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:34:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:34:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f33c40a3340 msgr2=0x7f33c40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f33c40a3340 0x7f33c40a5800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006010 tx=0x7f33c8009560 comp rx=0 tx=0).stop 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 msgr2=0x7f33e0196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 0x7f33e0196270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33d000b4a0 tx=0x7f33d000b960 comp rx=0 tx=0).stop 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 shutdown_connections 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e0101f40 0x7f33e0196270 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f33c40a3340 0x7f33c40a5800 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33e0103050 0x7f33e019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 --2- 172.21.15.22:0/3413253473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33e0101580 0x7f33e0195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.139+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 >> 172.21.15.22:0/3413253473 conn(0x7f33e00fd0d0 msgr2=0x7f33e0105f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.142+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 shutdown_connections 2024-09-15T22:34:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:45.144+0000 7f33e4a00640 1 -- 172.21.15.22:0/3413253473 wait complete. 2024-09-15T22:34:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:45 smithi110 ceph-mon[35282]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 266 MiB/s wr, 804 op/s 2024-09-15T22:34:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:45 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:34:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:45 smithi022 ceph-mon[30634]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 266 MiB/s wr, 804 op/s 2024-09-15T22:34:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:45 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:34:45.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:45 smithi112 ceph-mon[35032]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 266 MiB/s wr, 804 op/s 2024-09-15T22:34:45.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:45 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:34:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:46 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:34:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:46 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:34:46.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:46 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:34:46.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:46 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:34:46.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:46 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:34:46.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:46 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:34:46.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:34:46.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:34:46.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:34:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:47 smithi110 ceph-mon[35282]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 263 MiB/s wr, 801 op/s 2024-09-15T22:34:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:47 smithi022 ceph-mon[30634]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 263 MiB/s wr, 801 op/s 2024-09-15T22:34:47.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:47 smithi112 ceph-mon[35032]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 263 MiB/s wr, 801 op/s 2024-09-15T22:34:49.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:49 smithi110 ceph-mon[35282]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 276 MiB/s wr, 850 op/s 2024-09-15T22:34:49.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:49 smithi022 ceph-mon[30634]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 276 MiB/s wr, 850 op/s 2024-09-15T22:34:49.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:49 smithi112 ceph-mon[35032]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 276 MiB/s wr, 850 op/s 2024-09-15T22:34:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:51 smithi022 ceph-mon[30634]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 252 MiB/s wr, 796 op/s 2024-09-15T22:34:51.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:51 smithi112 ceph-mon[35032]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 252 MiB/s wr, 796 op/s 2024-09-15T22:34:51.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:51 smithi110 ceph-mon[35282]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 252 MiB/s wr, 796 op/s 2024-09-15T22:34:53.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:53 smithi022 ceph-mon[30634]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 265 MiB/s wr, 854 op/s 2024-09-15T22:34:53.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:53 smithi112 ceph-mon[35032]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 265 MiB/s wr, 854 op/s 2024-09-15T22:34:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:53 smithi110 ceph-mon[35282]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 265 MiB/s wr, 854 op/s 2024-09-15T22:34:55.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:55 smithi022 ceph-mon[30634]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 261 MiB/s wr, 869 op/s 2024-09-15T22:34:55.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:55 smithi112 ceph-mon[35032]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 261 MiB/s wr, 869 op/s 2024-09-15T22:34:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:55 smithi110 ceph-mon[35282]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 261 MiB/s wr, 869 op/s 2024-09-15T22:34:57.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:57 smithi112 ceph-mon[35032]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 254 MiB/s wr, 862 op/s 2024-09-15T22:34:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:57 smithi110 ceph-mon[35282]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 254 MiB/s wr, 862 op/s 2024-09-15T22:34:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:57 smithi022 ceph-mon[30634]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 254 MiB/s wr, 862 op/s 2024-09-15T22:34:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 -- 172.21.15.22:0/3515749199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa900736c0 msgr2=0x7ffa9010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 --2- 172.21.15.22:0/3515749199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa900736c0 0x7ffa9010a6d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009be0 tx=0x7ffa8802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 -- 172.21.15.22:0/3515749199 shutdown_connections 2024-09-15T22:34:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 --2- 172.21.15.22:0/3515749199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa900736c0 0x7ffa9010a6d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 --2- 172.21.15.22:0/3515749199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90072d20 0x7ffa90073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 --2- 172.21.15.22:0/3515749199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa90109700 0x7ffa90109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 -- 172.21.15.22:0/3515749199 >> 172.21.15.22:0/3515749199 conn(0x7ffa9006ece0 msgr2=0x7ffa90071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 -- 172.21.15.22:0/3515749199 shutdown_connections 2024-09-15T22:34:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.353+0000 7ffa96000640 1 -- 172.21.15.22:0/3515749199 wait complete. 2024-09-15T22:34:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.354+0000 7ffa96000640 1 Processor -- start 2024-09-15T22:34:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.354+0000 7ffa96000640 1 -- start start 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa96000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa90072d20 0x7ffa901a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa96000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 0x7ffa901a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa96000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90109700 0x7ffa901a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa96000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901181e0 con 0x7ffa90109700 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa96000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90118060 con 0x7ffa900736c0 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa96000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90118360 con 0x7ffa90072d20 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 0x7ffa901a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 0x7ffa901a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38136/0 (socket says 172.21.15.22:38136) 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8ea00640 1 -- 172.21.15.22:0/448408801 learned_addr learned my addr 172.21.15.22:0/448408801 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90109700 0x7ffa901a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8f400640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa90072d20 0x7ffa901a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8ea00640 1 -- 172.21.15.22:0/448408801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa90072d20 msgr2=0x7ffa901a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.355+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa90072d20 0x7ffa901a25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa8ea00640 1 -- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90109700 msgr2=0x7ffa901a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90109700 0x7ffa901a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa8ea00640 1 -- 172.21.15.22:0/448408801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa901aa210 con 0x7ffa900736c0 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa8f400640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa90072d20 0x7ffa901a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90109700 0x7ffa901a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:34:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 0x7ffa901a2b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00b4a0 tx=0x7ffa7c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa87e00640 1 -- 172.21.15.22:0/448408801 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c014070 con 0x7ffa900736c0 2024-09-15T22:34:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa87e00640 1 -- 172.21.15.22:0/448408801 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7c010af0 con 0x7ffa900736c0 2024-09-15T22:34:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa87e00640 1 -- 172.21.15.22:0/448408801 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c017d10 con 0x7ffa900736c0 2024-09-15T22:34:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.356+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa901aa500 con 0x7ffa900736c0 2024-09-15T22:34:58.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.357+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa901aaa80 con 0x7ffa900736c0 2024-09-15T22:34:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 Processor -- start 2024-09-15T22:34:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 -- start start 2024-09-15T22:34:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 0x55d1c6e99490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e999d0 0x55d1c6e9e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6ea0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1c6dfe100 con 0x55d1c6e9ea60 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d1c6da61b0 con 0x55d1c6e99090 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.360+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d1c6dfa0c0 con 0x55d1c6e999d0 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 0x55d1c6e99490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 0x55d1c6e99490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38146/0 (socket says 172.21.15.22:38146) 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 -- 172.21.15.22:0/4263136751 learned_addr learned my addr 172.21.15.22:0/4263136751 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 -- 172.21.15.22:0/4263136751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e999d0 msgr2=0x55d1c6e9e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e999d0 0x55d1c6e9e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 -- 172.21.15.22:0/4263136751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 msgr2=0x55d1c6ea0f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6ea0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 -- 172.21.15.22:0/4263136751 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1c6b11210 con 0x55d1c6e99090 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.361+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 0x55d1c6e99490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009370 tx=0x7ffa8800b130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf65d05a6d467da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.362+0000 7ffa87e00640 1 -- 172.21.15.22:0/448408801 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ffa7c017070 con 0x7ffa900736c0 2024-09-15T22:34:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.362+0000 7ffa7be00640 1 -- 172.21.15.22:0/4263136751 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88041070 con 0x55d1c6e99090 2024-09-15T22:34:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.363+0000 7ffa7be00640 1 -- 172.21.15.22:0/4263136751 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa88037040 con 0x55d1c6e99090 2024-09-15T22:34:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.363+0000 7ffa7be00640 1 -- 172.21.15.22:0/4263136751 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88036030 con 0x55d1c6e99090 2024-09-15T22:34:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.364+0000 7ffa98dfe740 1 -- 172.21.15.22:0/4263136751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 msgr2=0x55d1c6e99490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.364+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 0x55d1c6e99490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009370 tx=0x7ffa8800b130 comp rx=0 tx=0).stop 2024-09-15T22:34:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.366+0000 7ffa87e00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ffa740a32f0 0x7ffa740a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.366+0000 7ffa87e00640 1 -- 172.21.15.22:0/448408801 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ffa7c0cedd0 con 0x7ffa900736c0 2024-09-15T22:34:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.368+0000 7ffa98dfe740 1 -- 172.21.15.22:0/4263136751 shutdown_connections 2024-09-15T22:34:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.368+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e999d0 0x55d1c6e9e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.368+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6ea0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.368+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/4263136751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e99090 0x55d1c6e99490 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.368+0000 7ffa98dfe740 1 -- 172.21.15.22:0/4263136751 >> 172.21.15.22:0/4263136751 conn(0x55d1c6e94700 msgr2=0x55d1c6e94b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.369+0000 7ffa98dfe740 1 -- 172.21.15.22:0/4263136751 shutdown_connections 2024-09-15T22:34:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.369+0000 7ffa98dfe740 1 -- 172.21.15.22:0/4263136751 wait complete. 2024-09-15T22:34:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.370+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ffa740a32f0 0x7ffa740a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.370+0000 7ffa98dfe740 1 -- start start 2024-09-15T22:34:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.371+0000 7ffa98dfe740 1 Processor -- start 2024-09-15T22:34:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.373+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ffa740a32f0 0x7ffa740a57b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa88003ef0 tx=0x7ffa8802a6c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eabac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e999d0 0x55d1c6eac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1c6eaa1e0 con 0x55d1c6e999d0 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d1c6d87090 con 0x55d1c6e9ea60 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d1c6eaa360 con 0x55d1c6e99090 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.374+0000 7ffa98dfe740 10 client.0 _ll_register_callbacks cb 0x55d1c6ddbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eabac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eabac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:44930/0 (socket says 172.21.15.22:44930) 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8f400640 1 -- 172.21.15.22:0/2124255607 learned_addr learned my addr 172.21.15.22:0/2124255607 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e999d0 0x55d1c6eac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8f400640 1 -- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e9ea60 msgr2=0x55d1c6eb2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8f400640 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.375+0000 7ffa8f400640 1 -- 172.21.15.22:0/2124255607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e999d0 msgr2=0x55d1c6eac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa8f400640 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e999d0 0x55d1c6eac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa8f400640 1 -- 172.21.15.22:0/2124255607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1c6bdd620 con 0x55d1c6e99090 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa8f400640 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eabac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa80010620 tx=0x7ffa80010ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65a9800f1f8861dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa78c00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa78c00640 1 -- 172.21.15.22:0/2124255607 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80004220 con 0x55d1c6e99090 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa88037040 con 0x55d1c6e99090 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.376+0000 7ffa78c00640 1 -- 172.21.15.22:0/2124255607 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ffa800043c0 con 0x55d1c6e99090 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa78c00640 1 -- 172.21.15.22:0/2124255607 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa80005020 con 0x55d1c6e99090 2024-09-15T22:34:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 10 client.25267 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d1c6eb5ee0 con 0x55d1c6e99090 2024-09-15T22:34:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa78c00640 1 -- 172.21.15.22:0/2124255607 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa88037040 con 0x55d1c6e99090 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa78c00640 1 -- 172.21.15.22:0/2124255607 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa8000f040 con 0x55d1c6e99090 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 10 client.25267 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 10 client.25267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 20 client.25267 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6eb7560 0x55d1c6eb99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 4 client.25267 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.377+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1c6e0b830 con 0x55d1c6eb7560 2024-09-15T22:34:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.378+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6eb7560 0x55d1c6eb99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.378+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6eb7560 0x55d1c6eb99b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e79ab1089b5245a9 server_cookie=80979bdc4096f10a in_seq=0 out_seq=0 2024-09-15T22:34:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.378+0000 7ffa78c00640 10 client.25267 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.379+0000 7ffa78c00640 1 -- 172.21.15.22:0/2124255607 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1c6e0b830 con 0x55d1c6eb7560 2024-09-15T22:34:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.379+0000 7ffa78c00640 10 client.25267 handle_command_reply: tid=0 2024-09-15T22:34:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.379+0000 7ffa98dfe740 1 client.25267 shutdown 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.381+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 msgr2=0x55d1c6eabac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.381+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eabac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa80010620 tx=0x7ffa80010ae0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 shutdown_connections 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6eb7560 0x55d1c6eb99b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e999d0 0x55d1c6eac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa78c00640 0 client.25267 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2124255607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eabac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 >> 172.21.15.22:0/2124255607 conn(0x55d1c6e94700 msgr2=0x55d1c6e95f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 shutdown_connections 2024-09-15T22:34:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2124255607 wait complete. 2024-09-15T22:34:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.382+0000 7ffa98dfe740 20 client.25267 trim_cache size 0 max 16384 2024-09-15T22:34:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 Processor -- start 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 -- start start 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eb2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6e93770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901b1f90 con 0x55d1c6e9ea60 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901af860 con 0x55d1c6e999d0 2024-09-15T22:34:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901ad6b0 con 0x55d1c6e99090 2024-09-15T22:34:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa8f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa8f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:44932/0 (socket says 172.21.15.22:44932) 2024-09-15T22:34:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.405+0000 7ffa8f400640 1 -- 172.21.15.22:0/2796751935 learned_addr learned my addr 172.21.15.22:0/2796751935 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6e93770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8f400640 1 -- 172.21.15.22:0/2796751935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 msgr2=0x55d1c6eb2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8f400640 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eb2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8f400640 1 -- 172.21.15.22:0/2796751935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 msgr2=0x55d1c6e93770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8f400640 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6e93770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8f400640 1 -- 172.21.15.22:0/2796751935 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1c6e94520 con 0x55d1c6e99090 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa8f400640 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eac090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa80001eb0 tx=0x7ffa80009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4267a5f63c15626 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.406+0000 7ffa7b400640 1 -- 172.21.15.22:0/2796751935 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011000 con 0x55d1c6e99090 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.407+0000 7ffa7b400640 1 -- 172.21.15.22:0/2796751935 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa800111a0 con 0x55d1c6e99090 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.407+0000 7ffa7b400640 1 -- 172.21.15.22:0/2796751935 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80003850 con 0x55d1c6e99090 2024-09-15T22:34:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.408+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2796751935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 msgr2=0x55d1c6eac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.408+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eac090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa80001eb0 tx=0x7ffa80009e50 comp rx=0 tx=0).stop 2024-09-15T22:34:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2796751935 shutdown_connections 2024-09-15T22:34:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e9ea60 0x55d1c6e93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eb2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/2796751935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e99090 0x55d1c6eac090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2796751935 >> 172.21.15.22:0/2796751935 conn(0x55d1c6e94700 msgr2=0x55d1c6e93060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2796751935 shutdown_connections 2024-09-15T22:34:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 -- 172.21.15.22:0/2796751935 wait complete. 2024-09-15T22:34:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.409+0000 7ffa98dfe740 1 -- start start 2024-09-15T22:34:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 Processor -- start 2024-09-15T22:34:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e99090 0x55d1c6eae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eaebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901add20 con 0x55d1c6e99090 2024-09-15T22:34:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901af190 con 0x55d1c6e999d0 2024-09-15T22:34:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa901ae3f0 con 0x55d1c6e9ea60 2024-09-15T22:34:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa98dfe740 10 client.0 _ll_register_callbacks cb 0x7ffa80009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:34:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.410+0000 7ffa8ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eaebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eaebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38178/0 (socket says 172.21.15.22:38178) 2024-09-15T22:34:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 -- 172.21.15.22:0/1157036165 learned_addr learned my addr 172.21.15.22:0/1157036165 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:34:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8fe00640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8f400640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e99090 0x55d1c6eae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 -- 172.21.15.22:0/1157036165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e9ea60 msgr2=0x55d1c6eb1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 -- 172.21.15.22:0/1157036165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e99090 msgr2=0x55d1c6eae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e99090 0x55d1c6eae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 -- 172.21.15.22:0/1157036165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1c6eb2220 con 0x55d1c6e999d0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8f400640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e99090 0x55d1c6eae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa8ea00640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eaebf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009420 tx=0x7ffa7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa7cc86722fa1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.411+0000 7ffa78c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa78c00640 1 -- 172.21.15.22:0/1157036165 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0b3070 con 0x55d1c6e999d0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa78c00640 1 -- 172.21.15.22:0/1157036165 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ffa7c017360 con 0x55d1c6e999d0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa800111a0 con 0x55d1c6e999d0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa78c00640 1 -- 172.21.15.22:0/1157036165 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa7c01e040 con 0x55d1c6e999d0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa98dfe740 10 client.25259 fetch_fsmap learned FSMap version 25 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d1c6ea5780 con 0x55d1c6e999d0 2024-09-15T22:34:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.412+0000 7ffa78c00640 1 -- 172.21.15.22:0/1157036165 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa800111a0 con 0x55d1c6e999d0 2024-09-15T22:34:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa78c00640 1 -- 172.21.15.22:0/1157036165 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa7c097a20 con 0x55d1c6e999d0 2024-09-15T22:34:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa98dfe740 10 client.25259 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa98dfe740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa98dfe740 20 client.25259 populate_metadata read hostname 'smithi022' 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6ea6180 0x55d1c6ea85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa98dfe740 4 client.25259 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.413+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1c6e05b80 con 0x55d1c6ea6180 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.414+0000 7ffa8f400640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6ea6180 0x55d1c6ea85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.414+0000 7ffa8f400640 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6ea6180 0x55d1c6ea85a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=308b4271cb42400c server_cookie=25b3e931f656a86d in_seq=0 out_seq=0 2024-09-15T22:34:58.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.414+0000 7ffa78c00640 10 client.25259 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa78c00640 1 -- 172.21.15.22:0/1157036165 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d1c6e05b80 con 0x55d1c6ea6180 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa78c00640 10 client.25259 handle_command_reply: tid=0 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 client.25259 shutdown 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 msgr2=0x55d1c6eaebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eaebf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009420 tx=0x7ffa7c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 shutdown_connections 2024-09-15T22:34:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55d1c6ea6180 0x55d1c6ea85a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d1c6e9ea60 0x55d1c6eb1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d1c6e999d0 0x55d1c6eaebf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa78c00640 0 client.25259 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 --2- 172.21.15.22:0/1157036165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c6e99090 0x55d1c6eae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 >> 172.21.15.22:0/1157036165 conn(0x55d1c6e94700 msgr2=0x55d1c6e93880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 shutdown_connections 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.429+0000 7ffa98dfe740 1 -- 172.21.15.22:0/1157036165 wait complete. 2024-09-15T22:34:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.430+0000 7ffa98dfe740 20 client.25259 trim_cache size 0 max 16384 2024-09-15T22:34:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:34:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:34:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:34:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:34:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.430+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ffa740a32f0 msgr2=0x7ffa740a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.430+0000 7ffa96000640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ffa740a32f0 0x7ffa740a57b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa88003ef0 tx=0x7ffa8802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.430+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 msgr2=0x7ffa901a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.430+0000 7ffa96000640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 0x7ffa901a2b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00b4a0 tx=0x7ffa7c00b960 comp rx=0 tx=0).stop 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 shutdown_connections 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ffa740a32f0 0x7ffa740a57b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa90109700 0x7ffa901a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa900736c0 0x7ffa901a2b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 --2- 172.21.15.22:0/448408801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa90072d20 0x7ffa901a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 >> 172.21.15.22:0/448408801 conn(0x7ffa9006ece0 msgr2=0x7ffa90071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 shutdown_connections 2024-09-15T22:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:34:58.431+0000 7ffa96000640 1 -- 172.21.15.22:0/448408801 wait complete. 2024-09-15T22:34:59.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:34:59 smithi112 ceph-mon[35032]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 924 op/s 2024-09-15T22:34:59.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:34:59 smithi110 ceph-mon[35282]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 924 op/s 2024-09-15T22:34:59.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:34:59 smithi022 ceph-mon[30634]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 924 op/s 2024-09-15T22:35:01.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:01 smithi112 ceph-mon[35032]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 861 op/s 2024-09-15T22:35:01.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:01 smithi110 ceph-mon[35282]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 861 op/s 2024-09-15T22:35:01.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:01 smithi022 ceph-mon[30634]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 861 op/s 2024-09-15T22:35:03.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:03 smithi112 ceph-mon[35032]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 278 MiB/s wr, 924 op/s 2024-09-15T22:35:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:03 smithi110 ceph-mon[35282]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 278 MiB/s wr, 924 op/s 2024-09-15T22:35:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:03 smithi022 ceph-mon[30634]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 278 MiB/s wr, 924 op/s 2024-09-15T22:35:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:05 smithi110 ceph-mon[35282]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 271 MiB/s wr, 882 op/s 2024-09-15T22:35:05.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:05 smithi022 ceph-mon[30634]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 271 MiB/s wr, 882 op/s 2024-09-15T22:35:05.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:05 smithi112 ceph-mon[35032]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 271 MiB/s wr, 882 op/s 2024-09-15T22:35:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:07 smithi110 ceph-mon[35282]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 829 op/s 2024-09-15T22:35:07.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:07 smithi022 ceph-mon[30634]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 829 op/s 2024-09-15T22:35:07.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:07 smithi112 ceph-mon[35032]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 829 op/s 2024-09-15T22:35:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:09 smithi110 ceph-mon[35282]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 280 MiB/s wr, 890 op/s 2024-09-15T22:35:09.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:09 smithi022 ceph-mon[30634]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 280 MiB/s wr, 890 op/s 2024-09-15T22:35:09.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:09 smithi112 ceph-mon[35032]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 280 MiB/s wr, 890 op/s 2024-09-15T22:35:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 -- 172.21.15.22:0/1879253575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 msgr2=0x7f5f9c10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 --2- 172.21.15.22:0/1879253575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 0x7f5f9c10be90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009ca0 tx=0x7f5f9402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 -- 172.21.15.22:0/1879253575 shutdown_connections 2024-09-15T22:35:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 --2- 172.21.15.22:0/1879253575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 --2- 172.21.15.22:0/1879253575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 0x7f5f9c10be90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 --2- 172.21.15.22:0/1879253575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c076230 0x7f5f9c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 -- 172.21.15.22:0/1879253575 >> 172.21.15.22:0/1879253575 conn(0x7f5f9c0fd2e0 msgr2=0x7f5f9c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.646+0000 7f5fa2600640 1 -- 172.21.15.22:0/1879253575 shutdown_connections 2024-09-15T22:35:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.647+0000 7f5fa2600640 1 -- 172.21.15.22:0/1879253575 wait complete. 2024-09-15T22:35:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 Processor -- start 2024-09-15T22:35:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 -- start start 2024-09-15T22:35:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c076230 0x7f5f9c19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 0x7f5f9c1a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1021a0 con 0x7f5f9c1099d0 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c102020 con 0x7f5f9c076230 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5fa2600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c102320 con 0x7f5f9c074c50 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5f9b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5f9aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c076230 0x7f5f9c19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5f9b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:56224/0 (socket says 172.21.15.22:56224) 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.648+0000 7f5f9b400640 1 -- 172.21.15.22:0/195316728 learned_addr learned my addr 172.21.15.22:0/195316728 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9be00640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 0x7f5f9c1a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9b400640 1 -- 172.21.15.22:0/195316728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c076230 msgr2=0x7f5f9c19e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9b400640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c076230 0x7f5f9c19e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9b400640 1 -- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 msgr2=0x7f5f9c1a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9b400640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 0x7f5f9c1a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9b400640 1 -- 172.21.15.22:0/195316728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c1a5fe0 con 0x7f5f9c074c50 2024-09-15T22:35:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f9b400640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00ea60 tx=0x7f5f8c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f93e00640 1 -- 172.21.15.22:0/195316728 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00cd20 con 0x7f5f9c074c50 2024-09-15T22:35:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f93e00640 1 -- 172.21.15.22:0/195316728 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c010910 con 0x7f5f9c074c50 2024-09-15T22:35:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5f93e00640 1 -- 172.21.15.22:0/195316728 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c018910 con 0x7f5f9c074c50 2024-09-15T22:35:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.649+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c1a62d0 con 0x7f5f9c074c50 2024-09-15T22:35:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.650+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c1a6850 con 0x7f5f9c074c50 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 Processor -- start 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 -- start start 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5f93e00640 1 -- 172.21.15.22:0/195316728 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5f8c010ac0 con 0x7f5f9c074c50 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab73c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab741490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab741a60 0x55beab743f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55beab6a1100 con 0x55beab73c090 2024-09-15T22:35:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beab6491b0 con 0x55beab73c9d0 2024-09-15T22:35:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.654+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55beab69d0c0 con 0x55beab741a60 2024-09-15T22:35:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab73c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab73c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47386/0 (socket says 172.21.15.22:47386) 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 -- 172.21.15.22:0/4069527150 learned_addr learned my addr 172.21.15.22:0/4069527150 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab741a60 0x55beab743f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 -- 172.21.15.22:0/4069527150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab741a60 msgr2=0x55beab743f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab741a60 0x55beab743f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 -- 172.21.15.22:0/4069527150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 msgr2=0x55beab741490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab741490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.655+0000 7f5f9be00640 1 -- 172.21.15.22:0/4069527150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beab3b4210 con 0x55beab73c090 2024-09-15T22:35:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.656+0000 7f5f9be00640 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab73c490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009ca0 tx=0x7f5f94009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963264913409ec2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.656+0000 7f5f90c00640 1 -- 172.21.15.22:0/4069527150 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94031710 con 0x55beab73c090 2024-09-15T22:35:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.656+0000 7f5f93e00640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5f800a3370 0x7f5f800a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.656+0000 7f5f90c00640 1 -- 172.21.15.22:0/4069527150 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f94036040 con 0x55beab73c090 2024-09-15T22:35:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.656+0000 7f5f90c00640 1 -- 172.21.15.22:0/4069527150 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9402f610 con 0x55beab73c090 2024-09-15T22:35:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.657+0000 7f5f93e00640 1 -- 172.21.15.22:0/195316728 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5f8c0cfe50 con 0x7f5f9c074c50 2024-09-15T22:35:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.657+0000 7f5f9b400640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5f800a3370 0x7f5f800a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.657+0000 7f5fa55cc740 1 -- 172.21.15.22:0/4069527150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 msgr2=0x55beab73c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.657+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab73c490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009ca0 tx=0x7f5f94009800 comp rx=0 tx=0).stop 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.658+0000 7f5fa55cc740 1 -- 172.21.15.22:0/4069527150 shutdown_connections 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.658+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab741a60 0x55beab743f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.658+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab741490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.658+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/4069527150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab73c490 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.658+0000 7f5fa55cc740 1 -- 172.21.15.22:0/4069527150 >> 172.21.15.22:0/4069527150 conn(0x55beab737700 msgr2=0x55beab737b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.660+0000 7f5f9b400640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5f800a3370 0x7f5f800a5830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c6a0 tx=0x7f5f8c00ef90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.660+0000 7f5fa55cc740 1 -- 172.21.15.22:0/4069527150 shutdown_connections 2024-09-15T22:35:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.660+0000 7f5fa55cc740 1 -- 172.21.15.22:0/4069527150 wait complete. 2024-09-15T22:35:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.660+0000 7f5fa55cc740 1 -- start start 2024-09-15T22:35:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.660+0000 7f5fa55cc740 1 Processor -- start 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab7462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab7467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab74d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55beab7449d0 con 0x55beab73c090 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beab62a090 con 0x55beab741a60 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55beab744b50 con 0x55beab73c9d0 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5fa55cc740 10 client.0 _ll_register_callbacks cb 0x55beab67ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5f9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab7462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5f9aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab7467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5f9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab7462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47394/0 (socket says 172.21.15.22:47394) 2024-09-15T22:35:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.661+0000 7f5f9be00640 1 -- 172.21.15.22:0/670750931 learned_addr learned my addr 172.21.15.22:0/670750931 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9aa00640 1 -- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 msgr2=0x55beab74d820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab74d820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9aa00640 1 -- 172.21.15.22:0/670750931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 msgr2=0x55beab7462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab7462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9aa00640 1 -- 172.21.15.22:0/670750931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beab480620 con 0x55beab73c9d0 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9be00640 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab7462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:35:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab7467e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c19f8d0 tx=0x7f5f88010680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6f75e1558bdf26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f85600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.662+0000 7f5f85600640 1 -- 172.21.15.22:0/670750931 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88018070 con 0x55beab73c9d0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5f85600640 1 -- 172.21.15.22:0/670750931 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5f88014800 con 0x55beab73c9d0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f94036040 con 0x55beab73c9d0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5f85600640 1 -- 172.21.15.22:0/670750931 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5f88022050 con 0x55beab73c9d0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5fa55cc740 10 client.25279 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55beab7506e0 con 0x55beab73c9d0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5f85600640 1 -- 172.21.15.22:0/670750931 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f94036040 con 0x55beab73c9d0 2024-09-15T22:35:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.663+0000 7f5f85600640 1 -- 172.21.15.22:0/670750931 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5f8801daa0 con 0x55beab73c9d0 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5fa55cc740 10 client.25279 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5fa55cc740 10 client.25279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5fa55cc740 20 client.25279 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab751e20 0x55beab7542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5fa55cc740 4 client.25279 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beab6ae830 con 0x55beab751e20 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.664+0000 7f5f9be00640 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab751e20 0x55beab7542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.665+0000 7f5f9be00640 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab751e20 0x55beab7542a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9668777aef8ae1e server_cookie=c620f93c25151b10 in_seq=0 out_seq=0 2024-09-15T22:35:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.665+0000 7f5f85600640 10 client.25279 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.665+0000 7f5f85600640 1 -- 172.21.15.22:0/670750931 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55beab6ae830 con 0x55beab751e20 2024-09-15T22:35:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.665+0000 7f5f85600640 10 client.25279 handle_command_reply: tid=0 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.665+0000 7f5fa55cc740 1 client.25279 shutdown 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 msgr2=0x55beab7467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab7467e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c19f8d0 tx=0x7f5f88010680 comp rx=0 tx=0).stop 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 shutdown_connections 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab751e20 0x55beab7542a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab7467e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab74d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5f85600640 0 client.25279 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/670750931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab7462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 >> 172.21.15.22:0/670750931 conn(0x55beab737700 msgr2=0x55beab738f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 shutdown_connections 2024-09-15T22:35:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.666+0000 7f5fa55cc740 1 -- 172.21.15.22:0/670750931 wait complete. 2024-09-15T22:35:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.667+0000 7f5fa55cc740 20 client.25279 trim_cache size 0 max 16384 2024-09-15T22:35:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.698+0000 7f5fa55cc740 1 Processor -- start 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.698+0000 7f5fa55cc740 1 -- start start 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab738580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab74d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab738ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b2020 con 0x55beab73c090 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1af8f0 con 0x55beab741a60 2024-09-15T22:35:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1ad720 con 0x55beab73c9d0 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5f9aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab74d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5f9aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab74d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:56248/0 (socket says 172.21.15.22:56248) 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5f9be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab738580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5f9aa00640 1 -- 172.21.15.22:0/1615764537 learned_addr learned my addr 172.21.15.22:0/1615764537 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.699+0000 7f5f9be00640 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab738ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9aa00640 1 -- 172.21.15.22:0/1615764537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 msgr2=0x55beab738ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab738ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9aa00640 1 -- 172.21.15.22:0/1615764537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 msgr2=0x55beab738580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab738580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9aa00640 1 -- 172.21.15.22:0/1615764537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beab737520 con 0x55beab73c9d0 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9be00640 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab738ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.700+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab74d7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f88001eb0 tx=0x7f5f88009c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff59552e866d84a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.701+0000 7f5f87e00640 1 -- 172.21.15.22:0/1615764537 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88018040 con 0x55beab73c9d0 2024-09-15T22:35:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.701+0000 7f5f87e00640 1 -- 172.21.15.22:0/1615764537 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8801c720 con 0x55beab73c9d0 2024-09-15T22:35:11.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.701+0000 7f5f87e00640 1 -- 172.21.15.22:0/1615764537 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800f040 con 0x55beab73c9d0 2024-09-15T22:35:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:11 smithi110 ceph-mon[35282]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 260 MiB/s wr, 831 op/s 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 -- 172.21.15.22:0/1615764537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 msgr2=0x55beab74d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab74d7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f88001eb0 tx=0x7f5f88009c10 comp rx=0 tx=0).stop 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 -- 172.21.15.22:0/1615764537 shutdown_connections 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c9d0 0x55beab74d7e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab741a60 0x55beab738ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/1615764537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab73c090 0x55beab738580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 -- 172.21.15.22:0/1615764537 >> 172.21.15.22:0/1615764537 conn(0x55beab737700 msgr2=0x55beab7462a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.706+0000 7f5fa55cc740 1 -- 172.21.15.22:0/1615764537 shutdown_connections 2024-09-15T22:35:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.707+0000 7f5fa55cc740 1 -- 172.21.15.22:0/1615764537 wait complete. 2024-09-15T22:35:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.707+0000 7f5fa55cc740 1 -- start start 2024-09-15T22:35:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.708+0000 7f5fa55cc740 1 Processor -- start 2024-09-15T22:35:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c090 0x55beab74abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab74b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab741a60 0x55beab74c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1addb0 con 0x55beab741a60 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1af220 con 0x55beab73c9d0 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1ae480 con 0x55beab73c090 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5fa55cc740 10 client.0 _ll_register_callbacks cb 0x7f5f880093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab74b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab74b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59136/0 (socket says 172.21.15.22:59136) 2024-09-15T22:35:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 -- 172.21.15.22:0/769594383 learned_addr learned my addr 172.21.15.22:0/769594383 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9be00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c090 0x55beab74abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9be00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab741a60 0x55beab74c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 -- 172.21.15.22:0/769594383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c090 msgr2=0x55beab74abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c090 0x55beab74abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 -- 172.21.15.22:0/769594383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab741a60 msgr2=0x55beab74c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab741a60 0x55beab74c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.709+0000 7f5f9aa00640 1 -- 172.21.15.22:0/769594383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beab74c6c0 con 0x55beab73c9d0 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.710+0000 7f5f9be00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab741a60 0x55beab74c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.710+0000 7f5f9aa00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab74b0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f88010d00 tx=0x7f5f88014600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=457d7d48cd639e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.710+0000 7f5f85600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.710+0000 7f5f85600640 1 -- 172.21.15.22:0/769594383 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88035070 con 0x55beab73c9d0 2024-09-15T22:35:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.710+0000 7f5f85600640 1 -- 172.21.15.22:0/769594383 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5f8801cbd0 con 0x55beab73c9d0 2024-09-15T22:35:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.710+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f8801c720 con 0x55beab73c9d0 2024-09-15T22:35:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5f85600640 1 -- 172.21.15.22:0/769594383 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5f8803f050 con 0x55beab73c9d0 2024-09-15T22:35:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 10 client.25271 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55beab74d9d0 con 0x55beab73c9d0 2024-09-15T22:35:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5f85600640 1 -- 172.21.15.22:0/769594383 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8801c720 con 0x55beab73c9d0 2024-09-15T22:35:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5f85600640 1 -- 172.21.15.22:0/769594383 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5f8803a4d0 con 0x55beab73c9d0 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 10 client.25271 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 10 client.25271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 20 client.25271 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab7bd1f0 0x55beab7bf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 4 client.25271 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.711+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55beab6a8b80 con 0x55beab7bd1f0 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.712+0000 7f5f9be00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab7bd1f0 0x55beab7bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.712+0000 7f5f9be00640 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab7bd1f0 0x55beab7bf610 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e05e4dc51f8ec0 server_cookie=3c96fdb9c77c4737 in_seq=0 out_seq=0 2024-09-15T22:35:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.712+0000 7f5f85600640 10 client.25271 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:11.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5f85600640 1 -- 172.21.15.22:0/769594383 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55beab6a8b80 con 0x55beab7bd1f0 2024-09-15T22:35:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5f85600640 10 client.25271 handle_command_reply: tid=0 2024-09-15T22:35:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 client.25271 shutdown 2024-09-15T22:35:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 msgr2=0x55beab74b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab74b0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f88010d00 tx=0x7f5f88014600 comp rx=0 tx=0).stop 2024-09-15T22:35:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 shutdown_connections 2024-09-15T22:35:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55beab7bd1f0 0x55beab7bf610 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5f85600640 0 client.25271 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55beab741a60 0x55beab74c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beab73c9d0 0x55beab74b0f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 --2- 172.21.15.22:0/769594383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55beab73c090 0x55beab74abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.727+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 >> 172.21.15.22:0/769594383 conn(0x55beab737700 msgr2=0x55beab736060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.728+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 shutdown_connections 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.728+0000 7f5fa55cc740 1 -- 172.21.15.22:0/769594383 wait complete. 2024-09-15T22:35:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.728+0000 7f5fa55cc740 20 client.25271 trim_cache size 0 max 16384 2024-09-15T22:35:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:35:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:35:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:35:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:35:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5f800a3370 msgr2=0x7f5f800a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5f800a3370 0x7f5f800a5830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c6a0 tx=0x7f5f8c00ef90 comp rx=0 tx=0).stop 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 msgr2=0x7f5f9c19e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00ea60 tx=0x7f5f8c00ee60 comp rx=0 tx=0).stop 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 shutdown_connections 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5f800a3370 0x7f5f800a5830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c1099d0 0x7f5f9c1a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f9c076230 0x7f5f9c19e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 --2- 172.21.15.22:0/195316728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e3c0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00ea60 tx=0x7f5f8c00ee60 comp rx=0 tx=0).stop 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.730+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 >> 172.21.15.22:0/195316728 conn(0x7f5f9c0fd2e0 msgr2=0x7f5f9c102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.731+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 shutdown_connections 2024-09-15T22:35:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:11.731+0000 7f5fa2600640 1 -- 172.21.15.22:0/195316728 wait complete. 2024-09-15T22:35:11.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:11 smithi022 ceph-mon[30634]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 260 MiB/s wr, 831 op/s 2024-09-15T22:35:11.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:11 smithi112 ceph-mon[35032]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 260 MiB/s wr, 831 op/s 2024-09-15T22:35:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:13 smithi110 ceph-mon[35282]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 281 MiB/s wr, 909 op/s 2024-09-15T22:35:13.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:13 smithi022 ceph-mon[30634]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 281 MiB/s wr, 909 op/s 2024-09-15T22:35:13.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:13 smithi112 ceph-mon[35032]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 281 MiB/s wr, 909 op/s 2024-09-15T22:35:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:15 smithi110 ceph-mon[35282]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 273 MiB/s wr, 884 op/s 2024-09-15T22:35:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:15 smithi022 ceph-mon[30634]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 273 MiB/s wr, 884 op/s 2024-09-15T22:35:15.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:15 smithi112 ceph-mon[35032]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 273 MiB/s wr, 884 op/s 2024-09-15T22:35:17.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:17 smithi110 ceph-mon[35282]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 267 MiB/s wr, 882 op/s 2024-09-15T22:35:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:17 smithi022 ceph-mon[30634]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 267 MiB/s wr, 882 op/s 2024-09-15T22:35:17.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:17 smithi112 ceph-mon[35032]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 267 MiB/s wr, 882 op/s 2024-09-15T22:35:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:19 smithi110 ceph-mon[35282]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 283 MiB/s wr, 950 op/s 2024-09-15T22:35:19.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:19 smithi022 ceph-mon[30634]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 283 MiB/s wr, 950 op/s 2024-09-15T22:35:19.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:19 smithi112 ceph-mon[35032]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 283 MiB/s wr, 950 op/s 2024-09-15T22:35:21.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:21 smithi110 ceph-mon[35282]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 872 op/s 2024-09-15T22:35:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:21 smithi022 ceph-mon[30634]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 872 op/s 2024-09-15T22:35:21.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:21 smithi112 ceph-mon[35032]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 872 op/s 2024-09-15T22:35:23.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:23 smithi110 ceph-mon[35282]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 273 MiB/s wr, 920 op/s 2024-09-15T22:35:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:23 smithi022 ceph-mon[30634]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 273 MiB/s wr, 920 op/s 2024-09-15T22:35:23.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:23 smithi112 ceph-mon[35032]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 273 MiB/s wr, 920 op/s 2024-09-15T22:35:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 -- 172.21.15.22:0/1928318759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8103b70 msgr2=0x7ff4f8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 --2- 172.21.15.22:0/1928318759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8103b70 0x7ff4f8103f70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009900 tx=0x7ff4e402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 -- 172.21.15.22:0/1928318759 shutdown_connections 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 --2- 172.21.15.22:0/1928318759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8105720 0x7ff4f810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 --2- 172.21.15.22:0/1928318759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8104d60 0x7ff4f81051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 --2- 172.21.15.22:0/1928318759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8103b70 0x7ff4f8103f70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 -- 172.21.15.22:0/1928318759 >> 172.21.15.22:0/1928318759 conn(0x7ff4f80ff2f0 msgr2=0x7ff4f8101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.925+0000 7ff4fd000640 1 -- 172.21.15.22:0/1928318759 shutdown_connections 2024-09-15T22:35:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.926+0000 7ff4fd000640 1 -- 172.21.15.22:0/1928318759 wait complete. 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.926+0000 7ff4fd000640 1 Processor -- start 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 -- start start 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8103b70 0x7ff4f8195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8104d60 0x7ff4f8195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 0x7ff4f819d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f8079260 con 0x7ff4f8103b70 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f80790e0 con 0x7ff4f8105720 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4fd000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f80793e0 con 0x7ff4f8104d60 2024-09-15T22:35:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8103b70 0x7ff4f8195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4f7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 0x7ff4f819d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4f7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 0x7ff4f819d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56822/0 (socket says 172.21.15.22:56822) 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8103b70 0x7ff4f8195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39472/0 (socket says 172.21.15.22:39472) 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.927+0000 7ff4f7e00640 1 -- 172.21.15.22:0/3458408856 learned_addr learned my addr 172.21.15.22:0/3458408856 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4f7e00640 1 -- 172.21.15.22:0/3458408856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8104d60 msgr2=0x7ff4f8195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8104d60 0x7ff4f8195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4f7e00640 1 -- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8103b70 msgr2=0x7ff4f8195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8103b70 0x7ff4f8195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4f7e00640 1 -- 172.21.15.22:0/3458408856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f819d6a0 con 0x7ff4f8105720 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 0x7ff4f819d030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00153d0 tx=0x7ff4f0015890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4efe00640 1 -- 172.21.15.22:0/3458408856 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0004d20 con 0x7ff4f8105720 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4efe00640 1 -- 172.21.15.22:0/3458408856 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4f001aa40 con 0x7ff4f8105720 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4efe00640 1 -- 172.21.15.22:0/3458408856 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0005610 con 0x7ff4f8105720 2024-09-15T22:35:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.928+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f819d990 con 0x7ff4f8105720 2024-09-15T22:35:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.929+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f819de90 con 0x7ff4f8105720 2024-09-15T22:35:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff4efe00640 1 -- 172.21.15.22:0/3458408856 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff4f001abf0 con 0x7ff4f8105720 2024-09-15T22:35:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 Processor -- start 2024-09-15T22:35:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 -- start start 2024-09-15T22:35:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbdfd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 0x5605cbe02660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbe02c30 0x5605cbe050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605cbd62100 con 0x5605cbe02c30 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5605cbd0a1b0 con 0x5605cbdfd260 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.932+0000 7ff501486740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5605cbd5e0c0 con 0x5605cbdfdba0 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 0x5605cbe02660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 0x5605cbe02660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43934/0 (socket says 172.21.15.22:43934) 2024-09-15T22:35:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 -- 172.21.15.22:0/3233842763 learned_addr learned my addr 172.21.15.22:0/3233842763 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f6a00640 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbdfd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 -- 172.21.15.22:0/3233842763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 msgr2=0x5605cbdfd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbdfd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 -- 172.21.15.22:0/3233842763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbe02c30 msgr2=0x5605cbe050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbe02c30 0x5605cbe050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.933+0000 7ff4f7400640 1 -- 172.21.15.22:0/3233842763 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605cba75210 con 0x5605cbdfdba0 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.934+0000 7ff4efe00640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4dc0a3240 0x7ff4dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.934+0000 7ff4f7400640 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 0x5605cbe02660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4031610 tx=0x7ff4e4032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9597762bbf6a4df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.934+0000 7ff4efe00640 1 -- 172.21.15.22:0/3458408856 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff4f00d7b10 con 0x7ff4f8105720 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.935+0000 7ff4ecc00640 1 -- 172.21.15.22:0/3233842763 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4040070 con 0x5605cbdfdba0 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.935+0000 7ff4ecc00640 1 -- 172.21.15.22:0/3233842763 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4e4032e20 con 0x5605cbdfdba0 2024-09-15T22:35:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.935+0000 7ff4ecc00640 1 -- 172.21.15.22:0/3233842763 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4035040 con 0x5605cbdfdba0 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.935+0000 7ff4f6a00640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4dc0a3240 0x7ff4dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 -- 172.21.15.22:0/3233842763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 msgr2=0x5605cbe02660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 0x5605cbe02660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4031610 tx=0x7ff4e4032c30 comp rx=0 tx=0).stop 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 -- 172.21.15.22:0/3233842763 shutdown_connections 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdfdba0 0x5605cbe02660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbe02c30 0x5605cbe050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 --2- 172.21.15.22:0/3233842763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbdfd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.936+0000 7ff501486740 1 -- 172.21.15.22:0/3233842763 >> 172.21.15.22:0/3233842763 conn(0x5605cbdf88d0 msgr2=0x5605cbdf8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.937+0000 7ff501486740 1 -- 172.21.15.22:0/3233842763 shutdown_connections 2024-09-15T22:35:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.937+0000 7ff501486740 1 -- 172.21.15.22:0/3233842763 wait complete. 2024-09-15T22:35:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.937+0000 7ff4f6a00640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4dc0a3240 0x7ff4dc0a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8005d00 tx=0x7ff4e8009390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.937+0000 7ff501486740 1 -- start start 2024-09-15T22:35:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.938+0000 7ff501486740 1 Processor -- start 2024-09-15T22:35:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.938+0000 7ff501486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfd260 0x5605cbe07440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.938+0000 7ff501486740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfdba0 0x5605cbe07980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.938+0000 7ff501486740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 0x5605cbe0e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff501486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605cbe05ba0 con 0x5605cbdfd260 2024-09-15T22:35:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff501486740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5605cbceb090 con 0x5605cbdfdba0 2024-09-15T22:35:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff501486740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5605cbe05d20 con 0x5605cbe02c30 2024-09-15T22:35:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff501486740 10 client.0 _ll_register_callbacks cb 0x5605cbd3ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfdba0 0x5605cbe07980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 0x5605cbe0e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 0x5605cbe0e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43946/0 (socket says 172.21.15.22:43946) 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfd260 0x5605cbe07440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 -- 172.21.15.22:0/614646260 learned_addr learned my addr 172.21.15.22:0/614646260 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 -- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfdba0 msgr2=0x5605cbe07980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfdba0 0x5605cbe07980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 -- 172.21.15.22:0/614646260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfd260 msgr2=0x5605cbe07440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfd260 0x5605cbe07440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7e00640 1 -- 172.21.15.22:0/614646260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605cbb41620 con 0x5605cbe02c30 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.939+0000 7ff4f7400640 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfd260 0x5605cbe07440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 0x5605cbe0e9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00a0550 tx=0x7ff4f00a3b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23c2020e1d226a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff4e1600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff4e1600640 1 -- 172.21.15.22:0/614646260 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00acd60 con 0x5605cbe02c30 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e4032e20 con 0x5605cbe02c30 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff4e1600640 1 -- 172.21.15.22:0/614646260 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff4f00a8120 con 0x5605cbe02c30 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff4e1600640 1 -- 172.21.15.22:0/614646260 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4f00a0760 con 0x5605cbe02c30 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff501486740 10 client.25294 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.940+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605cbe118d0 con 0x5605cbe02c30 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff4e1600640 1 -- 172.21.15.22:0/614646260 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4e4032e20 con 0x5605cbe02c30 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff4e1600640 1 -- 172.21.15.22:0/614646260 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4f00be070 con 0x5605cbe02c30 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff501486740 10 client.25294 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff501486740 10 client.25294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff501486740 20 client.25294 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff501486740 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe12f50 0x5605cbe15380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff501486740 4 client.25294 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605cbd6f830 con 0x5605cbe12f50 2024-09-15T22:35:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.941+0000 7ff4f7400640 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe12f50 0x5605cbe15380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.943+0000 7ff4e1600640 10 client.25294 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.943+0000 7ff4f7400640 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe12f50 0x5605cbe15380 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a50e34d3fb2677c7 server_cookie=7cebe77c53a767df in_seq=0 out_seq=0 2024-09-15T22:35:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff4e1600640 1 -- 172.21.15.22:0/614646260 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605cbd6f830 con 0x5605cbe12f50 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff4e1600640 10 client.25294 handle_command_reply: tid=0 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 client.25294 shutdown 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 msgr2=0x5605cbe0e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 0x5605cbe0e9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00a0550 tx=0x7ff4f00a3b20 comp rx=0 tx=0).stop 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 shutdown_connections 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe12f50 0x5605cbe15380 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbe02c30 0x5605cbe0e9c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfdba0 0x5605cbe07980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 --2- 172.21.15.22:0/614646260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfd260 0x5605cbe07440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff4e1600640 0 client.25294 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 >> 172.21.15.22:0/614646260 conn(0x5605cbdf88d0 msgr2=0x5605cbdfa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 shutdown_connections 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 1 -- 172.21.15.22:0/614646260 wait complete. 2024-09-15T22:35:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.944+0000 7ff501486740 20 client.25294 trim_cache size 0 max 16384 2024-09-15T22:35:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.966+0000 7ff501486740 1 Processor -- start 2024-09-15T22:35:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.966+0000 7ff501486740 1 -- start start 2024-09-15T22:35:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.967+0000 7ff501486740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbdfd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.967+0000 7ff501486740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.967+0000 7ff501486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbdf9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.967+0000 7ff501486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81a95a0 con 0x5605cbdfdba0 2024-09-15T22:35:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.967+0000 7ff501486740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81a6e70 con 0x5605cbdfd260 2024-09-15T22:35:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.967+0000 7ff501486740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81a4ca0 con 0x5605cbdf88d0 2024-09-15T22:35:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.968+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbdfd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.969+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbdfd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43956/0 (socket says 172.21.15.22:43956) 2024-09-15T22:35:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.969+0000 7ff4f7400640 1 -- 172.21.15.22:0/73089422 learned_addr learned my addr 172.21.15.22:0/73089422 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.969+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbdf9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.969+0000 7ff4f7400640 1 -- 172.21.15.22:0/73089422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 msgr2=0x5605cbe0e980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:35:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.969+0000 7ff4f7400640 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0e980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.969+0000 7ff4f7400640 1 -- 172.21.15.22:0/73089422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 msgr2=0x5605cbdf9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.973+0000 7ff4f7400640 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbdf9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.973+0000 7ff4f7400640 1 -- 172.21.15.22:0/73089422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605cbe05ea0 con 0x5605cbdf88d0 2024-09-15T22:35:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.977+0000 7ff4f7e00640 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbdf9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.977+0000 7ff4f7400640 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbdfd640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4e402a910 tx=0x7ff4e402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4d2b15555bca9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.978+0000 7ff4e3e00640 1 -- 172.21.15.22:0/73089422 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4035040 con 0x5605cbdf88d0 2024-09-15T22:35:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.980+0000 7ff4e3e00640 1 -- 172.21.15.22:0/73089422 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4e404a040 con 0x5605cbdf88d0 2024-09-15T22:35:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.980+0000 7ff4e3e00640 1 -- 172.21.15.22:0/73089422 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4035040 con 0x5605cbdf88d0 2024-09-15T22:35:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.981+0000 7ff501486740 1 -- 172.21.15.22:0/73089422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 msgr2=0x5605cbdfd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.981+0000 7ff501486740 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbdfd640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4e402a910 tx=0x7ff4e402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 -- 172.21.15.22:0/73089422 shutdown_connections 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbdf9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 --2- 172.21.15.22:0/73089422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbdfd640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 -- 172.21.15.22:0/73089422 >> 172.21.15.22:0/73089422 conn(0x5605cbe027c0 msgr2=0x5605cbe07440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 -- 172.21.15.22:0/73089422 shutdown_connections 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.990+0000 7ff501486740 1 -- 172.21.15.22:0/73089422 wait complete. 2024-09-15T22:35:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.991+0000 7ff501486740 1 -- start start 2024-09-15T22:35:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.991+0000 7ff501486740 1 Processor -- start 2024-09-15T22:35:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.993+0000 7ff501486740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbe0b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.993+0000 7ff501486740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.993+0000 7ff501486740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbe7bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff4f6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff4f6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56846/0 (socket says 172.21.15.22:56846) 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff501486740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81a5330 con 0x5605cbdfdba0 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81a67a0 con 0x5605cbdfd260 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81a5a00 con 0x5605cbdf88d0 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff501486740 10 client.0 _ll_register_callbacks cb 0x7ff4f0004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.994+0000 7ff4f6a00640 1 -- 172.21.15.22:0/3084837857 learned_addr learned my addr 172.21.15.22:0/3084837857 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4f6a00640 1 -- 172.21.15.22:0/3084837857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 msgr2=0x5605cbe0b6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4f6a00640 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbe0b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4f6a00640 1 -- 172.21.15.22:0/3084837857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 msgr2=0x5605cbe7bc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:35:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4f6a00640 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbe7bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4f6a00640 1 -- 172.21.15.22:0/3084837857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605cbe0c280 con 0x5605cbdfd260 2024-09-15T22:35:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4f6a00640 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0bc10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80038a0 tx=0x7ff4e8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1793b9afe8b916b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.996+0000 7ff4e1600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:35:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.997+0000 7ff4e1600640 1 -- 172.21.15.22:0/3084837857 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8016070 con 0x5605cbdfd260 2024-09-15T22:35:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.998+0000 7ff4e1600640 1 -- 172.21.15.22:0/3084837857 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff4e801eb40 con 0x5605cbdfd260 2024-09-15T22:35:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.998+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e404a040 con 0x5605cbdfd260 2024-09-15T22:35:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.998+0000 7ff4e1600640 1 -- 172.21.15.22:0/3084837857 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4e801ed40 con 0x5605cbdfd260 2024-09-15T22:35:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.999+0000 7ff501486740 10 client.25283 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:24.999+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605cbe8e3b0 con 0x5605cbdfd260 2024-09-15T22:35:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.000+0000 7ff4e1600640 1 -- 172.21.15.22:0/3084837857 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4e404a040 con 0x5605cbdfd260 2024-09-15T22:35:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.000+0000 7ff4e1600640 1 -- 172.21.15.22:0/3084837857 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4e8025070 con 0x5605cbdfd260 2024-09-15T22:35:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.001+0000 7ff501486740 10 client.25283 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.001+0000 7ff501486740 10 client.25283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.001+0000 7ff501486740 20 client.25283 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.001+0000 7ff501486740 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe02c30 0x5605cbe90db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.001+0000 7ff501486740 4 client.25283 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:35:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.001+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605cbd69b80 con 0x5605cbe02c30 2024-09-15T22:35:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.002+0000 7ff4f7400640 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe02c30 0x5605cbe90db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.011+0000 7ff4f7400640 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe02c30 0x5605cbe90db0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37929df297357be6 server_cookie=5dadbe39fc921174 in_seq=0 out_seq=0 2024-09-15T22:35:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.011+0000 7ff4e1600640 10 client.25283 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.046+0000 7ff4e1600640 1 -- 172.21.15.22:0/3084837857 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5605cbd69b80 con 0x5605cbe02c30 2024-09-15T22:35:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.046+0000 7ff4e1600640 10 client.25283 handle_command_reply: tid=0 2024-09-15T22:35:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.047+0000 7ff501486740 1 client.25283 shutdown 2024-09-15T22:35:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.050+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 msgr2=0x5605cbe0bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.050+0000 7ff501486740 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0bc10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80038a0 tx=0x7ff4e8005f90 comp rx=0 tx=0).stop 2024-09-15T22:35:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 shutdown_connections 2024-09-15T22:35:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff501486740 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5605cbe02c30 0x5605cbe90db0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff4e1600640 0 client.25283 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff501486740 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605cbdfdba0 0x5605cbe7bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff501486740 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605cbdfd260 0x5605cbe0bc10 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80038a0 tx=0x7ff4e8005f90 comp rx=0 tx=0).stop 2024-09-15T22:35:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff501486740 1 --2- 172.21.15.22:0/3084837857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5605cbdf88d0 0x5605cbe0b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.052+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 >> 172.21.15.22:0/3084837857 conn(0x5605cbe027c0 msgr2=0x5605cbdf71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.053+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 shutdown_connections 2024-09-15T22:35:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.055+0000 7ff501486740 1 -- 172.21.15.22:0/3084837857 wait complete. 2024-09-15T22:35:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.055+0000 7ff501486740 20 client.25283 trim_cache size 0 max 16384 2024-09-15T22:35:25.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:35:25.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:35:25.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:35:25.058 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:35:25.059 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.057+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4dc0a3240 msgr2=0x7ff4dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.057+0000 7ff4fd000640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4dc0a3240 0x7ff4dc0a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8005d00 tx=0x7ff4e8009390 comp rx=0 tx=0).stop 2024-09-15T22:35:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.057+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 msgr2=0x7ff4f819d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.057+0000 7ff4fd000640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 0x7ff4f819d030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00153d0 tx=0x7ff4f0015890 comp rx=0 tx=0).stop 2024-09-15T22:35:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.059+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 shutdown_connections 2024-09-15T22:35:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.059+0000 7ff4fd000640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f8104d60 0x7ff4f8195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.059+0000 7ff4fd000640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4dc0a3240 0x7ff4dc0a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.059+0000 7ff4fd000640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f8105720 0x7ff4f819d030 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.059+0000 7ff4fd000640 1 --2- 172.21.15.22:0/3458408856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4f8103b70 0x7ff4f8195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.059+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 >> 172.21.15.22:0/3458408856 conn(0x7ff4f80ff2f0 msgr2=0x7ff4f80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.062+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 shutdown_connections 2024-09-15T22:35:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:25.064+0000 7ff4fd000640 1 -- 172.21.15.22:0/3458408856 wait complete. 2024-09-15T22:35:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:25 smithi110 ceph-mon[35282]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 267 MiB/s wr, 902 op/s 2024-09-15T22:35:25.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:25 smithi022 ceph-mon[30634]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 267 MiB/s wr, 902 op/s 2024-09-15T22:35:25.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:25 smithi112 ceph-mon[35032]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 267 MiB/s wr, 902 op/s 2024-09-15T22:35:27.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:27 smithi022 ceph-mon[30634]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 884 op/s 2024-09-15T22:35:27.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:27 smithi112 ceph-mon[35032]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 884 op/s 2024-09-15T22:35:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:27 smithi110 ceph-mon[35282]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 884 op/s 2024-09-15T22:35:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:29 smithi022 ceph-mon[30634]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 936 op/s 2024-09-15T22:35:29.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:29 smithi112 ceph-mon[35032]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 936 op/s 2024-09-15T22:35:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:29 smithi110 ceph-mon[35282]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 936 op/s 2024-09-15T22:35:31.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:31 smithi022 ceph-mon[30634]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 847 op/s 2024-09-15T22:35:31.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:31 smithi112 ceph-mon[35032]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 847 op/s 2024-09-15T22:35:31.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:31 smithi110 ceph-mon[35282]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 847 op/s 2024-09-15T22:35:33.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:33 smithi022 ceph-mon[30634]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 908 op/s 2024-09-15T22:35:33.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:33 smithi112 ceph-mon[35032]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 908 op/s 2024-09-15T22:35:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:33 smithi110 ceph-mon[35282]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 908 op/s 2024-09-15T22:35:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:35 smithi022 ceph-mon[30634]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 264 MiB/s wr, 878 op/s 2024-09-15T22:35:35.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:35 smithi112 ceph-mon[35032]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 264 MiB/s wr, 878 op/s 2024-09-15T22:35:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:35 smithi110 ceph-mon[35282]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 264 MiB/s wr, 878 op/s 2024-09-15T22:35:37.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:37 smithi112 ceph-mon[35032]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 847 op/s 2024-09-15T22:35:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:37 smithi110 ceph-mon[35282]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 847 op/s 2024-09-15T22:35:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:37 smithi022 ceph-mon[30634]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 847 op/s 2024-09-15T22:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.219+0000 7f7089200640 1 -- 172.21.15.22:0/2529194089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 msgr2=0x7f70841070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.219+0000 7f7089200640 1 --2- 172.21.15.22:0/2529194089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70841070e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7070009900 tx=0x7f707002a400 comp rx=0 tx=0).stop 2024-09-15T22:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 -- 172.21.15.22:0/2529194089 shutdown_connections 2024-09-15T22:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 --2- 172.21.15.22:0/2529194089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7084107620 0x7f7084109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 --2- 172.21.15.22:0/2529194089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70841070e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 --2- 172.21.15.22:0/2529194089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70841023c0 0x7f70841047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 -- 172.21.15.22:0/2529194089 >> 172.21.15.22:0/2529194089 conn(0x7f70840fbfa0 msgr2=0x7f70840fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 -- 172.21.15.22:0/2529194089 shutdown_connections 2024-09-15T22:35:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.220+0000 7f7089200640 1 -- 172.21.15.22:0/2529194089 wait complete. 2024-09-15T22:35:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.221+0000 7f7089200640 1 Processor -- start 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.221+0000 7f7089200640 1 -- start start 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7089200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70841023c0 0x7f7084070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7089200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70840710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7089200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084107620 0x7f70841a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7089200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f708410d620 con 0x7f70841023c0 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7089200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f708410d4a0 con 0x7f7084104cf0 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7089200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f708410d7a0 con 0x7f7084107620 2024-09-15T22:35:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7082a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70840710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7082a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70840710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:44544/0 (socket says 172.21.15.22:44544) 2024-09-15T22:35:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7082a00640 1 -- 172.21.15.22:0/2006059037 learned_addr learned my addr 172.21.15.22:0/2006059037 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7083e00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084107620 0x7f70841a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.222+0000 7f7083400640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70841023c0 0x7f7084070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7083e00640 1 -- 172.21.15.22:0/2006059037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 msgr2=0x7f70840710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7083e00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70840710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7083e00640 1 -- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70841023c0 msgr2=0x7f7084070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7083e00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70841023c0 0x7f7084070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7083e00640 1 -- 172.21.15.22:0/2006059037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70841a8270 con 0x7f7084107620 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7082a00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70840710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7083e00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084107620 0x7f70841a7d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f707c005fd0 tx=0x7f707c00b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f707be00640 1 -- 172.21.15.22:0/2006059037 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c01e070 con 0x7f7084107620 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70841001b0 con 0x7f7084107620 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f707be00640 1 -- 172.21.15.22:0/2006059037 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f707c004d20 con 0x7f7084107620 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.223+0000 7f707be00640 1 -- 172.21.15.22:0/2006059037 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c005280 con 0x7f7084107620 2024-09-15T22:35:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.224+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70841006a0 con 0x7f7084107620 2024-09-15T22:35:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.228+0000 7f708d84a740 1 Processor -- start 2024-09-15T22:35:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.228+0000 7f707be00640 1 -- 172.21.15.22:0/2006059037 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f707c005420 con 0x7f7084107620 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 -- start start 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df71660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df76660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df76c30 0x56441df790f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56441ded6100 con 0x56441df71260 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56441de7e1b0 con 0x56441df71ba0 2024-09-15T22:35:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.229+0000 7f708d84a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56441ded20c0 con 0x56441df76c30 2024-09-15T22:35:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.230+0000 7f7083400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df76660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.230+0000 7f7083400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df76660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:44560/0 (socket says 172.21.15.22:44560) 2024-09-15T22:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.230+0000 7f7082a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df71660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f707be00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70680a3280 0x7f70680a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7082a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df71660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52124/0 (socket says 172.21.15.22:52124) 2024-09-15T22:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7082a00640 1 -- 172.21.15.22:0/2732614886 learned_addr learned my addr 172.21.15.22:0/2732614886 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f707be00640 1 -- 172.21.15.22:0/2006059037 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f707c0d7f50 con 0x7f7084107620 2024-09-15T22:35:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7083400640 1 -- 172.21.15.22:0/2732614886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df76c30 msgr2=0x56441df790f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7083400640 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df76c30 0x56441df790f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7083400640 1 -- 172.21.15.22:0/2732614886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 msgr2=0x56441df71660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7083400640 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df71660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.231+0000 7f7083400640 1 -- 172.21.15.22:0/2732614886 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56441dbe9210 con 0x56441df71ba0 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.232+0000 7f7083e00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70680a3280 0x7f70680a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.232+0000 7f7083400640 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df76660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7074009c20 tx=0x7f7074011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54bfa798122a9777 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.232+0000 7f7078c00640 1 -- 172.21.15.22:0/2732614886 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074009dd0 con 0x56441df71ba0 2024-09-15T22:35:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.233+0000 7f7078c00640 1 -- 172.21.15.22:0/2732614886 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7074005020 con 0x56441df71ba0 2024-09-15T22:35:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.233+0000 7f7078c00640 1 -- 172.21.15.22:0/2732614886 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074009dd0 con 0x56441df71ba0 2024-09-15T22:35:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f7083e00640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70680a3280 0x7f70680a5740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f707c0a0ff0 tx=0x7f707c009eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 -- 172.21.15.22:0/2732614886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 msgr2=0x56441df76660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df76660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7074009c20 tx=0x7f7074011810 comp rx=0 tx=0).stop 2024-09-15T22:35:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 -- 172.21.15.22:0/2732614886 shutdown_connections 2024-09-15T22:35:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df76c30 0x56441df790f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df76660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 --2- 172.21.15.22:0/2732614886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df71660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 -- 172.21.15.22:0/2732614886 >> 172.21.15.22:0/2732614886 conn(0x56441df6c8d0 msgr2=0x56441df6ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.234+0000 7f708d84a740 1 -- 172.21.15.22:0/2732614886 shutdown_connections 2024-09-15T22:35:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.235+0000 7f708d84a740 1 -- 172.21.15.22:0/2732614886 wait complete. 2024-09-15T22:35:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.235+0000 7f708d84a740 1 -- start start 2024-09-15T22:35:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.236+0000 7f708d84a740 1 Processor -- start 2024-09-15T22:35:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.236+0000 7f708d84a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 0x56441df7b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 0x56441df7b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 0x56441df7b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:44564/0 (socket says 172.21.15.22:44564) 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 -- 172.21.15.22:0/2268539404 learned_addr learned my addr 172.21.15.22:0/2268539404 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df71ba0 0x56441df7b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df76c30 0x56441df82960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56441df79c00 con 0x56441df76c30 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56441de5f090 con 0x56441df71260 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56441df79d80 con 0x56441df71ba0 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 -- 172.21.15.22:0/2268539404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df71ba0 msgr2=0x56441df7b920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df71ba0 0x56441df7b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 -- 172.21.15.22:0/2268539404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df76c30 msgr2=0x56441df82960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df76c30 0x56441df82960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f7082a00640 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56441dcb5620 con 0x56441df71260 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.237+0000 7f708d84a740 10 client.0 _ll_register_callbacks cb 0x56441deb3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.238+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7074005020 con 0x56441df71260 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.238+0000 7f7082a00640 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 0x56441df7b3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7070005e60 tx=0x7f7070031a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61d0818df8d63c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.238+0000 7f706d600640 10 client.25295 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.238+0000 7f706d600640 1 -- 172.21.15.22:0/2268539404 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070035040 con 0x56441df71260 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.238+0000 7f706d600640 1 -- 172.21.15.22:0/2268539404 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f7070005030 con 0x56441df71260 2024-09-15T22:35:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.239+0000 7f706d600640 1 -- 172.21.15.22:0/2268539404 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7070005230 con 0x56441df71260 2024-09-15T22:35:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.243+0000 7f708d84a740 10 client.25295 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.243+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({fsmap=25}) -- 0x56441df85690 con 0x56441df71260 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f706d600640 1 -- 172.21.15.22:0/2268539404 <== mon.2 v2:172.21.15.110:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f70700053d0 con 0x56441df71260 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f708d84a740 10 client.25295 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f708d84a740 10 client.25295 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f708d84a740 20 client.25295 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df86cc0 0x56441df89110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f708d84a740 4 client.25295 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.244+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56441dee3830 con 0x56441df86cc0 2024-09-15T22:35:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.245+0000 7f7083400640 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df86cc0 0x56441df89110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.246+0000 7f7083400640 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df86cc0 0x56441df89110 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c2ee14b6315d3f server_cookie=a7c34c6a6e914f8f in_seq=0 out_seq=0 2024-09-15T22:35:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.246+0000 7f706d600640 10 client.25295 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.247+0000 7f706d600640 1 -- 172.21.15.22:0/2268539404 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56441dee3830 con 0x56441df86cc0 2024-09-15T22:35:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.247+0000 7f706d600640 10 client.25295 handle_command_reply: tid=0 2024-09-15T22:35:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 client.25295 shutdown 2024-09-15T22:35:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 msgr2=0x56441df7b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 0x56441df7b3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7070005e60 tx=0x7f7070031a40 comp rx=0 tx=0).stop 2024-09-15T22:35:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 shutdown_connections 2024-09-15T22:35:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df86cc0 0x56441df89110 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df71ba0 0x56441df7b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df76c30 0x56441df82960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 --2- 172.21.15.22:0/2268539404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71260 0x56441df7b3e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 >> 172.21.15.22:0/2268539404 conn(0x56441df6c8d0 msgr2=0x56441df6e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.248+0000 7f706d600640 0 client.25295 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.249+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 shutdown_connections 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.249+0000 7f708d84a740 1 -- 172.21.15.22:0/2268539404 wait complete. 2024-09-15T22:35:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.249+0000 7f708d84a740 20 client.25295 trim_cache size 0 max 16384 2024-09-15T22:35:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.277+0000 7f708d84a740 1 Processor -- start 2024-09-15T22:35:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.277+0000 7f708d84a740 1 -- start start 2024-09-15T22:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.278+0000 7f708d84a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df71640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.278+0000 7f708d84a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df82920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.278+0000 7f708d84a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df6d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.278+0000 7f708d84a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70841b1d30 con 0x56441df71260 2024-09-15T22:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.278+0000 7f708d84a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f70841af600 con 0x56441df71ba0 2024-09-15T22:35:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.278+0000 7f708d84a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70841ad430 con 0x56441df6c8d0 2024-09-15T22:35:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.279+0000 7f7083400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df82920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.279+0000 7f7082a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df71640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.280+0000 7f7082a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df6d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.280+0000 7f7083400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df82920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52154/0 (socket says 172.21.15.22:52154) 2024-09-15T22:35:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.280+0000 7f7083400640 1 -- 172.21.15.22:0/1046866596 learned_addr learned my addr 172.21.15.22:0/1046866596 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.281+0000 7f7083400640 1 -- 172.21.15.22:0/1046866596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 msgr2=0x56441df71640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.281+0000 7f7083400640 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df71640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.281+0000 7f7083400640 1 -- 172.21.15.22:0/1046866596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 msgr2=0x56441df6d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.281+0000 7f7083400640 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df6d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.281+0000 7f7083400640 1 -- 172.21.15.22:0/1046866596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56441df6c6f0 con 0x56441df71260 2024-09-15T22:35:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.282+0000 7f7083400640 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df82920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7074014040 tx=0x7f7074000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff6d285cb163ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.282+0000 7f706fe00640 1 -- 172.21.15.22:0/1046866596 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740054e0 con 0x56441df71260 2024-09-15T22:35:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.283+0000 7f706fe00640 1 -- 172.21.15.22:0/1046866596 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7074029070 con 0x56441df71260 2024-09-15T22:35:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.283+0000 7f706fe00640 1 -- 172.21.15.22:0/1046866596 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740035f0 con 0x56441df71260 2024-09-15T22:35:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 -- 172.21.15.22:0/1046866596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 msgr2=0x56441df82920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df82920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7074014040 tx=0x7f7074000bc0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 -- 172.21.15.22:0/1046866596 shutdown_connections 2024-09-15T22:35:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df6d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df82920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 --2- 172.21.15.22:0/1046866596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df71640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.284+0000 7f708d84a740 1 -- 172.21.15.22:0/1046866596 >> 172.21.15.22:0/1046866596 conn(0x56441df76750 msgr2=0x56441df7b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.285+0000 7f708d84a740 1 -- 172.21.15.22:0/1046866596 shutdown_connections 2024-09-15T22:35:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.285+0000 7f708d84a740 1 -- 172.21.15.22:0/1046866596 wait complete. 2024-09-15T22:35:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.285+0000 7f708d84a740 1 -- start start 2024-09-15T22:35:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.285+0000 7f708d84a740 1 Processor -- start 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df7fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df81290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70841adac0 con 0x56441df71260 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f70841aef30 con 0x56441df71ba0 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70841ae190 con 0x56441df6c8d0 2024-09-15T22:35:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.286+0000 7f708d84a740 10 client.0 _ll_register_callbacks cb 0x7f7070009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.287+0000 7f7083400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.287+0000 7f7083400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df802d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52160/0 (socket says 172.21.15.22:52160) 2024-09-15T22:35:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.287+0000 7f7083400640 1 -- 172.21.15.22:0/593908997 learned_addr learned my addr 172.21.15.22:0/593908997 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.287+0000 7f7082a00640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df81290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.287+0000 7f7082a00640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df7fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f7082a00640 1 -- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 msgr2=0x56441df81290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f7082a00640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df81290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f7082a00640 1 -- 172.21.15.22:0/593908997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 msgr2=0x56441df802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f7082a00640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df802d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f7082a00640 1 -- 172.21.15.22:0/593908997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56441df818a0 con 0x56441df6c8d0 2024-09-15T22:35:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f7082a00640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df7fd90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7070032fd0 tx=0x7f707003d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf08442b93495bed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f706d600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:35:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.288+0000 7f706d600640 1 -- 172.21.15.22:0/593908997 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070035030 con 0x56441df6c8d0 2024-09-15T22:35:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.289+0000 7f706d600640 1 -- 172.21.15.22:0/593908997 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f7070004ee0 con 0x56441df6c8d0 2024-09-15T22:35:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.290+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7074029070 con 0x56441df6c8d0 2024-09-15T22:35:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.291+0000 7f706d600640 1 -- 172.21.15.22:0/593908997 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70700035f0 con 0x56441df6c8d0 2024-09-15T22:35:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.291+0000 7f708d84a740 10 client.25309 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.291+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56441df82bb0 con 0x56441df6c8d0 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f706d600640 1 -- 172.21.15.22:0/593908997 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7074029070 con 0x56441df6c8d0 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f706d600640 1 -- 172.21.15.22:0/593908997 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7070069640 con 0x56441df6c8d0 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f708d84a740 10 client.25309 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f708d84a740 10 client.25309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f708d84a740 20 client.25309 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f708d84a740 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df76c30 0x56441dff40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f708d84a740 4 client.25309 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:35:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.292+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56441deddb80 con 0x56441df76c30 2024-09-15T22:35:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.293+0000 7f7083400640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df76c30 0x56441dff40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.300+0000 7f7083400640 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df76c30 0x56441dff40a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1962458b9fff1a29 server_cookie=7da6bcbca4c90ec4 in_seq=0 out_seq=0 2024-09-15T22:35:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.300+0000 7f706d600640 10 client.25309 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f706d600640 1 -- 172.21.15.22:0/593908997 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56441deddb80 con 0x56441df76c30 2024-09-15T22:35:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f706d600640 10 client.25309 handle_command_reply: tid=0 2024-09-15T22:35:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 client.25309 shutdown 2024-09-15T22:35:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 msgr2=0x56441df7fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df7fd90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7070032fd0 tx=0x7f707003d000 comp rx=0 tx=0).stop 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 shutdown_connections 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56441df76c30 0x56441dff40a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56441df71ba0 0x56441df81290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56441df71260 0x56441df802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 --2- 172.21.15.22:0/593908997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56441df6c8d0 0x56441df7fd90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 >> 172.21.15.22:0/593908997 conn(0x56441df76750 msgr2=0x56441df6b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.322+0000 7f706d600640 0 client.25309 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.323+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 shutdown_connections 2024-09-15T22:35:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.323+0000 7f708d84a740 1 -- 172.21.15.22:0/593908997 wait complete. 2024-09-15T22:35:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.323+0000 7f708d84a740 20 client.25309 trim_cache size 0 max 16384 2024-09-15T22:35:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:35:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:35:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:35:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:35:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70680a3280 msgr2=0x7f70680a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70680a3280 0x7f70680a5740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f707c0a0ff0 tx=0x7f707c009eb0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084107620 msgr2=0x7f70841a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084107620 0x7f70841a7d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f707c005fd0 tx=0x7f707c00b630 comp rx=0 tx=0).stop 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 shutdown_connections 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7084107620 0x7f70841a7d30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f70680a3280 0x7f70680a5740 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7084104cf0 0x7f70840710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 --2- 172.21.15.22:0/2006059037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70841023c0 0x7f7084070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.329+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 >> 172.21.15.22:0/2006059037 conn(0x7f70840fbfa0 msgr2=0x7f7084105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.330+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 shutdown_connections 2024-09-15T22:35:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:38.332+0000 7f7089200640 1 -- 172.21.15.22:0/2006059037 wait complete. 2024-09-15T22:35:39.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:39 smithi112 ceph-mon[35032]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 905 op/s 2024-09-15T22:35:39.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:39 smithi110 ceph-mon[35282]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 905 op/s 2024-09-15T22:35:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:39 smithi022 ceph-mon[30634]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 905 op/s 2024-09-15T22:35:41.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:41 smithi112 ceph-mon[35032]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 250 MiB/s wr, 848 op/s 2024-09-15T22:35:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:41 smithi110 ceph-mon[35282]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 250 MiB/s wr, 848 op/s 2024-09-15T22:35:42.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:41 smithi022 ceph-mon[30634]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 250 MiB/s wr, 848 op/s 2024-09-15T22:35:43.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:43 smithi022 ceph-mon[30634]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 279 MiB/s wr, 957 op/s 2024-09-15T22:35:43.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:43 smithi112 ceph-mon[35032]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 279 MiB/s wr, 957 op/s 2024-09-15T22:35:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:43 smithi110 ceph-mon[35282]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 279 MiB/s wr, 957 op/s 2024-09-15T22:35:45.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:45 smithi112 ceph-mon[35032]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 276 MiB/s wr, 940 op/s 2024-09-15T22:35:45.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:45 smithi110 ceph-mon[35282]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 276 MiB/s wr, 940 op/s 2024-09-15T22:35:46.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:45 smithi022 ceph-mon[30634]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 276 MiB/s wr, 940 op/s 2024-09-15T22:35:46.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:46 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:47.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:46 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:47.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:46 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:47.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:47 smithi110 ceph-mon[35282]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 916 op/s 2024-09-15T22:35:48.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:47 smithi022 ceph-mon[30634]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 916 op/s 2024-09-15T22:35:48.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:47 smithi112 ceph-mon[35032]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 916 op/s 2024-09-15T22:35:48.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:48 smithi110 ceph-mon[35282]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 281 MiB/s wr, 954 op/s 2024-09-15T22:35:48.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:35:48.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:35:48.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:35:49.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:48 smithi022 ceph-mon[30634]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 281 MiB/s wr, 954 op/s 2024-09-15T22:35:49.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:35:49.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:35:49.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:35:49.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:48 smithi112 ceph-mon[35032]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 281 MiB/s wr, 954 op/s 2024-09-15T22:35:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:35:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:35:49.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:35:51.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:50 smithi022 ceph-mon[30634]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 262 MiB/s wr, 876 op/s 2024-09-15T22:35:51.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:50 smithi112 ceph-mon[35032]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 262 MiB/s wr, 876 op/s 2024-09-15T22:35:51.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:50 smithi110 ceph-mon[35282]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 262 MiB/s wr, 876 op/s 2024-09-15T22:35:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.545+0000 7fadb0c00640 1 -- 172.21.15.22:0/2109796141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 msgr2=0x7fadac1025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.545+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2109796141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 0x7fadac1025c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009900 tx=0x7fad9c02a420 comp rx=0 tx=0).stop 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.546+0000 7fadb0c00640 1 -- 172.21.15.22:0/2109796141 shutdown_connections 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.546+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2109796141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac102b00 0x7fadac104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.546+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2109796141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadac1054b0 0x7fadac105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.547+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2109796141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 0x7fadac1025c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.547+0000 7fadb0c00640 1 -- 172.21.15.22:0/2109796141 >> 172.21.15.22:0/2109796141 conn(0x7fadac0fbfa0 msgr2=0x7fadac0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.547+0000 7fadb0c00640 1 -- 172.21.15.22:0/2109796141 shutdown_connections 2024-09-15T22:35:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.548+0000 7fadb0c00640 1 -- 172.21.15.22:0/2109796141 wait complete. 2024-09-15T22:35:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.549+0000 7fadb0c00640 1 Processor -- start 2024-09-15T22:35:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.549+0000 7fadb0c00640 1 -- start start 2024-09-15T22:35:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadb0c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 0x7fadac070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadb0c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadac102b00 0x7fadac0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadb0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 0x7fadac1ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadb0c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadac113c80 con 0x7fadac102b00 2024-09-15T22:35:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadb0c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fadac113b00 con 0x7fadac1001b0 2024-09-15T22:35:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadb0c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadac113e00 con 0x7fadac1054b0 2024-09-15T22:35:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadabe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 0x7fadac1ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadabe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 0x7fadac1ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50794/0 (socket says 172.21.15.22:50794) 2024-09-15T22:35:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.550+0000 7fadabe00640 1 -- 172.21.15.22:0/2856345521 learned_addr learned my addr 172.21.15.22:0/2856345521 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.551+0000 7fadabe00640 1 -- 172.21.15.22:0/2856345521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 msgr2=0x7fadac070b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:35:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.551+0000 7fadabe00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 0x7fadac070b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.551+0000 7fadabe00640 1 -- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadac102b00 msgr2=0x7fadac0710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.551+0000 7fadabe00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadac102b00 0x7fadac0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.551+0000 7fadabe00640 1 -- 172.21.15.22:0/2856345521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac1ae8d0 con 0x7fadac1054b0 2024-09-15T22:35:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.551+0000 7fadabe00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 0x7fadac1ae390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fada400cce0 tx=0x7fada400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.552+0000 7fada8c00640 1 -- 172.21.15.22:0/2856345521 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada400f450 con 0x7fadac1054b0 2024-09-15T22:35:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.552+0000 7fada8c00640 1 -- 172.21.15.22:0/2856345521 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada400fad0 con 0x7fadac1054b0 2024-09-15T22:35:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.552+0000 7fada8c00640 1 -- 172.21.15.22:0/2856345521 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4018c10 con 0x7fadac1054b0 2024-09-15T22:35:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.552+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac1aeaa0 con 0x7fadac1054b0 2024-09-15T22:35:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.553+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac1aef90 con 0x7fadac1054b0 2024-09-15T22:35:51.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.557+0000 7fadb5076740 1 Processor -- start 2024-09-15T22:35:51.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.562+0000 7fada8c00640 1 -- 172.21.15.22:0/2856345521 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fada400f5f0 con 0x7fadac1054b0 2024-09-15T22:35:51.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.564+0000 7fada8c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fad900a3450 0x7fad900a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.564+0000 7fada8c00640 1 -- 172.21.15.22:0/2856345521 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fada40cffc0 con 0x7fadac1054b0 2024-09-15T22:35:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 -- start start 2024-09-15T22:35:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400a260 0x55673400a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 0x55673400f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x5567340120f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556733f6f100 con 0x55673400a260 2024-09-15T22:35:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556733f171b0 con 0x55673400fc30 2024-09-15T22:35:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.565+0000 7fadb5076740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556733f6b0c0 con 0x55673400aba0 2024-09-15T22:35:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.566+0000 7fada3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 0x55673400f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.566+0000 7fada3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 0x55673400f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50796/0 (socket says 172.21.15.22:50796) 2024-09-15T22:35:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.566+0000 7fada3e00640 1 -- 172.21.15.22:0/326079276 learned_addr learned my addr 172.21.15.22:0/326079276 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.567+0000 7fada3e00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fad900a3450 0x7fad900a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.567+0000 7fada3e00640 1 -- 172.21.15.22:0/326079276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 msgr2=0x5567340120f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:35:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.567+0000 7fada3e00640 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x5567340120f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.567+0000 7fada3e00640 1 -- 172.21.15.22:0/326079276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400a260 msgr2=0x55673400a660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:35:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.570+0000 7fadab400640 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400a260 0x55673400a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.570+0000 7fada3e00640 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400a260 0x55673400a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.570+0000 7fada3e00640 1 -- 172.21.15.22:0/326079276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556733c82210 con 0x55673400aba0 2024-09-15T22:35:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.570+0000 7fadab400640 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400a260 0x55673400a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.571+0000 7fada3e00640 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 0x55673400f660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad94012360 tx=0x7fad94012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e504466b635900e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.571+0000 7fada3e00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fad900a3450 0x7fad900a5910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad94012d20 tx=0x7fad94005000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.572+0000 7fad9be00640 1 -- 172.21.15.22:0/326079276 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9401d070 con 0x55673400aba0 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.572+0000 7fad9be00640 1 -- 172.21.15.22:0/326079276 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad94019910 con 0x55673400aba0 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.572+0000 7fad9be00640 1 -- 172.21.15.22:0/326079276 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94018750 con 0x55673400aba0 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.573+0000 7fadb5076740 1 -- 172.21.15.22:0/326079276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 msgr2=0x55673400f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.573+0000 7fadb5076740 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 0x55673400f660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad94012360 tx=0x7fad94012820 comp rx=0 tx=0).stop 2024-09-15T22:35:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.579+0000 7fadb5076740 1 -- 172.21.15.22:0/326079276 shutdown_connections 2024-09-15T22:35:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.579+0000 7fadb5076740 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400aba0 0x55673400f660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.580+0000 7fadb5076740 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x5567340120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.580+0000 7fadb5076740 1 --2- 172.21.15.22:0/326079276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400a260 0x55673400a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.580+0000 7fadb5076740 1 -- 172.21.15.22:0/326079276 >> 172.21.15.22:0/326079276 conn(0x5567340058d0 msgr2=0x556734005cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.581+0000 7fadb5076740 1 -- 172.21.15.22:0/326079276 shutdown_connections 2024-09-15T22:35:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.581+0000 7fadb5076740 1 -- 172.21.15.22:0/326079276 wait complete. 2024-09-15T22:35:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.582+0000 7fadb5076740 1 -- start start 2024-09-15T22:35:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.583+0000 7fadb5076740 1 Processor -- start 2024-09-15T22:35:51.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.585+0000 7fadb5076740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x5567340145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.586+0000 7fadab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x5567340145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.586+0000 7fadab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x5567340145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:51426/0 (socket says 172.21.15.22:51426) 2024-09-15T22:35:51.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.586+0000 7fadab400640 1 -- 172.21.15.22:0/1246042986 learned_addr learned my addr 172.21.15.22:0/1246042986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:51.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.586+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400aba0 0x556734014ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.587+0000 7fada3e00640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400aba0 0x556734014ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.588+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400fc30 0x55673401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.588+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556734012ba0 con 0x55673400aba0 2024-09-15T22:35:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.588+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556733ef8090 con 0x55673400a260 2024-09-15T22:35:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.588+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556734012d20 con 0x55673400fc30 2024-09-15T22:35:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.588+0000 7fadb5076740 10 client.0 _ll_register_callbacks cb 0x556733f4cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fadabe00640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400fc30 0x55673401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fada3e00640 1 -- 172.21.15.22:0/1246042986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400fc30 msgr2=0x55673401bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fada3e00640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400fc30 0x55673401bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fada3e00640 1 -- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 msgr2=0x5567340145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fada3e00640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x5567340145a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fada3e00640 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556733d4e620 con 0x55673400aba0 2024-09-15T22:35:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.589+0000 7fadab400640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x5567340145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.590+0000 7fadabe00640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400fc30 0x55673401bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:35:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.590+0000 7fada3e00640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400aba0 0x556734014ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fad94009080 tx=0x7fad94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28f2f32428df4fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.593 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.591+0000 7fad98c00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:35:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.592+0000 7fad98c00640 1 -- 172.21.15.22:0/1246042986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9401d070 con 0x55673400aba0 2024-09-15T22:35:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.592+0000 7fad98c00640 1 -- 172.21.15.22:0/1246042986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fad94004220 con 0x55673400aba0 2024-09-15T22:35:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.592+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad94019910 con 0x55673400aba0 2024-09-15T22:35:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.593+0000 7fad98c00640 1 -- 172.21.15.22:0/1246042986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad94019730 con 0x55673400aba0 2024-09-15T22:35:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.593+0000 7fadb5076740 10 client.15237 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.593+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55673401e880 con 0x55673400aba0 2024-09-15T22:35:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fad98c00640 1 -- 172.21.15.22:0/1246042986 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad94019910 con 0x55673400aba0 2024-09-15T22:35:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fad98c00640 1 -- 172.21.15.22:0/1246042986 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad94029030 con 0x55673400aba0 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fadb5076740 10 client.15237 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fadb5076740 10 client.15237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fadb5076740 20 client.15237 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673401fdd0 0x5567340221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fadb5076740 4 client.15237 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.594+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556733f7c830 con 0x55673401fdd0 2024-09-15T22:35:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.595+0000 7fadab400640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673401fdd0 0x5567340221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.596+0000 7fadab400640 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673401fdd0 0x5567340221f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80dd1bc265209bcd server_cookie=a4fc83ede8836193 in_seq=0 out_seq=0 2024-09-15T22:35:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.596+0000 7fad98c00640 10 client.15237 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fad98c00640 1 -- 172.21.15.22:0/1246042986 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556733f7c830 con 0x55673401fdd0 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fad98c00640 10 client.15237 handle_command_reply: tid=0 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 client.15237 shutdown 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400aba0 msgr2=0x556734014ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400aba0 0x556734014ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fad94009080 tx=0x7fad94004750 comp rx=0 tx=0).stop 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 shutdown_connections 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673401fdd0 0x5567340221f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400fc30 0x55673401bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400aba0 0x556734014ae0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 --2- 172.21.15.22:0/1246042986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x5567340145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.597+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 >> 172.21.15.22:0/1246042986 conn(0x5567340058d0 msgr2=0x5567340070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.598+0000 7fad98c00640 0 client.15237 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.598+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 shutdown_connections 2024-09-15T22:35:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.598+0000 7fadb5076740 1 -- 172.21.15.22:0/1246042986 wait complete. 2024-09-15T22:35:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.599+0000 7fadb5076740 20 client.15237 trim_cache size 0 max 16384 2024-09-15T22:35:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.658+0000 7fadb5076740 1 Processor -- start 2024-09-15T22:35:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.658+0000 7fadb5076740 1 -- start start 2024-09-15T22:35:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadb5076740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x556734007cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadb5076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400fc30 0x55673401ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadb5076740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556734008200 0x5567340086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadb5076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1ba5f0 con 0x55673400fc30 2024-09-15T22:35:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadb5076740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1b7ec0 con 0x55673400a260 2024-09-15T22:35:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadb5076740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1b5cf0 con 0x556734008200 2024-09-15T22:35:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x556734007cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x556734007cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:51434/0 (socket says 172.21.15.22:51434) 2024-09-15T22:35:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadab400640 1 -- 172.21.15.22:0/2372847845 learned_addr learned my addr 172.21.15.22:0/2372847845 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fadabe00640 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556734008200 0x5567340086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.659+0000 7fada3e00640 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400fc30 0x55673401ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fadabe00640 1 -- 172.21.15.22:0/2372847845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 msgr2=0x556734007cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fadabe00640 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x556734007cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fadabe00640 1 -- 172.21.15.22:0/2372847845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400fc30 msgr2=0x55673401ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fadabe00640 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400fc30 0x55673401ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fadabe00640 1 -- 172.21.15.22:0/2372847845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567340056f0 con 0x556734008200 2024-09-15T22:35:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fada3e00640 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400fc30 0x55673401ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:35:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fadabe00640 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556734008200 0x5567340086b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fada40cda80 tx=0x7fada409c160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79a05b26373cd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fad9b400640 1 -- 172.21.15.22:0/2372847845 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada409c5a0 con 0x556734008200 2024-09-15T22:35:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fad9b400640 1 -- 172.21.15.22:0/2372847845 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada40a0950 con 0x556734008200 2024-09-15T22:35:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.660+0000 7fad9b400640 1 -- 172.21.15.22:0/2372847845 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada400fc80 con 0x556734008200 2024-09-15T22:35:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.661+0000 7fadb5076740 1 -- 172.21.15.22:0/2372847845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556734008200 msgr2=0x5567340086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.661+0000 7fadb5076740 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556734008200 0x5567340086b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fada40cda80 tx=0x7fada409c160 comp rx=0 tx=0).stop 2024-09-15T22:35:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 -- 172.21.15.22:0/2372847845 shutdown_connections 2024-09-15T22:35:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556734008200 0x5567340086b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55673400fc30 0x55673401ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 --2- 172.21.15.22:0/2372847845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400a260 0x556734007cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 -- 172.21.15.22:0/2372847845 >> 172.21.15.22:0/2372847845 conn(0x5567340058d0 msgr2=0x55673400b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 -- 172.21.15.22:0/2372847845 shutdown_connections 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 -- 172.21.15.22:0/2372847845 wait complete. 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 -- start start 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.662+0000 7fadb5076740 1 Processor -- start 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 0x5567340191c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400a260 0x556734019700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x55673401a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1b6380 con 0x556734008200 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1b77f0 con 0x55673400fc30 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1b6a50 con 0x55673400a260 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadb5076740 10 client.0 _ll_register_callbacks cb 0x7fad94012160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadab400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 0x5567340191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadab400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 0x5567340191c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50626/0 (socket says 172.21.15.22:50626) 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadab400640 1 -- 172.21.15.22:0/1371941561 learned_addr learned my addr 172.21.15.22:0/1371941561 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fadabe00640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x55673401a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.663+0000 7fada3e00640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400a260 0x556734019700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fadab400640 1 -- 172.21.15.22:0/1371941561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400a260 msgr2=0x556734019700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fadab400640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400a260 0x556734019700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fadab400640 1 -- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 msgr2=0x55673401a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fadab400640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x55673401a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fadab400640 1 -- 172.21.15.22:0/1371941561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673401aba0 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fadab400640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 0x5567340191c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009230 tx=0x7fad9c005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def9692a14ec9afe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fad98c00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.664+0000 7fad98c00640 1 -- 172.21.15.22:0/1371941561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c035070 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.665+0000 7fad98c00640 1 -- 172.21.15.22:0/1371941561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fad9c0048c0 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.665+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada40a0950 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.665+0000 7fad98c00640 1 -- 172.21.15.22:0/1371941561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad9c004ac0 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.665+0000 7fadb5076740 10 client.15243 fetch_fsmap learned FSMap version 25 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.665+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55673408aa90 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.666+0000 7fad98c00640 1 -- 172.21.15.22:0/1371941561 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada40a0950 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.666+0000 7fad98c00640 1 -- 172.21.15.22:0/1371941561 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad9c044070 con 0x556734008200 2024-09-15T22:35:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.666+0000 7fadb5076740 10 client.15243 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.666+0000 7fadb5076740 10 client.15243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.666+0000 7fadb5076740 20 client.15243 populate_metadata read hostname 'smithi022' 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.666+0000 7fadb5076740 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673408b3b0 0x55673408d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.667+0000 7fadb5076740 4 client.15243 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.667+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556733f76b80 con 0x55673408b3b0 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.667+0000 7fada3e00640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673408b3b0 0x55673408d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.667+0000 7fad98c00640 10 client.15243 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.667+0000 7fada3e00640 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673408b3b0 0x55673408d7d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af54e1b11e12494 server_cookie=20febc7a64158e68 in_seq=0 out_seq=0 2024-09-15T22:35:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fad98c00640 1 -- 172.21.15.22:0/1371941561 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556733f76b80 con 0x55673408b3b0 2024-09-15T22:35:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fad98c00640 10 client.15243 handle_command_reply: tid=0 2024-09-15T22:35:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 client.15243 shutdown 2024-09-15T22:35:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 msgr2=0x5567340191c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 0x5567340191c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009230 tx=0x7fad9c005300 comp rx=0 tx=0).stop 2024-09-15T22:35:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 shutdown_connections 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55673408b3b0 0x55673408d7d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55673400a260 0x556734019700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55673400fc30 0x55673401a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 --2- 172.21.15.22:0/1371941561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556734008200 0x5567340191c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 >> 172.21.15.22:0/1371941561 conn(0x5567340058d0 msgr2=0x5567340041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fad98c00640 0 client.15243 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 shutdown_connections 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.682+0000 7fadb5076740 1 -- 172.21.15.22:0/1371941561 wait complete. 2024-09-15T22:35:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb5076740 20 client.15243 trim_cache size 0 max 16384 2024-09-15T22:35:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:35:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:35:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:35:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:35:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fad900a3450 msgr2=0x7fad900a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fad900a3450 0x7fad900a5910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad94012d20 tx=0x7fad94005000 comp rx=0 tx=0).stop 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 msgr2=0x7fadac1ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 0x7fadac1ae390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fada400cce0 tx=0x7fada400a620 comp rx=0 tx=0).stop 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 shutdown_connections 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadac1054b0 0x7fadac1ae390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fad900a3450 0x7fad900a5910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadac102b00 0x7fadac0710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 --2- 172.21.15.22:0/2856345521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadac1001b0 0x7fadac070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.683+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 >> 172.21.15.22:0/2856345521 conn(0x7fadac0fbfa0 msgr2=0x7fadac103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.684+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 shutdown_connections 2024-09-15T22:35:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:35:51.684+0000 7fadb0c00640 1 -- 172.21.15.22:0/2856345521 wait complete. 2024-09-15T22:35:53.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:52 smithi022 ceph-mon[30634]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 270 MiB/s wr, 895 op/s 2024-09-15T22:35:53.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:52 smithi112 ceph-mon[35032]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 270 MiB/s wr, 895 op/s 2024-09-15T22:35:53.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:52 smithi110 ceph-mon[35282]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 270 MiB/s wr, 895 op/s 2024-09-15T22:35:55.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:54 smithi022 ceph-mon[30634]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 250 MiB/s wr, 821 op/s 2024-09-15T22:35:55.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:54 smithi112 ceph-mon[35032]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 250 MiB/s wr, 821 op/s 2024-09-15T22:35:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:54 smithi110 ceph-mon[35282]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 250 MiB/s wr, 821 op/s 2024-09-15T22:35:57.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:56 smithi112 ceph-mon[35032]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 243 MiB/s wr, 795 op/s 2024-09-15T22:35:57.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:56 smithi110 ceph-mon[35282]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 243 MiB/s wr, 795 op/s 2024-09-15T22:35:57.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:56 smithi022 ceph-mon[30634]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 243 MiB/s wr, 795 op/s 2024-09-15T22:35:59.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:35:58 smithi112 ceph-mon[35032]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 269 MiB/s wr, 873 op/s 2024-09-15T22:35:59.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:35:58 smithi110 ceph-mon[35282]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 269 MiB/s wr, 873 op/s 2024-09-15T22:35:59.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:35:58 smithi022 ceph-mon[30634]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 269 MiB/s wr, 873 op/s 2024-09-15T22:36:01.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:00 smithi112 ceph-mon[35032]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 835 op/s 2024-09-15T22:36:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:00 smithi110 ceph-mon[35282]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 835 op/s 2024-09-15T22:36:01.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:00 smithi022 ceph-mon[30634]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 835 op/s 2024-09-15T22:36:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:02 smithi110 ceph-mon[35282]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 909 op/s 2024-09-15T22:36:03.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:02 smithi022 ceph-mon[30634]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 909 op/s 2024-09-15T22:36:03.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:02 smithi112 ceph-mon[35032]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 909 op/s 2024-09-15T22:36:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 -- 172.21.15.22:0/740427545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c101b60 msgr2=0x7fc41c101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 --2- 172.21.15.22:0/740427545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c101b60 0x7fc41c101f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009900 tx=0x7fc40c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 -- 172.21.15.22:0/740427545 shutdown_connections 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 --2- 172.21.15.22:0/740427545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c103710 0x7fc41c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 --2- 172.21.15.22:0/740427545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc41c102d50 0x7fc41c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 --2- 172.21.15.22:0/740427545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c101b60 0x7fc41c101f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.859+0000 7fc421000640 1 -- 172.21.15.22:0/740427545 >> 172.21.15.22:0/740427545 conn(0x7fc41c0fd2e0 msgr2=0x7fc41c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.860+0000 7fc421000640 1 -- 172.21.15.22:0/740427545 shutdown_connections 2024-09-15T22:36:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.860+0000 7fc421000640 1 -- 172.21.15.22:0/740427545 wait complete. 2024-09-15T22:36:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.861+0000 7fc421000640 1 Processor -- start 2024-09-15T22:36:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.861+0000 7fc421000640 1 -- start start 2024-09-15T22:36:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc421000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc41c101b60 0x7fc41c19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc421000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c102d50 0x7fc41c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc421000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 0x7fc41c1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc421000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c10d7e0 con 0x7fc41c102d50 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc421000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c10d660 con 0x7fc41c101b60 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc421000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c10d960 con 0x7fc41c103710 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 0x7fc41c1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc419400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c102d50 0x7fc41c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc419e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc41c101b60 0x7fc41c19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 0x7fc41c1a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47972/0 (socket says 172.21.15.22:47972) 2024-09-15T22:36:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 -- 172.21.15.22:0/1887494841 learned_addr learned my addr 172.21.15.22:0/1887494841 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 -- 172.21.15.22:0/1887494841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc41c101b60 msgr2=0x7fc41c19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc41c101b60 0x7fc41c19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 -- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c102d50 msgr2=0x7fc41c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c102d50 0x7fc41c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.862+0000 7fc41a800640 1 -- 172.21.15.22:0/1887494841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c1a1c40 con 0x7fc41c103710 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.863+0000 7fc41a800640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 0x7fc41c1a15d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc41400eb10 tx=0x7fc41400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.863+0000 7fc412a00640 1 -- 172.21.15.22:0/1887494841 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414004b20 con 0x7fc41c103710 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.863+0000 7fc412a00640 1 -- 172.21.15.22:0/1887494841 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc414004cc0 con 0x7fc41c103710 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.863+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c1a1f30 con 0x7fc41c103710 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.863+0000 7fc412a00640 1 -- 172.21.15.22:0/1887494841 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414010760 con 0x7fc41c103710 2024-09-15T22:36:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.863+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c1a23f0 con 0x7fc41c103710 2024-09-15T22:36:04.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.867+0000 7fc412a00640 1 -- 172.21.15.22:0/1887494841 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc414005020 con 0x7fc41c103710 2024-09-15T22:36:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.868+0000 7fc423ea1740 1 Processor -- start 2024-09-15T22:36:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc412a00640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4000a33f0 0x7fc4000a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 -- start start 2024-09-15T22:36:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc412a00640 1 -- 172.21.15.22:0/1887494841 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fc4140cfe80 con 0x7fc41c103710 2024-09-15T22:36:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f63490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f68490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f6af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e133ec8100 con 0x55e133f63090 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e133e701b0 con 0x55e133f639d0 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc423ea1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e133ec40c0 con 0x55e133f68a60 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.870+0000 7fc419400640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4000a33f0 0x7fc4000a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f6af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f6af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47982/0 (socket says 172.21.15.22:47982) 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 -- 172.21.15.22:0/803021362 learned_addr learned my addr 172.21.15.22:0/803021362 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc419400640 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f68490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc419e00640 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f63490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 -- 172.21.15.22:0/803021362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 msgr2=0x55e133f68490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f68490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 -- 172.21.15.22:0/803021362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 msgr2=0x55e133f63490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f63490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc41a800640 1 -- 172.21.15.22:0/803021362 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e133bdb210 con 0x55e133f68a60 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.871+0000 7fc419e00640 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f63490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.872+0000 7fc419400640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4000a33f0 0x7fc4000a58b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc408009710 tx=0x7fc408009af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.872+0000 7fc41a800640 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f6af20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc414004af0 tx=0x7fc4140987f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a18b4dc6fb1dc21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.873+0000 7fc407400640 1 -- 172.21.15.22:0/803021362 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140b4020 con 0x55e133f68a60 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.873+0000 7fc407400640 1 -- 172.21.15.22:0/803021362 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc41409cb60 con 0x55e133f68a60 2024-09-15T22:36:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.873+0000 7fc407400640 1 -- 172.21.15.22:0/803021362 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414098ad0 con 0x55e133f68a60 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.873+0000 7fc423ea1740 1 -- 172.21.15.22:0/803021362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 msgr2=0x55e133f6af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.873+0000 7fc423ea1740 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f6af20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc414004af0 tx=0x7fc4140987f0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 -- 172.21.15.22:0/803021362 shutdown_connections 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f6af20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f68490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 --2- 172.21.15.22:0/803021362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f63490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 -- 172.21.15.22:0/803021362 >> 172.21.15.22:0/803021362 conn(0x55e133f5e700 msgr2=0x55e133f5eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 -- 172.21.15.22:0/803021362 shutdown_connections 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 -- 172.21.15.22:0/803021362 wait complete. 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 -- start start 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.874+0000 7fc423ea1740 1 Processor -- start 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f75a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f75f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f7cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e133f741e0 con 0x55e133f63090 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e133e51090 con 0x55e133f639d0 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e133f74360 con 0x55e133f68a60 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc423ea1740 10 client.0 _ll_register_callbacks cb 0x55e133ea5f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc41a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f7cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc419400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f75f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc41a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f7cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47986/0 (socket says 172.21.15.22:47986) 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.875+0000 7fc41a800640 1 -- 172.21.15.22:0/2974329075 learned_addr learned my addr 172.21.15.22:0/2974329075 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc419e00640 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f75a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc41a800640 1 -- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 msgr2=0x55e133f75f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc41a800640 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f75f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc41a800640 1 -- 172.21.15.22:0/2974329075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 msgr2=0x55e133f75a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc41a800640 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f75a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc41a800640 1 -- 172.21.15.22:0/2974329075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e133ca7620 con 0x55e133f68a60 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc41a800640 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f7cfd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4140cd940 tx=0x7fc4140a5150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e90f181817b50022 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc3fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc3fbe00640 1 -- 172.21.15.22:0/2974329075 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140b9070 con 0x55e133f68a60 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc3fbe00640 1 -- 172.21.15.22:0/2974329075 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fc4140a4c40 con 0x55e133f68a60 2024-09-15T22:36:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc41409cb60 con 0x55e133f68a60 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.876+0000 7fc3fbe00640 1 -- 172.21.15.22:0/2974329075 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc4140b4070 con 0x55e133f68a60 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 10 client.25333 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e133f741e0 con 0x55e133f68a60 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc3fbe00640 1 -- 172.21.15.22:0/2974329075 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc41409cb60 con 0x55e133f68a60 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc3fbe00640 1 -- 172.21.15.22:0/2974329075 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc41409b8b0 con 0x55e133f68a60 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 10 client.25333 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 10 client.25333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 20 client.25333 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133f81050 0x55e133f83440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 4 client.25333 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.877+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e133ed5830 con 0x55e133f81050 2024-09-15T22:36:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.878+0000 7fc419e00640 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133f81050 0x55e133f83440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.878+0000 7fc419e00640 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133f81050 0x55e133f83440 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17088f3b89c532fa server_cookie=136bce5e47c45864 in_seq=0 out_seq=0 2024-09-15T22:36:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.878+0000 7fc3fbe00640 10 client.25333 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.879+0000 7fc3fbe00640 1 -- 172.21.15.22:0/2974329075 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e133ed5830 con 0x55e133f81050 2024-09-15T22:36:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.879+0000 7fc3fbe00640 10 client.25333 handle_command_reply: tid=0 2024-09-15T22:36:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.879+0000 7fc423ea1740 1 client.25333 shutdown 2024-09-15T22:36:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.881+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 msgr2=0x55e133f7cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.881+0000 7fc423ea1740 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f7cfd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4140cd940 tx=0x7fc4140a5150 comp rx=0 tx=0).stop 2024-09-15T22:36:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 shutdown_connections 2024-09-15T22:36:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133f81050 0x55e133f83440 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f68a60 0x55e133f7cfd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f75f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 --2- 172.21.15.22:0/2974329075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f75a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 >> 172.21.15.22:0/2974329075 conn(0x55e133f5e700 msgr2=0x55e133f5ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc3fbe00640 0 client.25333 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 shutdown_connections 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.882+0000 7fc423ea1740 1 -- 172.21.15.22:0/2974329075 wait complete. 2024-09-15T22:36:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.883+0000 7fc423ea1740 20 client.25333 trim_cache size 0 max 16384 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.902+0000 7fc423ea1740 1 Processor -- start 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.902+0000 7fc423ea1740 1 -- start start 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 0x55e133f5faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f7cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f68a60 0x55e133f60030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc423ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a9740 con 0x55e133f68a60 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc423ea1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a7010 con 0x55e133f639d0 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc423ea1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a4e80 con 0x55e133f63090 2024-09-15T22:36:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f7cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 0x55e133f5faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 0x55e133f5faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47992/0 (socket says 172.21.15.22:47992) 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 -- 172.21.15.22:0/4213720019 learned_addr learned my addr 172.21.15.22:0/4213720019 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f7cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:35650/0 (socket says 172.21.15.22:35650) 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc41a800640 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f68a60 0x55e133f60030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 -- 172.21.15.22:0/4213720019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 msgr2=0x55e133f7cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f7cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 -- 172.21.15.22:0/4213720019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f68a60 msgr2=0x55e133f60030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f68a60 0x55e133f60030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.903+0000 7fc419e00640 1 -- 172.21.15.22:0/4213720019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e133f59d60 con 0x55e133f63090 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.904+0000 7fc419e00640 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 0x55e133f5faf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0314e0 tx=0x7fc40c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd630db0eed43eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.904+0000 7fc406a00640 1 -- 172.21.15.22:0/4213720019 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c049070 con 0x55e133f63090 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.904+0000 7fc406a00640 1 -- 172.21.15.22:0/4213720019 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc40c005520 con 0x55e133f63090 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.904+0000 7fc406a00640 1 -- 172.21.15.22:0/4213720019 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c035040 con 0x55e133f63090 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 -- 172.21.15.22:0/4213720019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 msgr2=0x55e133f5faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 0x55e133f5faf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0314e0 tx=0x7fc40c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 -- 172.21.15.22:0/4213720019 shutdown_connections 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f68a60 0x55e133f60030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f639d0 0x55e133f7cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 --2- 172.21.15.22:0/4213720019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f63090 0x55e133f5faf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 -- 172.21.15.22:0/4213720019 >> 172.21.15.22:0/4213720019 conn(0x55e133f5e700 msgr2=0x55e133f5d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 -- 172.21.15.22:0/4213720019 shutdown_connections 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 -- 172.21.15.22:0/4213720019 wait complete. 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.905+0000 7fc423ea1740 1 -- start start 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 Processor -- start 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f7a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 0x55e133f7a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f68a60 0x55e133f7b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a54d0 con 0x55e133f63090 2024-09-15T22:36:04.909 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a6940 con 0x55e133f68a60 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a5ba0 con 0x55e133f639d0 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc423ea1740 10 client.0 _ll_register_callbacks cb 0x7fc4080134e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc419e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f7a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc419400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 0x55e133f7a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc419400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 0x55e133f7a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48000/0 (socket says 172.21.15.22:48000) 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc419e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f7a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58542/0 (socket says 172.21.15.22:58542) 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc41a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f68a60 0x55e133f7b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.906+0000 7fc419400640 1 -- 172.21.15.22:0/3235122648 learned_addr learned my addr 172.21.15.22:0/3235122648 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc419400640 1 -- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f68a60 msgr2=0x55e133f7b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc419400640 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f68a60 0x55e133f7b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc419400640 1 -- 172.21.15.22:0/3235122648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 msgr2=0x55e133f7a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc419400640 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f7a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc419400640 1 -- 172.21.15.22:0/3235122648 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e133f5df90 con 0x55e133f639d0 2024-09-15T22:36:04.910 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc41a800640 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f68a60 0x55e133f7b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:36:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc419400640 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 0x55e133f7a8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc408013200 tx=0x7fc408004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb280d2f7856e194 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc3fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:36:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc3fbe00640 1 -- 172.21.15.22:0/3235122648 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080035f0 con 0x55e133f639d0 2024-09-15T22:36:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c005520 con 0x55e133f639d0 2024-09-15T22:36:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.907+0000 7fc3fbe00640 1 -- 172.21.15.22:0/3235122648 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fc40801c040 con 0x55e133f639d0 2024-09-15T22:36:04.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.908+0000 7fc3fbe00640 1 -- 172.21.15.22:0/3235122648 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc408003790 con 0x55e133f639d0 2024-09-15T22:36:04.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.908+0000 7fc423ea1740 10 client.25339 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:04.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.908+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e133f7d140 con 0x55e133f639d0 2024-09-15T22:36:04.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.908+0000 7fc3fbe00640 1 -- 172.21.15.22:0/3235122648 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc40c005520 con 0x55e133f639d0 2024-09-15T22:36:04.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc3fbe00640 1 -- 172.21.15.22:0/3235122648 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc40801f040 con 0x55e133f639d0 2024-09-15T22:36:04.912 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc423ea1740 10 client.25339 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc423ea1740 10 client.25339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc423ea1740 20 client.25339 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc423ea1740 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133fec240 0x55e133fee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc423ea1740 4 client.25339 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.909+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e133ecfb80 con 0x55e133fec240 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.910+0000 7fc419e00640 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133fec240 0x55e133fee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.910+0000 7fc419e00640 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133fec240 0x55e133fee660 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c632a235b3a79fc1 server_cookie=d99f7ba284615430 in_seq=0 out_seq=0 2024-09-15T22:36:04.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.910+0000 7fc3fbe00640 10 client.25339 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc3fbe00640 1 -- 172.21.15.22:0/3235122648 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e133ecfb80 con 0x55e133fec240 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc3fbe00640 10 client.25339 handle_command_reply: tid=0 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 client.25339 shutdown 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 msgr2=0x55e133f7a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 0x55e133f7a8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc408013200 tx=0x7fc408004730 comp rx=0 tx=0).stop 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 shutdown_connections 2024-09-15T22:36:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e133fec240 0x55e133fee660 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e133f639d0 0x55e133f7a8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e133f68a60 0x55e133f7b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc3fbe00640 0 client.25339 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 --2- 172.21.15.22:0/3235122648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e133f63090 0x55e133f7a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 >> 172.21.15.22:0/3235122648 conn(0x55e133f5e700 msgr2=0x55e133f5eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 shutdown_connections 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 1 -- 172.21.15.22:0/3235122648 wait complete. 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.928+0000 7fc423ea1740 20 client.25339 trim_cache size 0 max 16384 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:36:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:36:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:36:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:36:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4000a33f0 msgr2=0x7fc4000a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4000a33f0 0x7fc4000a58b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc408009710 tx=0x7fc408009af0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 msgr2=0x7fc41c1a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 0x7fc41c1a15d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc41400eb10 tx=0x7fc41400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 shutdown_connections 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc41c103710 0x7fc41c1a15d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fc4000a33f0 0x7fc4000a58b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc41c102d50 0x7fc41c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 --2- 172.21.15.22:0/1887494841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc41c101b60 0x7fc41c19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 >> 172.21.15.22:0/1887494841 conn(0x7fc41c0fd2e0 msgr2=0x7fc41c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 shutdown_connections 2024-09-15T22:36:04.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:04.929+0000 7fc421000640 1 -- 172.21.15.22:0/1887494841 wait complete. 2024-09-15T22:36:05.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:04 smithi110 ceph-mon[35282]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 887 op/s 2024-09-15T22:36:05.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:04 smithi022 ceph-mon[30634]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 887 op/s 2024-09-15T22:36:05.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:04 smithi112 ceph-mon[35032]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 887 op/s 2024-09-15T22:36:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:06 smithi110 ceph-mon[35282]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 258 MiB/s wr, 859 op/s 2024-09-15T22:36:07.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:06 smithi022 ceph-mon[30634]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 258 MiB/s wr, 859 op/s 2024-09-15T22:36:07.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:06 smithi112 ceph-mon[35032]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 258 MiB/s wr, 859 op/s 2024-09-15T22:36:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:08 smithi110 ceph-mon[35282]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 266 MiB/s wr, 891 op/s 2024-09-15T22:36:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:08 smithi022 ceph-mon[30634]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 266 MiB/s wr, 891 op/s 2024-09-15T22:36:09.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:08 smithi112 ceph-mon[35032]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 266 MiB/s wr, 891 op/s 2024-09-15T22:36:11.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:10 smithi110 ceph-mon[35282]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 239 MiB/s wr, 814 op/s 2024-09-15T22:36:11.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:10 smithi022 ceph-mon[30634]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 239 MiB/s wr, 814 op/s 2024-09-15T22:36:11.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:10 smithi112 ceph-mon[35032]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 239 MiB/s wr, 814 op/s 2024-09-15T22:36:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:12 smithi110 ceph-mon[35282]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 254 MiB/s wr, 866 op/s 2024-09-15T22:36:13.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:12 smithi022 ceph-mon[30634]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 254 MiB/s wr, 866 op/s 2024-09-15T22:36:13.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:12 smithi112 ceph-mon[35032]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 254 MiB/s wr, 866 op/s 2024-09-15T22:36:15.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:14 smithi110 ceph-mon[35282]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 816 op/s 2024-09-15T22:36:15.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:14 smithi022 ceph-mon[30634]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 816 op/s 2024-09-15T22:36:15.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:14 smithi112 ceph-mon[35032]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 816 op/s 2024-09-15T22:36:17.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:16 smithi022 ceph-mon[30634]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 239 MiB/s wr, 809 op/s 2024-09-15T22:36:17.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:16 smithi112 ceph-mon[35032]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 239 MiB/s wr, 809 op/s 2024-09-15T22:36:17.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:16 smithi110 ceph-mon[35282]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 239 MiB/s wr, 809 op/s 2024-09-15T22:36:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 -- 172.21.15.22:0/4203836172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac101f40 msgr2=0x7fe5ac109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/4203836172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac101f40 0x7fe5ac109db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009be0 tx=0x7fe5a402a6c0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 -- 172.21.15.22:0/4203836172 shutdown_connections 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/4203836172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac101f40 0x7fe5ac109db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/4203836172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5ac101580 0x7fe5ac101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/4203836172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac103050 0x7fe5ac103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 -- 172.21.15.22:0/4203836172 >> 172.21.15.22:0/4203836172 conn(0x7fe5ac0fd0d0 msgr2=0x7fe5ac0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 -- 172.21.15.22:0/4203836172 shutdown_connections 2024-09-15T22:36:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.067+0000 7fe5b2a00640 1 -- 172.21.15.22:0/4203836172 wait complete. 2024-09-15T22:36:18.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.068+0000 7fe5b2a00640 1 Processor -- start 2024-09-15T22:36:18.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 -- start start 2024-09-15T22:36:18.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac101580 0x7fe5ac199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5ac101f40 0x7fe5ac19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 0x7fe5ac1a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.072 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac10d680 con 0x7fe5ac101f40 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac10d500 con 0x7fe5ac101580 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac10d800 con 0x7fe5ac103050 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 0x7fe5ac1a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b1600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac101580 0x7fe5ac199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 0x7fe5ac1a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:59798/0 (socket says 172.21.15.22:59798) 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b0c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5ac101f40 0x7fe5ac19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.069+0000 7fe5b2000640 1 -- 172.21.15.22:0/1429286072 learned_addr learned my addr 172.21.15.22:0/1429286072 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b1600640 1 -- 172.21.15.22:0/1429286072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 msgr2=0x7fe5ac1a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b1600640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 0x7fe5ac1a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b1600640 1 -- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5ac101f40 msgr2=0x7fe5ac19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b1600640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5ac101f40 0x7fe5ac19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b1600640 1 -- 172.21.15.22:0/1429286072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac1a1b50 con 0x7fe5ac101580 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b2000640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 0x7fe5ac1a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.070+0000 7fe5b1600640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac101580 0x7fe5ac199f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac1029c0 tx=0x7fe5a000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.071+0000 7fe5aa000640 1 -- 172.21.15.22:0/1429286072 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000ccd0 con 0x7fe5ac101580 2024-09-15T22:36:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.071+0000 7fe5aa000640 1 -- 172.21.15.22:0/1429286072 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a00035f0 con 0x7fe5ac101580 2024-09-15T22:36:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.071+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac1a1e40 con 0x7fe5ac101580 2024-09-15T22:36:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.071+0000 7fe5aa000640 1 -- 172.21.15.22:0/1429286072 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0010690 con 0x7fe5ac101580 2024-09-15T22:36:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.071+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac1a2300 con 0x7fe5ac101580 2024-09-15T22:36:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.075+0000 7fe5b6e63740 1 Processor -- start 2024-09-15T22:36:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.075+0000 7fe5b6e63740 1 -- start start 2024-09-15T22:36:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.076+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c92e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.077+0000 7fe5aa000640 1 -- 172.21.15.22:0/1429286072 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe5a00037a0 con 0x7fe5ac101580 2024-09-15T22:36:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.077+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.077+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c98440 0x556838c9a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.077+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556838bef100 con 0x556838c933b0 2024-09-15T22:36:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.077+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556838b971b0 con 0x556838c92a70 2024-09-15T22:36:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.077+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556838beb0c0 con 0x556838c98440 2024-09-15T22:36:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c92e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c92e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56536/0 (socket says 172.21.15.22:56536) 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 -- 172.21.15.22:0/2471383052 learned_addr learned my addr 172.21.15.22:0/2471383052 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b1600640 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 -- 172.21.15.22:0/2471383052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c98440 msgr2=0x556838c9a900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c98440 0x556838c9a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 -- 172.21.15.22:0/2471383052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 msgr2=0x556838c97e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c97e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.079+0000 7fe5b2000640 1 -- 172.21.15.22:0/2471383052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556838902210 con 0x556838c92a70 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.080+0000 7fe5b1600640 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c97e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:36:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.080+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c92e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005c90 tx=0x7fe5a40303a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b6ae0fcde1ed81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.080+0000 7fe59e600640 1 -- 172.21.15.22:0/2471383052 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4042030 con 0x556838c92a70 2024-09-15T22:36:18.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.081+0000 7fe59e600640 1 -- 172.21.15.22:0/2471383052 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a4037040 con 0x556838c92a70 2024-09-15T22:36:18.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.081+0000 7fe59e600640 1 -- 172.21.15.22:0/2471383052 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4036070 con 0x556838c92a70 2024-09-15T22:36:18.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.081+0000 7fe5aa000640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe5940a3340 0x7fe5940a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.081+0000 7fe5b1600640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe5940a3340 0x7fe5940a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.082+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2471383052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 msgr2=0x556838c92e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c92e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005c90 tx=0x7fe5a40303a0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b1600640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe5940a3340 0x7fe5940a5800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00984e0 tx=0x7fe5a0098370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5aa000640 1 -- 172.21.15.22:0/1429286072 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe5a00cfaf0 con 0x7fe5ac101580 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2471383052 shutdown_connections 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c98440 0x556838c9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c97e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2471383052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c92e70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.083+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2471383052 >> 172.21.15.22:0/2471383052 conn(0x556838c8e0e0 msgr2=0x556838c8e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.086+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2471383052 shutdown_connections 2024-09-15T22:36:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.086+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2471383052 wait complete. 2024-09-15T22:36:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.088+0000 7fe5b6e63740 1 -- start start 2024-09-15T22:36:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 Processor -- start 2024-09-15T22:36:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c9ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c9d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838ca2260 0x556838ca4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556838c9b3b0 con 0x556838c933b0 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556838b78090 con 0x556838c92a70 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556838c9b530 con 0x556838ca2260 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.089+0000 7fe5b6e63740 10 client.0 _ll_register_callbacks cb 0x556838bccf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.090+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c9ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.090+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c9ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56546/0 (socket says 172.21.15.22:56546) 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.090+0000 7fe5b2000640 1 -- 172.21.15.22:0/2639175755 learned_addr learned my addr 172.21.15.22:0/2639175755 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.090+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838ca2260 0x556838ca4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.090+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c9d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.091+0000 7fe5b2000640 1 -- 172.21.15.22:0/2639175755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838ca2260 msgr2=0x556838ca4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.091+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838ca2260 0x556838ca4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.091+0000 7fe5b2000640 1 -- 172.21.15.22:0/2639175755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 msgr2=0x556838c9d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.091+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c9d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.091+0000 7fe5b2000640 1 -- 172.21.15.22:0/2639175755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568389ce620 con 0x556838c92a70 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.092+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c9d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.092+0000 7fe5b2000640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c9ccf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4004aa0 tx=0x7fe5a402ae40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad970b44f8705032 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.092+0000 7fe592a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:36:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.092+0000 7fe592a00640 1 -- 172.21.15.22:0/2639175755 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4042070 con 0x556838c92a70 2024-09-15T22:36:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.092+0000 7fe592a00640 1 -- 172.21.15.22:0/2639175755 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe5a4003e80 con 0x556838c92a70 2024-09-15T22:36:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.093+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a4037040 con 0x556838c92a70 2024-09-15T22:36:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.093+0000 7fe592a00640 1 -- 172.21.15.22:0/2639175755 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5a406a050 con 0x556838c92a70 2024-09-15T22:36:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.093+0000 7fe5b6e63740 10 client.25340 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.093+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556838ca73b0 con 0x556838c92a70 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe592a00640 1 -- 172.21.15.22:0/2639175755 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a4037040 con 0x556838c92a70 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe592a00640 1 -- 172.21.15.22:0/2639175755 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe5a403c040 con 0x556838c92a70 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b6e63740 10 client.25340 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b6e63740 10 client.25340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b6e63740 20 client.25340 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca8700 0x556838caaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b6e63740 4 client.25340 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:36:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556838bfc830 con 0x556838ca8700 2024-09-15T22:36:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.095+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca8700 0x556838caaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.097+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca8700 0x556838caaaf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be704ee904dadae2 server_cookie=e162484671686f8e in_seq=0 out_seq=0 2024-09-15T22:36:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.097+0000 7fe592a00640 10 client.25340 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.098+0000 7fe592a00640 1 -- 172.21.15.22:0/2639175755 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556838bfc830 con 0x556838ca8700 2024-09-15T22:36:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.098+0000 7fe592a00640 10 client.25340 handle_command_reply: tid=0 2024-09-15T22:36:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.098+0000 7fe5b6e63740 1 client.25340 shutdown 2024-09-15T22:36:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 msgr2=0x556838c9ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c9ccf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4004aa0 tx=0x7fe5a402ae40 comp rx=0 tx=0).stop 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 shutdown_connections 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca8700 0x556838caaaf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838ca2260 0x556838ca4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c933b0 0x556838c9d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/2639175755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c92a70 0x556838c9ccf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 >> 172.21.15.22:0/2639175755 conn(0x556838c8e0e0 msgr2=0x556838c8f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.099+0000 7fe592a00640 0 client.25340 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.100+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 shutdown_connections 2024-09-15T22:36:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.100+0000 7fe5b6e63740 1 -- 172.21.15.22:0/2639175755 wait complete. 2024-09-15T22:36:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.102+0000 7fe5b6e63740 20 client.25340 trim_cache size 0 max 16384 2024-09-15T22:36:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.151+0000 7fe5b6e63740 1 Processor -- start 2024-09-15T22:36:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.152+0000 7fe5b6e63740 1 -- start start 2024-09-15T22:36:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.152+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838c8ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.152+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838c8f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838c8ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838c8ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56548/0 (socket says 172.21.15.22:56548) 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b2000640 1 -- 172.21.15.22:0/3047878682 learned_addr learned my addr 172.21.15.22:0/3047878682 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838c8fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838c8f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac072c40 con 0x556838c92a70 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac070510 con 0x556838c8e0e0 2024-09-15T22:36:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.153+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac06e3c0 con 0x556838c933b0 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.154+0000 7fe5b2000640 1 -- 172.21.15.22:0/3047878682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 msgr2=0x556838c8fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.154+0000 7fe5b2000640 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838c8fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.154+0000 7fe5b2000640 1 -- 172.21.15.22:0/3047878682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 msgr2=0x556838c8f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.154+0000 7fe5b2000640 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838c8f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.154+0000 7fe5b2000640 1 -- 172.21.15.22:0/3047878682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556838c8ff50 con 0x556838c8e0e0 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.154+0000 7fe5b2000640 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838c8ef90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009b30 tx=0x7fe5a40039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea064caedf371ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.155+0000 7fe59dc00640 1 -- 172.21.15.22:0/3047878682 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4042040 con 0x556838c8e0e0 2024-09-15T22:36:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.155+0000 7fe59dc00640 1 -- 172.21.15.22:0/3047878682 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a40046d0 con 0x556838c8e0e0 2024-09-15T22:36:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.155+0000 7fe59dc00640 1 -- 172.21.15.22:0/3047878682 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4036040 con 0x556838c8e0e0 2024-09-15T22:36:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.156+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 msgr2=0x556838c8ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.156+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838c8ef90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009b30 tx=0x7fe5a40039d0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 shutdown_connections 2024-09-15T22:36:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838c8fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838c8f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/3047878682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838c8ef90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 >> 172.21.15.22:0/3047878682 conn(0x556838c97fd0 msgr2=0x556838c9caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 shutdown_connections 2024-09-15T22:36:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.157+0000 7fe5b6e63740 1 -- 172.21.15.22:0/3047878682 wait complete. 2024-09-15T22:36:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.158+0000 7fe5b6e63740 1 -- start start 2024-09-15T22:36:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.158+0000 7fe5b6e63740 1 Processor -- start 2024-09-15T22:36:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838cba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838cba560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838cbb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac06ea10 con 0x556838c92a70 2024-09-15T22:36:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac06fe40 con 0x556838c8e0e0 2024-09-15T22:36:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac06f0a0 con 0x556838c933b0 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b6e63740 10 client.0 _ll_register_callbacks cb 0x7fe5a4009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838cba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838cba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56550/0 (socket says 172.21.15.22:56550) 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b2000640 1 -- 172.21.15.22:0/504113124 learned_addr learned my addr 172.21.15.22:0/504113124 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b2000640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838cbb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838cba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b2000640 1 -- 172.21.15.22:0/504113124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 msgr2=0x556838cbb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.159+0000 7fe5b2000640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838cbb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe5b2000640 1 -- 172.21.15.22:0/504113124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 msgr2=0x556838cba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe5b2000640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838cba560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe5b2000640 1 -- 172.21.15.22:0/504113124 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556838cbbb80 con 0x556838c8e0e0 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe5b2000640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838cba020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe5a405b040 tx=0x7fe5a40303a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=982adddaebed99ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe592a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe592a00640 1 -- 172.21.15.22:0/504113124 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4036040 con 0x556838c8e0e0 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe592a00640 1 -- 172.21.15.22:0/504113124 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fe5a4031440 con 0x556838c8e0e0 2024-09-15T22:36:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.160+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a40046d0 con 0x556838c8e0e0 2024-09-15T22:36:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.161+0000 7fe592a00640 1 -- 172.21.15.22:0/504113124 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5a403e630 con 0x556838c8e0e0 2024-09-15T22:36:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.161+0000 7fe5b6e63740 10 client.25346 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.161+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556838d13180 con 0x556838c8e0e0 2024-09-15T22:36:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe592a00640 1 -- 172.21.15.22:0/504113124 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a40046d0 con 0x556838c8e0e0 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe592a00640 1 -- 172.21.15.22:0/504113124 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe5a406f440 con 0x556838c8e0e0 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe5b6e63740 10 client.25346 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe5b6e63740 10 client.25346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe5b6e63740 20 client.25346 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca2260 0x556838d15a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe5b6e63740 4 client.25346 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.162+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556838bf6b80 con 0x556838ca2260 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.163+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca2260 0x556838d15a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.163+0000 7fe5b0c00640 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca2260 0x556838d15a10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da343f29cf703074 server_cookie=e81ac56ccac75714 in_seq=0 out_seq=0 2024-09-15T22:36:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.163+0000 7fe592a00640 10 client.25346 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe592a00640 1 -- 172.21.15.22:0/504113124 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556838bf6b80 con 0x556838ca2260 2024-09-15T22:36:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe592a00640 10 client.25346 handle_command_reply: tid=0 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe5b6e63740 1 client.25346 shutdown 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 msgr2=0x556838cba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838cba020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe5a405b040 tx=0x7fe5a40303a0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 shutdown_connections 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.177+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x556838ca2260 0x556838d15a10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556838c933b0 0x556838cbb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556838c92a70 0x556838cba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 1 --2- 172.21.15.22:0/504113124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556838c8e0e0 0x556838cba020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe592a00640 0 client.25346 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 >> 172.21.15.22:0/504113124 conn(0x556838c97fd0 msgr2=0x556838c8ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 shutdown_connections 2024-09-15T22:36:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 1 -- 172.21.15.22:0/504113124 wait complete. 2024-09-15T22:36:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.178+0000 7fe5b6e63740 20 client.25346 trim_cache size 0 max 16384 2024-09-15T22:36:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:36:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:36:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:36:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:36:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe5940a3340 msgr2=0x7fe5940a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe5940a3340 0x7fe5940a5800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00984e0 tx=0x7fe5a0098370 comp rx=0 tx=0).stop 2024-09-15T22:36:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac101580 msgr2=0x7fe5ac199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac101580 0x7fe5ac199f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac1029c0 tx=0x7fe5a000ee50 comp rx=0 tx=0).stop 2024-09-15T22:36:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 shutdown_connections 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5ac103050 0x7fe5ac1a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe5940a3340 0x7fe5940a5800 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5ac101f40 0x7fe5ac19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 --2- 172.21.15.22:0/1429286072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5ac101580 0x7fe5ac199f30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 >> 172.21.15.22:0/1429286072 conn(0x7fe5ac0fd0d0 msgr2=0x7fe5ac1083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 shutdown_connections 2024-09-15T22:36:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:18.179+0000 7fe5b2a00640 1 -- 172.21.15.22:0/1429286072 wait complete. 2024-09-15T22:36:19.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:18 smithi022 ceph-mon[30634]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 881 op/s 2024-09-15T22:36:19.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:18 smithi112 ceph-mon[35032]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 881 op/s 2024-09-15T22:36:19.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:18 smithi110 ceph-mon[35282]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 881 op/s 2024-09-15T22:36:21.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:20 smithi022 ceph-mon[30634]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 256 MiB/s wr, 845 op/s 2024-09-15T22:36:21.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:20 smithi112 ceph-mon[35032]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 256 MiB/s wr, 845 op/s 2024-09-15T22:36:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:20 smithi110 ceph-mon[35282]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 256 MiB/s wr, 845 op/s 2024-09-15T22:36:23.256 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:22 smithi110 ceph-mon[35282]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 271 MiB/s wr, 895 op/s 2024-09-15T22:36:23.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:22 smithi022 ceph-mon[30634]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 271 MiB/s wr, 895 op/s 2024-09-15T22:36:23.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:22 smithi112 ceph-mon[35032]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 271 MiB/s wr, 895 op/s 2024-09-15T22:36:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:25 smithi022 ceph-mon[30634]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 257 MiB/s wr, 841 op/s 2024-09-15T22:36:25.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:25 smithi112 ceph-mon[35032]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 257 MiB/s wr, 841 op/s 2024-09-15T22:36:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:25 smithi110 ceph-mon[35282]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 257 MiB/s wr, 841 op/s 2024-09-15T22:36:27.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:27 smithi112 ceph-mon[35032]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 249 MiB/s wr, 824 op/s 2024-09-15T22:36:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:27 smithi110 ceph-mon[35282]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 249 MiB/s wr, 824 op/s 2024-09-15T22:36:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:27 smithi022 ceph-mon[30634]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 249 MiB/s wr, 824 op/s 2024-09-15T22:36:29.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:29 smithi112 ceph-mon[35032]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 877 op/s 2024-09-15T22:36:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:29 smithi110 ceph-mon[35282]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 877 op/s 2024-09-15T22:36:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:29 smithi022 ceph-mon[30634]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 877 op/s 2024-09-15T22:36:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.332+0000 7fcff7e00640 1 -- 172.21.15.22:0/3203669885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0096870 msgr2=0x7fcff0096cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.332+0000 7fcff7e00640 1 --2- 172.21.15.22:0/3203669885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0096870 0x7fcff0096cf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009900 tx=0x7fcfe402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.333+0000 7fcff7e00640 1 -- 172.21.15.22:0/3203669885 shutdown_connections 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.333+0000 7fcff7e00640 1 --2- 172.21.15.22:0/3203669885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff0097230 0x7fcff009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.333+0000 7fcff7e00640 1 --2- 172.21.15.22:0/3203669885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0096870 0x7fcff0096cf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.333+0000 7fcff7e00640 1 --2- 172.21.15.22:0/3203669885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0095680 0x7fcff0095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.333+0000 7fcff7e00640 1 -- 172.21.15.22:0/3203669885 >> 172.21.15.22:0/3203669885 conn(0x7fcff0090dc0 msgr2=0x7fcff0093220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.333+0000 7fcff7e00640 1 -- 172.21.15.22:0/3203669885 shutdown_connections 2024-09-15T22:36:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.334+0000 7fcff7e00640 1 -- 172.21.15.22:0/3203669885 wait complete. 2024-09-15T22:36:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.336+0000 7fcff7e00640 1 Processor -- start 2024-09-15T22:36:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.336+0000 7fcff7e00640 1 -- start start 2024-09-15T22:36:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.336+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff0095680 0x7fcff012dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.336+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 0x7fcff012e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0097230 0x7fcff0135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff7e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00a1300 con 0x7fcff0095680 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00a1180 con 0x7fcff0097230 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00a1480 con 0x7fcff0096870 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff0095680 0x7fcff012dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 0x7fcff012e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 0x7fcff012e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:53890/0 (socket says 172.21.15.22:53890) 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff6000640 1 -- 172.21.15.22:0/752245287 learned_addr learned my addr 172.21.15.22:0/752245287 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff7400640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0097230 0x7fcff0135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff6000640 1 -- 172.21.15.22:0/752245287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0097230 msgr2=0x7fcff0135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.337+0000 7fcff6000640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0097230 0x7fcff0135150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.338+0000 7fcff6000640 1 -- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff0095680 msgr2=0x7fcff012dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.338+0000 7fcff6000640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff0095680 0x7fcff012dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.338+0000 7fcff6000640 1 -- 172.21.15.22:0/752245287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff01357c0 con 0x7fcff0096870 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.338+0000 7fcff6000640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 0x7fcff012e0e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009230 tx=0x7fcfe4031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.338+0000 7fcfef400640 1 -- 172.21.15.22:0/752245287 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe403f030 con 0x7fcff0096870 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.339+0000 7fcfef400640 1 -- 172.21.15.22:0/752245287 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe4003ad0 con 0x7fcff0096870 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.339+0000 7fcfef400640 1 -- 172.21.15.22:0/752245287 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4035070 con 0x7fcff0096870 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.339+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff0135a50 con 0x7fcff0096870 2024-09-15T22:36:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.339+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff0135ef0 con 0x7fcff0096870 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 Processor -- start 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 -- start start 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82eb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82f0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82f0c30 0x5601f82f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601f8250100 con 0x5601f82eb260 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5601f81f81b0 con 0x5601f82f0c30 2024-09-15T22:36:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fd0005ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5601f824c0c0 con 0x5601f82ebba0 2024-09-15T22:36:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fcff6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.343+0000 7fcff7400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:53902/0 (socket says 172.21.15.22:53902) 2024-09-15T22:36:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 -- 172.21.15.22:0/1357171212 learned_addr learned my addr 172.21.15.22:0/1357171212 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 -- 172.21.15.22:0/1357171212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82f0c30 msgr2=0x5601f82f30f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82f0c30 0x5601f82f30f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 -- 172.21.15.22:0/1357171212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 msgr2=0x5601f82eb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82eb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 -- 172.21.15.22:0/1357171212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f7f63210 con 0x5601f82ebba0 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcfef400640 1 -- 172.21.15.22:0/752245287 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fcfe4042030 con 0x7fcff0096870 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.344+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82f0660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009ca0 tx=0x7fcfe8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b68b593c130ff9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.345+0000 7fcfe3400640 1 -- 172.21.15.22:0/1357171212 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8004220 con 0x5601f82ebba0 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.345+0000 7fcfe3400640 1 -- 172.21.15.22:0/1357171212 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe80043c0 con 0x5601f82ebba0 2024-09-15T22:36:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.345+0000 7fcfe3400640 1 -- 172.21.15.22:0/1357171212 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8019970 con 0x5601f82ebba0 2024-09-15T22:36:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 -- 172.21.15.22:0/1357171212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 msgr2=0x5601f82f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82f0660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009ca0 tx=0x7fcfe8011810 comp rx=0 tx=0).stop 2024-09-15T22:36:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fcfef400640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcfdc0a32d0 0x7fcfdc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fcfef400640 1 -- 172.21.15.22:0/752245287 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fcfe40efe20 con 0x7fcff0096870 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 -- 172.21.15.22:0/1357171212 shutdown_connections 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82f0660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82f0c30 0x5601f82f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1357171212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 -- 172.21.15.22:0/1357171212 >> 172.21.15.22:0/1357171212 conn(0x5601f82e68d0 msgr2=0x5601f82e6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 -- 172.21.15.22:0/1357171212 shutdown_connections 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fcff7400640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcfdc0a32d0 0x7fcfdc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.346+0000 7fd0005ef740 1 -- 172.21.15.22:0/1357171212 wait complete. 2024-09-15T22:36:31.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.347+0000 7fd0005ef740 1 -- start start 2024-09-15T22:36:31.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.347+0000 7fd0005ef740 1 Processor -- start 2024-09-15T22:36:31.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.347+0000 7fcff7400640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcfdc0a32d0 0x7fcfdc0a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcff8067ea0 tx=0x7fcff80687a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82ebba0 0x5601f82f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fd0005ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601f82f3c00 con 0x5601f82ebba0 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fd0005ef740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5601f81d9090 con 0x5601f82eb260 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fd0005ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5601f82f3d80 con 0x5601f82f0c30 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fcff7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fcff7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82fc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:53910/0 (socket says 172.21.15.22:53910) 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.349+0000 7fcff7400640 1 -- 172.21.15.22:0/250473582 learned_addr learned my addr 172.21.15.22:0/250473582 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.350+0000 7fcff6a00640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:31 smithi112 ceph-mon[35032]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 246 MiB/s wr, 808 op/s 2024-09-15T22:36:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.350+0000 7fcff6000640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82ebba0 0x5601f82f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fd0005ef740 10 client.0 _ll_register_callbacks cb 0x5601f822df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fcff7400640 1 -- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 msgr2=0x5601f82f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fcff7400640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fcff7400640 1 -- 172.21.15.22:0/250473582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82ebba0 msgr2=0x5601f82f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fcff7400640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82ebba0 0x5601f82f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fcff7400640 1 -- 172.21.15.22:0/250473582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f802f620 con 0x5601f82f0c30 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.351+0000 7fcff6000640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82ebba0 0x5601f82f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.352+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe80043c0 con 0x5601f82f0c30 2024-09-15T22:36:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.353+0000 7fcff7400640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82fc9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcff8067960 tx=0x7fcff8068340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6573431d526210 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.353+0000 7fcfd7e00640 10 client.25363 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:36:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.354+0000 7fcfd7e00640 1 -- 172.21.15.22:0/250473582 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff808d060 con 0x5601f82f0c30 2024-09-15T22:36:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.354+0000 7fcfd7e00640 1 -- 172.21.15.22:0/250473582 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fcff807db10 con 0x5601f82f0c30 2024-09-15T22:36:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.359+0000 7fcfd7e00640 1 -- 172.21.15.22:0/250473582 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcff807dd10 con 0x5601f82f0c30 2024-09-15T22:36:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.360+0000 7fd0005ef740 10 client.25363 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.360+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5601f8310770 con 0x5601f82f0c30 2024-09-15T22:36:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.361+0000 7fcfd7e00640 1 -- 172.21.15.22:0/250473582 <== mon.1 v2:172.21.15.112:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcff80913d0 con 0x5601f82f0c30 2024-09-15T22:36:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.362+0000 7fd0005ef740 10 client.25363 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.363+0000 7fd0005ef740 10 client.25363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.363+0000 7fd0005ef740 20 client.25363 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.364+0000 7fd0005ef740 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f8314130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.364+0000 7fd0005ef740 4 client.25363 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:36:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.364+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601f825d830 con 0x5601f8311ce0 2024-09-15T22:36:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.369+0000 7fcff6a00640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f8314130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.370+0000 7fcff6a00640 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f8314130 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26fc8a237fb0c40d server_cookie=8f3919681e83ee84 in_seq=0 out_seq=0 2024-09-15T22:36:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.370+0000 7fcfd7e00640 10 client.25363 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.370+0000 7fcfd7e00640 1 -- 172.21.15.22:0/250473582 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601f825d830 con 0x5601f8311ce0 2024-09-15T22:36:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.371+0000 7fcfd7e00640 10 client.25363 handle_command_reply: tid=0 2024-09-15T22:36:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.371+0000 7fd0005ef740 1 client.25363 shutdown 2024-09-15T22:36:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.377+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 msgr2=0x5601f82fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.377+0000 7fd0005ef740 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82fc9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcff8067960 tx=0x7fcff8068340 comp rx=0 tx=0).stop 2024-09-15T22:36:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.378+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 shutdown_connections 2024-09-15T22:36:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.379+0000 7fd0005ef740 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f8314130 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.379+0000 7fd0005ef740 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82fc9d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.379+0000 7fcfd7e00640 0 client.25363 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.379+0000 7fd0005ef740 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82ebba0 0x5601f82f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.379+0000 7fd0005ef740 1 --2- 172.21.15.22:0/250473582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.379+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 >> 172.21.15.22:0/250473582 conn(0x5601f82e68d0 msgr2=0x5601f82e80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.380+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 shutdown_connections 2024-09-15T22:36:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.380+0000 7fd0005ef740 1 -- 172.21.15.22:0/250473582 wait complete. 2024-09-15T22:36:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.381+0000 7fd0005ef740 20 client.25363 trim_cache size 0 max 16384 2024-09-15T22:36:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.448+0000 7fd0005ef740 1 Processor -- start 2024-09-15T22:36:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.449+0000 7fd0005ef740 1 -- start start 2024-09-15T22:36:31.455 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.453+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82f5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:31 smithi110 ceph-mon[35282]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 246 MiB/s wr, 808 op/s 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.453+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82ebba0 0x5601f82fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.453+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.454+0000 7fd0005ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcff01416e0 con 0x5601f82eb260 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.454+0000 7fd0005ef740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcff013efb0 con 0x5601f82ebba0 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.454+0000 7fd0005ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcff013cde0 con 0x5601f82f0c30 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.454+0000 7fcff6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.455+0000 7fcff6a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38618/0 (socket says 172.21.15.22:38618) 2024-09-15T22:36:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.455+0000 7fcff6a00640 1 -- 172.21.15.22:0/2827796880 learned_addr learned my addr 172.21.15.22:0/2827796880 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.456+0000 7fcff6000640 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82ebba0 0x5601f82fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.462 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.456+0000 7fcff7400640 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.462+0000 7fcff6000640 1 -- 172.21.15.22:0/2827796880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 msgr2=0x5601f82f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.462+0000 7fcff6000640 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.462+0000 7fcff6000640 1 -- 172.21.15.22:0/2827796880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 msgr2=0x5601f82f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.462+0000 7fcff6000640 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.462+0000 7fcff6000640 1 -- 172.21.15.22:0/2827796880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f82e66f0 con 0x5601f82ebba0 2024-09-15T22:36:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.463+0000 7fcff6000640 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82ebba0 0x5601f82fc990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40ed920 tx=0x7fcfe404a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47d23f4d595175 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:31.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.464+0000 7fcfe2a00640 1 -- 172.21.15.22:0/2827796880 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40d5070 con 0x5601f82ebba0 2024-09-15T22:36:31.467 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.464+0000 7fcfe2a00640 1 -- 172.21.15.22:0/2827796880 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe40c07f0 con 0x5601f82ebba0 2024-09-15T22:36:31.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.464+0000 7fcfe2a00640 1 -- 172.21.15.22:0/2827796880 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4003c80 con 0x5601f82ebba0 2024-09-15T22:36:31.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.467+0000 7fd0005ef740 1 -- 172.21.15.22:0/2827796880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82ebba0 msgr2=0x5601f82fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.467+0000 7fd0005ef740 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82ebba0 0x5601f82fc990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40ed920 tx=0x7fcfe404a000 comp rx=0 tx=0).stop 2024-09-15T22:36:31.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 -- 172.21.15.22:0/2827796880 shutdown_connections 2024-09-15T22:36:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82f0c30 0x5601f82f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82ebba0 0x5601f82fc990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 --2- 172.21.15.22:0/2827796880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82eb260 0x5601f82f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 -- 172.21.15.22:0/2827796880 >> 172.21.15.22:0/2827796880 conn(0x5601f82e68d0 msgr2=0x5601f82f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 -- 172.21.15.22:0/2827796880 shutdown_connections 2024-09-15T22:36:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.468+0000 7fd0005ef740 1 -- 172.21.15.22:0/2827796880 wait complete. 2024-09-15T22:36:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.469+0000 7fd0005ef740 1 -- start start 2024-09-15T22:36:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.470+0000 7fd0005ef740 1 Processor -- start 2024-09-15T22:36:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.470+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.470+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.470+0000 7fd0005ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82f0c30 0x5601f82fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.470+0000 7fd0005ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcff013d470 con 0x5601f82f0c30 2024-09-15T22:36:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fd0005ef740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcff013e8e0 con 0x5601f82eb260 2024-09-15T22:36:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fd0005ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcff013db40 con 0x5601f82ebba0 2024-09-15T22:36:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fd0005ef740 10 client.0 _ll_register_callbacks cb 0x7fcff8050800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fcff6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fcff6000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:53938/0 (socket says 172.21.15.22:53938) 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fcff6000640 1 -- 172.21.15.22:0/1846646509 learned_addr learned my addr 172.21.15.22:0/1846646509 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.471+0000 7fcff7400640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82f0c30 0x5601f82fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6000640 1 -- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 msgr2=0x5601f82f9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6000640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6000640 1 -- 172.21.15.22:0/1846646509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82f0c30 msgr2=0x5601f82fb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6000640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82f0c30 0x5601f82fb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6000640 1 -- 172.21.15.22:0/1846646509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f82fb7f0 con 0x5601f82ebba0 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff7400640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82f0c30 0x5601f82fb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcff6000640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82fa1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b88a0 tx=0x7fcfe40bc500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25ca913614dd45ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.472+0000 7fcfd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.473+0000 7fcfd7e00640 1 -- 172.21.15.22:0/1846646509 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40d5040 con 0x5601f82ebba0 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.473+0000 7fcfd7e00640 1 -- 172.21.15.22:0/1846646509 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fcfe40ba740 con 0x5601f82ebba0 2024-09-15T22:36:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.473+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe40c07f0 con 0x5601f82ebba0 2024-09-15T22:36:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.474+0000 7fcfd7e00640 1 -- 172.21.15.22:0/1846646509 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcfe4003c80 con 0x5601f82ebba0 2024-09-15T22:36:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.474+0000 7fd0005ef740 10 client.25369 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.474+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5601f82fcb00 con 0x5601f82ebba0 2024-09-15T22:36:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fcfd7e00640 1 -- 172.21.15.22:0/1846646509 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe40c07f0 con 0x5601f82ebba0 2024-09-15T22:36:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fcfd7e00640 1 -- 172.21.15.22:0/1846646509 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcfe4031bd0 con 0x5601f82ebba0 2024-09-15T22:36:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fd0005ef740 10 client.25369 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fd0005ef740 10 client.25369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fd0005ef740 20 client.25369 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f83877f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fd0005ef740 4 client.25369 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:36:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.475+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601f8257b80 con 0x5601f8311ce0 2024-09-15T22:36:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.476+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f83877f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.477+0000 7fcff6a00640 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f83877f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6535634f9345276 server_cookie=6c8b9e375253da21 in_seq=0 out_seq=0 2024-09-15T22:36:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.477+0000 7fcfd7e00640 10 client.25369 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.490+0000 7fcfd7e00640 1 -- 172.21.15.22:0/1846646509 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601f8257b80 con 0x5601f8311ce0 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.490+0000 7fcfd7e00640 10 client.25369 handle_command_reply: tid=0 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.490+0000 7fd0005ef740 1 client.25369 shutdown 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 msgr2=0x5601f82fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82fa1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b88a0 tx=0x7fcfe40bc500 comp rx=0 tx=0).stop 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 shutdown_connections 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5601f8311ce0 0x5601f83877f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5601f82ebba0 0x5601f82fa1d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601f82f0c30 0x5601f82fb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 --2- 172.21.15.22:0/1846646509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5601f82eb260 0x5601f82f9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fcfd7e00640 0 client.25369 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 >> 172.21.15.22:0/1846646509 conn(0x5601f82e68d0 msgr2=0x5601f82f51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 shutdown_connections 2024-09-15T22:36:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 1 -- 172.21.15.22:0/1846646509 wait complete. 2024-09-15T22:36:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.491+0000 7fd0005ef740 20 client.25369 trim_cache size 0 max 16384 2024-09-15T22:36:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:36:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:36:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:36:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcfdc0a32d0 msgr2=0x7fcfdc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcfdc0a32d0 0x7fcfdc0a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcff8067ea0 tx=0x7fcff80687a0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 msgr2=0x7fcff012e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 0x7fcff012e0e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009230 tx=0x7fcfe4031b60 comp rx=0 tx=0).stop 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 shutdown_connections 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff0096870 0x7fcff012e0e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fcfdc0a32d0 0x7fcfdc0a5790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff0097230 0x7fcff0135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 --2- 172.21.15.22:0/752245287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcff0095680 0x7fcff012dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 >> 172.21.15.22:0/752245287 conn(0x7fcff0090dc0 msgr2=0x7fcff00069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 shutdown_connections 2024-09-15T22:36:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:31.492+0000 7fcff7e00640 1 -- 172.21.15.22:0/752245287 wait complete. 2024-09-15T22:36:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:31 smithi022 ceph-mon[30634]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 246 MiB/s wr, 808 op/s 2024-09-15T22:36:33.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:33 smithi112 ceph-mon[35032]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 852 op/s 2024-09-15T22:36:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:33 smithi110 ceph-mon[35282]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 852 op/s 2024-09-15T22:36:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:33 smithi022 ceph-mon[30634]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 852 op/s 2024-09-15T22:36:35.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:35 smithi110 ceph-mon[35282]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 255 MiB/s wr, 833 op/s 2024-09-15T22:36:35.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:35 smithi022 ceph-mon[30634]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 255 MiB/s wr, 833 op/s 2024-09-15T22:36:35.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:35 smithi112 ceph-mon[35032]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 255 MiB/s wr, 833 op/s 2024-09-15T22:36:37.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:37 smithi112 ceph-mon[35032]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 829 op/s 2024-09-15T22:36:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:37 smithi110 ceph-mon[35282]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 829 op/s 2024-09-15T22:36:37.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:37 smithi022 ceph-mon[30634]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 829 op/s 2024-09-15T22:36:39.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:39 smithi112 ceph-mon[35032]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 270 MiB/s wr, 888 op/s 2024-09-15T22:36:39.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:39 smithi110 ceph-mon[35282]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 270 MiB/s wr, 888 op/s 2024-09-15T22:36:39.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:39 smithi022 ceph-mon[30634]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 270 MiB/s wr, 888 op/s 2024-09-15T22:36:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:41 smithi110 ceph-mon[35282]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 836 op/s 2024-09-15T22:36:41.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:41 smithi022 ceph-mon[30634]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 836 op/s 2024-09-15T22:36:41.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:41 smithi112 ceph-mon[35032]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 836 op/s 2024-09-15T22:36:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:43 smithi110 ceph-mon[35282]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 273 MiB/s wr, 913 op/s 2024-09-15T22:36:43.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:43 smithi022 ceph-mon[30634]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 273 MiB/s wr, 913 op/s 2024-09-15T22:36:43.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:43 smithi112 ceph-mon[35032]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 273 MiB/s wr, 913 op/s 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.696+0000 7f989b200640 1 -- 172.21.15.22:0/1632361948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 msgr2=0x7f989c1097d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.696+0000 7f989b200640 1 --2- 172.21.15.22:0/1632361948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c1097d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9888009900 tx=0x7f988802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 -- 172.21.15.22:0/1632361948 shutdown_connections 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 --2- 172.21.15.22:0/1632361948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c1097d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 --2- 172.21.15.22:0/1632361948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c109d10 0x7f989c10c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 --2- 172.21.15.22:0/1632361948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c074600 0x7f989c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 -- 172.21.15.22:0/1632361948 >> 172.21.15.22:0/1632361948 conn(0x7f989c0fd0d0 msgr2=0x7f989c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 -- 172.21.15.22:0/1632361948 shutdown_connections 2024-09-15T22:36:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.697+0000 7f989b200640 1 -- 172.21.15.22:0/1632361948 wait complete. 2024-09-15T22:36:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.698+0000 7f989b200640 1 Processor -- start 2024-09-15T22:36:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 -- start start 2024-09-15T22:36:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c074600 0x7f989c19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c109d10 0x7f989c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f989c10f9a0 con 0x7f989c109d10 2024-09-15T22:36:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f989c10f820 con 0x7f989c074600 2024-09-15T22:36:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f989b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f989c10fb20 con 0x7f989c074f40 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.699+0000 7f9899400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c074600 0x7f989c19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c19a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43440/0 (socket says 172.21.15.22:43440) 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 -- 172.21.15.22:0/2938218965 learned_addr learned my addr 172.21.15.22:0/2938218965 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f989a800640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c109d10 0x7f989c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 -- 172.21.15.22:0/2938218965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c074600 msgr2=0x7f989c19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c074600 0x7f989c19a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 -- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c109d10 msgr2=0x7f989c1a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c109d10 0x7f989c1a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 -- 172.21.15.22:0/2938218965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c1a1c20 con 0x7f989c074f40 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f989a800640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c109d10 0x7f989c1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.700+0000 7f9899400640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c19a540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9888031440 tx=0x7f9888032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.701+0000 7f9892a00640 1 -- 172.21.15.22:0/2938218965 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988803f030 con 0x7f989c074f40 2024-09-15T22:36:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.701+0000 7f9892a00640 1 -- 172.21.15.22:0/2938218965 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9888003ce0 con 0x7f989c074f40 2024-09-15T22:36:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.701+0000 7f9892a00640 1 -- 172.21.15.22:0/2938218965 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888035070 con 0x7f989c074f40 2024-09-15T22:36:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.701+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c1a1eb0 con 0x7f989c074f40 2024-09-15T22:36:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.701+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c1a2340 con 0x7f989c074f40 2024-09-15T22:36:44.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.706+0000 7f98a37e1740 1 Processor -- start 2024-09-15T22:36:44.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.706+0000 7f98a37e1740 1 -- start start 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f9892a00640 1 -- 172.21.15.22:0/2938218965 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9888042030 con 0x7f989c074f40 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f98a37e1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bfc4730100 con 0x55bfc47d0c30 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f98a37e1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bfc46d81b0 con 0x55bfc47cb260 2024-09-15T22:36:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f98a37e1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bfc472c0c0 con 0x55bfc47cbba0 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.707+0000 7f9899400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f9899400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47d30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56480/0 (socket says 172.21.15.22:56480) 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f9899400640 1 -- 172.21.15.22:0/798767352 learned_addr learned my addr 172.21.15.22:0/798767352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f9899e00640 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f989a800640 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f9899e00640 1 -- 172.21.15.22:0/798767352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 msgr2=0x55bfc47cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f9899e00640 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.708+0000 7f9899e00640 1 -- 172.21.15.22:0/798767352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 msgr2=0x55bfc47d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.709+0000 7f9892a00640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a32c0 0x7f98800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.710+0000 7f9892a00640 1 -- 172.21.15.22:0/2938218965 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f98880eff10 con 0x7f989c074f40 2024-09-15T22:36:44.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.710+0000 7f9899e00640 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.710+0000 7f9899e00640 1 -- 172.21.15.22:0/798767352 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfc4443210 con 0x55bfc47cbba0 2024-09-15T22:36:44.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.711+0000 7f9899400640 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:36:44.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.711+0000 7f989a800640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a32c0 0x7f98800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.712+0000 7f9899e00640 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47d0660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f988c009c20 tx=0x7f988c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3269684502d429f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.712+0000 7f989a800640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a32c0 0x7f98800a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f989400c530 tx=0x7f989400e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:44.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.713+0000 7f9887000640 1 -- 172.21.15.22:0/798767352 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c004050 con 0x55bfc47cbba0 2024-09-15T22:36:44.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.713+0000 7f9887000640 1 -- 172.21.15.22:0/798767352 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f988c005500 con 0x55bfc47cbba0 2024-09-15T22:36:44.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.713+0000 7f9887000640 1 -- 172.21.15.22:0/798767352 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c004dd0 con 0x55bfc47cbba0 2024-09-15T22:36:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 -- 172.21.15.22:0/798767352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 msgr2=0x55bfc47d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47d0660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f988c009c20 tx=0x7f988c011810 comp rx=0 tx=0).stop 2024-09-15T22:36:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 -- 172.21.15.22:0/798767352 shutdown_connections 2024-09-15T22:36:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47d0660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 --2- 172.21.15.22:0/798767352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 -- 172.21.15.22:0/798767352 >> 172.21.15.22:0/798767352 conn(0x55bfc47c68d0 msgr2=0x55bfc47c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 -- 172.21.15.22:0/798767352 shutdown_connections 2024-09-15T22:36:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.714+0000 7f98a37e1740 1 -- 172.21.15.22:0/798767352 wait complete. 2024-09-15T22:36:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.716+0000 7f98a37e1740 1 -- start start 2024-09-15T22:36:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.716+0000 7f98a37e1740 1 Processor -- start 2024-09-15T22:36:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47ddc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47d0c30 0x55bfc47e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bfc47d3c00 con 0x55bfc47cb260 2024-09-15T22:36:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bfc46b9090 con 0x55bfc47d0c30 2024-09-15T22:36:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bfc47d3d80 con 0x55bfc47cbba0 2024-09-15T22:36:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.717+0000 7f98a37e1740 10 client.0 _ll_register_callbacks cb 0x55bfc470df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47ddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47ddc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56484/0 (socket says 172.21.15.22:56484) 2024-09-15T22:36:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 -- 172.21.15.22:0/3411936862 learned_addr learned my addr 172.21.15.22:0/3411936862 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 -- 172.21.15.22:0/3411936862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 msgr2=0x55bfc47de160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 -- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47d0c30 msgr2=0x55bfc47e51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47d0c30 0x55bfc47e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.718+0000 7f9899e00640 1 -- 172.21.15.22:0/3411936862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfc450f620 con 0x55bfc47cb260 2024-09-15T22:36:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.719+0000 7f9899e00640 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47ddc20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f988c011d10 tx=0x7f988c0044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d2d49639bc8e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.719+0000 7f987b400640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:36:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.720+0000 7f987b400640 1 -- 172.21.15.22:0/3411936862 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c029070 con 0x55bfc47cb260 2024-09-15T22:36:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.721+0000 7f987b400640 1 -- 172.21.15.22:0/3411936862 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f988c004d50 con 0x55bfc47cb260 2024-09-15T22:36:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.721+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988c005500 con 0x55bfc47cb260 2024-09-15T22:36:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.722+0000 7f987b400640 1 -- 172.21.15.22:0/3411936862 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f988c033050 con 0x55bfc47cb260 2024-09-15T22:36:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.722+0000 7f98a37e1740 10 client.15306 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.722+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfc47e7f90 con 0x55bfc47cb260 2024-09-15T22:36:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.723+0000 7f987b400640 1 -- 172.21.15.22:0/3411936862 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f988c005500 con 0x55bfc47cb260 2024-09-15T22:36:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.723+0000 7f987b400640 1 -- 172.21.15.22:0/3411936862 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f988c02e440 con 0x55bfc47cb260 2024-09-15T22:36:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.724+0000 7f98a37e1740 10 client.15306 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.724+0000 7f98a37e1740 10 client.15306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.724+0000 7f98a37e1740 20 client.15306 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.725+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc47e94b0 0x55bfc47eb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.725+0000 7f98a37e1740 4 client.15306 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:36:44.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.725+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfc473d830 con 0x55bfc47e94b0 2024-09-15T22:36:44.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.726+0000 7f9899400640 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc47e94b0 0x55bfc47eb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.727+0000 7f9899400640 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc47e94b0 0x55bfc47eb8e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5996f91da71fbf2b server_cookie=3e22900425b0b1d6 in_seq=0 out_seq=0 2024-09-15T22:36:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.727+0000 7f987b400640 10 client.15306 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.728+0000 7f987b400640 1 -- 172.21.15.22:0/3411936862 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfc473d830 con 0x55bfc47e94b0 2024-09-15T22:36:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.728+0000 7f987b400640 10 client.15306 handle_command_reply: tid=0 2024-09-15T22:36:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.728+0000 7f98a37e1740 1 client.15306 shutdown 2024-09-15T22:36:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.729+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 msgr2=0x55bfc47ddc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.729+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47ddc20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f988c011d10 tx=0x7f988c0044a0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 shutdown_connections 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc47e94b0 0x55bfc47eb8e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47de160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47d0c30 0x55bfc47e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3411936862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47ddc20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 >> 172.21.15.22:0/3411936862 conn(0x55bfc47c68d0 msgr2=0x55bfc47c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f987b400640 0 client.15306 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.731+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 shutdown_connections 2024-09-15T22:36:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.734+0000 7f98a37e1740 1 -- 172.21.15.22:0/3411936862 wait complete. 2024-09-15T22:36:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.734+0000 7f98a37e1740 20 client.15306 trim_cache size 0 max 16384 2024-09-15T22:36:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.802+0000 7f98a37e1740 1 Processor -- start 2024-09-15T22:36:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 -- start start 2024-09-15T22:36:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 0x55bfc47e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47d0c30 0x55bfc47c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1a9530 con 0x55bfc47cb260 2024-09-15T22:36:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1a6e00 con 0x55bfc47cbba0 2024-09-15T22:36:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.805+0000 7f98a37e1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1a4c30 con 0x55bfc47d0c30 2024-09-15T22:36:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.807+0000 7f9899400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 0x55bfc47e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.808+0000 7f9899400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 0x55bfc47e5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:51340/0 (socket says 172.21.15.22:51340) 2024-09-15T22:36:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.808+0000 7f9899400640 1 -- 172.21.15.22:0/3758959565 learned_addr learned my addr 172.21.15.22:0/3758959565 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.808+0000 7f989a800640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47d0c30 0x55bfc47c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.808+0000 7f9899400640 1 -- 172.21.15.22:0/3758959565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47d0c30 msgr2=0x55bfc47c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.809+0000 7f9899400640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47d0c30 0x55bfc47c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.809+0000 7f9899e00640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.809+0000 7f9899400640 1 -- 172.21.15.22:0/3758959565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 msgr2=0x55bfc47c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.809+0000 7f9899400640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.809+0000 7f9899400640 1 -- 172.21.15.22:0/3758959565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfc47c66f0 con 0x55bfc47cbba0 2024-09-15T22:36:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.809+0000 7f989a800640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47d0c30 0x55bfc47c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:36:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.810+0000 7f9899e00640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:36:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.810+0000 7f9899400640 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 0x55bfc47e5160 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9888005c20 tx=0x7f9888009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3875b3b28cfb064f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.811+0000 7f9886600640 1 -- 172.21.15.22:0/3758959565 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880a5020 con 0x55bfc47cbba0 2024-09-15T22:36:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.812+0000 7f9886600640 1 -- 172.21.15.22:0/3758959565 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98880bcbf0 con 0x55bfc47cbba0 2024-09-15T22:36:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.812+0000 7f9886600640 1 -- 172.21.15.22:0/3758959565 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880c5160 con 0x55bfc47cbba0 2024-09-15T22:36:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.815+0000 7f98a37e1740 1 -- 172.21.15.22:0/3758959565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 msgr2=0x55bfc47e5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.816+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 0x55bfc47e5160 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9888005c20 tx=0x7f9888009260 comp rx=0 tx=0).stop 2024-09-15T22:36:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.817+0000 7f98a37e1740 1 -- 172.21.15.22:0/3758959565 shutdown_connections 2024-09-15T22:36:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.817+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47d0c30 0x55bfc47c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.817+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cbba0 0x55bfc47e5160 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.817+0000 7f98a37e1740 1 --2- 172.21.15.22:0/3758959565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47cb260 0x55bfc47c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.818+0000 7f98a37e1740 1 -- 172.21.15.22:0/3758959565 >> 172.21.15.22:0/3758959565 conn(0x55bfc47c68d0 msgr2=0x55bfc47dd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.819+0000 7f98a37e1740 1 -- 172.21.15.22:0/3758959565 shutdown_connections 2024-09-15T22:36:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.819+0000 7f98a37e1740 1 -- 172.21.15.22:0/3758959565 wait complete. 2024-09-15T22:36:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.820+0000 7f98a37e1740 1 -- start start 2024-09-15T22:36:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.821+0000 7f98a37e1740 1 Processor -- start 2024-09-15T22:36:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.827+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.828+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.828+0000 7f98a37e1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47e37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f98a37e1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1a52c0 con 0x55bfc47d0c30 2024-09-15T22:36:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f98a37e1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1a6730 con 0x55bfc47cb260 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f98a37e1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1a5990 con 0x55bfc47cbba0 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f98a37e1740 10 client.0 _ll_register_callbacks cb 0x7f98880f3820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f989a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47e37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f989a800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47e37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56496/0 (socket says 172.21.15.22:56496) 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f989a800640 1 -- 172.21.15.22:0/2068265087 learned_addr learned my addr 172.21.15.22:0/2068265087 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.829+0000 7f9899e00640 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.830+0000 7f989a800640 1 -- 172.21.15.22:0/2068265087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 msgr2=0x55bfc47e27e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.830+0000 7f989a800640 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47e27e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.830+0000 7f989a800640 1 -- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 msgr2=0x55bfc47e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.830+0000 7f989a800640 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47e22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.830+0000 7f989a800640 1 -- 172.21.15.22:0/2068265087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfc47e3e00 con 0x55bfc47d0c30 2024-09-15T22:36:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.831+0000 7f989a800640 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47e37f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9894018fd0 tx=0x7f9894009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631d49dba34459dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.831+0000 7f987b400640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:36:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.833+0000 7f987b400640 1 -- 172.21.15.22:0/2068265087 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940165d0 con 0x55bfc47d0c30 2024-09-15T22:36:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.834+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98880bcbf0 con 0x55bfc47d0c30 2024-09-15T22:36:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.834+0000 7f987b400640 1 -- 172.21.15.22:0/2068265087 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9894016770 con 0x55bfc47d0c30 2024-09-15T22:36:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.834+0000 7f987b400640 1 -- 172.21.15.22:0/2068265087 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9894016970 con 0x55bfc47d0c30 2024-09-15T22:36:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.834+0000 7f98a37e1740 10 client.15309 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.834+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfc47e51d0 con 0x55bfc47d0c30 2024-09-15T22:36:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.843+0000 7f987b400640 1 -- 172.21.15.22:0/2068265087 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98880bcbf0 con 0x55bfc47d0c30 2024-09-15T22:36:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f987b400640 1 -- 172.21.15.22:0/2068265087 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f98940223f0 con 0x55bfc47d0c30 2024-09-15T22:36:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f98a37e1740 10 client.15309 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f98a37e1740 10 client.15309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f98a37e1740 20 client.15309 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f98a37e1740 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc4854720 0x55bfc4856b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f98a37e1740 4 client.15309 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:36:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.844+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfc4737b80 con 0x55bfc4854720 2024-09-15T22:36:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.845+0000 7f9899e00640 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc4854720 0x55bfc4856b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.846+0000 7f9899e00640 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc4854720 0x55bfc4856b40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6bbd14f8e9251f server_cookie=56f15bfd23d86de9 in_seq=0 out_seq=0 2024-09-15T22:36:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.849+0000 7f987b400640 10 client.15309 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.935+0000 7f987b400640 1 -- 172.21.15.22:0/2068265087 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfc4737b80 con 0x55bfc4854720 2024-09-15T22:36:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.935+0000 7f987b400640 10 client.15309 handle_command_reply: tid=0 2024-09-15T22:36:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.935+0000 7f98a37e1740 1 client.15309 shutdown 2024-09-15T22:36:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.950+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 msgr2=0x55bfc47e37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.950+0000 7f98a37e1740 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47e37f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9894018fd0 tx=0x7f9894009850 comp rx=0 tx=0).stop 2024-09-15T22:36:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 shutdown_connections 2024-09-15T22:36:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55bfc4854720 0x55bfc4856b40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bfc47cbba0 0x55bfc47e27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bfc47d0c30 0x55bfc47e37f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 --2- 172.21.15.22:0/2068265087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bfc47cb260 0x55bfc47e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 >> 172.21.15.22:0/2068265087 conn(0x55bfc47c68d0 msgr2=0x55bfc47c51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f987b400640 0 client.15309 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 shutdown_connections 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.953+0000 7f98a37e1740 1 -- 172.21.15.22:0/2068265087 wait complete. 2024-09-15T22:36:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.954+0000 7f98a37e1740 20 client.15309 trim_cache size 0 max 16384 2024-09-15T22:36:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:36:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:36:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:36:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:36:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.956+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a32c0 msgr2=0x7f98800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.956+0000 7f989b200640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a32c0 0x7f98800a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f989400c530 tx=0x7f989400e040 comp rx=0 tx=0).stop 2024-09-15T22:36:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.956+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 msgr2=0x7f989c19a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.956+0000 7f989b200640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c19a540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9888031440 tx=0x7f9888032ce0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.957+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 shutdown_connections 2024-09-15T22:36:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.957+0000 7f989b200640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f989c074f40 0x7f989c19a540 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.957+0000 7f989b200640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f98800a32c0 0x7f98800a5780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.957+0000 7f989b200640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f989c109d10 0x7f989c1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.957+0000 7f989b200640 1 --2- 172.21.15.22:0/2938218965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c074600 0x7f989c19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.957+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 >> 172.21.15.22:0/2938218965 conn(0x7f989c0fd0d0 msgr2=0x7f989c1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.958+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 shutdown_connections 2024-09-15T22:36:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:44.958+0000 7f989b200640 1 -- 172.21.15.22:0/2938218965 wait complete. 2024-09-15T22:36:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:45 smithi110 ceph-mon[35282]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 269 MiB/s wr, 902 op/s 2024-09-15T22:36:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:45 smithi022 ceph-mon[30634]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 269 MiB/s wr, 902 op/s 2024-09-15T22:36:45.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:45 smithi112 ceph-mon[35032]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 269 MiB/s wr, 902 op/s 2024-09-15T22:36:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:47 smithi110 ceph-mon[35282]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 257 MiB/s wr, 875 op/s 2024-09-15T22:36:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:47 smithi022 ceph-mon[30634]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 257 MiB/s wr, 875 op/s 2024-09-15T22:36:47.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:47 smithi112 ceph-mon[35032]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 257 MiB/s wr, 875 op/s 2024-09-15T22:36:48.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:48 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:48.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:48 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:48.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:48 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:49.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:49 smithi110 ceph-mon[35282]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 273 MiB/s wr, 924 op/s 2024-09-15T22:36:49.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:49 smithi022 ceph-mon[30634]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 273 MiB/s wr, 924 op/s 2024-09-15T22:36:49.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:49 smithi112 ceph-mon[35032]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 273 MiB/s wr, 924 op/s 2024-09-15T22:36:50.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:50.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:50.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:36:50.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:50.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:50.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:36:50.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:50.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:50.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:36:51.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:51 smithi112 ceph-mon[35032]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 256 MiB/s wr, 865 op/s 2024-09-15T22:36:51.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:51 smithi110 ceph-mon[35282]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 256 MiB/s wr, 865 op/s 2024-09-15T22:36:52.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:51 smithi022 ceph-mon[30634]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 256 MiB/s wr, 865 op/s 2024-09-15T22:36:53.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:53 smithi112 ceph-mon[35032]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 267 MiB/s wr, 899 op/s 2024-09-15T22:36:53.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:53 smithi110 ceph-mon[35282]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 267 MiB/s wr, 899 op/s 2024-09-15T22:36:54.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:53 smithi022 ceph-mon[30634]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 267 MiB/s wr, 899 op/s 2024-09-15T22:36:55.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:55 smithi110 ceph-mon[35282]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 850 op/s 2024-09-15T22:36:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:55 smithi022 ceph-mon[30634]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 850 op/s 2024-09-15T22:36:56.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:55 smithi112 ceph-mon[35032]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 850 op/s 2024-09-15T22:36:57.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:57 smithi110 ceph-mon[35282]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 244 MiB/s wr, 822 op/s 2024-09-15T22:36:58.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:57 smithi022 ceph-mon[30634]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 244 MiB/s wr, 822 op/s 2024-09-15T22:36:58.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:57 smithi112 ceph-mon[35032]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 244 MiB/s wr, 822 op/s 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 -- 172.21.15.22:0/1278735842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074680 msgr2=0x7f7158074a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 --2- 172.21.15.22:0/1278735842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074680 0x7f7158074a80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7148009900 tx=0x7f714802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 -- 172.21.15.22:0/1278735842 shutdown_connections 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 --2- 172.21.15.22:0/1278735842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 0x7f715810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 --2- 172.21.15.22:0/1278735842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074fc0 0x7f7158109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 --2- 172.21.15.22:0/1278735842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074680 0x7f7158074a80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 -- 172.21.15.22:0/1278735842 >> 172.21.15.22:0/1278735842 conn(0x7f71580fd0d0 msgr2=0x7f71580ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 -- 172.21.15.22:0/1278735842 shutdown_connections 2024-09-15T22:36:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.166+0000 7f715ca00640 1 -- 172.21.15.22:0/1278735842 wait complete. 2024-09-15T22:36:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.167+0000 7f715ca00640 1 Processor -- start 2024-09-15T22:36:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 -- start start 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 0x7f7158199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074fc0 0x7f715819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 0x7f71581a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f715810f8e0 con 0x7f7158109c90 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f715810f760 con 0x7f7158074680 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f715ca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f715810fa60 con 0x7f7158074fc0 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f7156800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 0x7f7158199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f7156800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 0x7f7158199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:41794/0 (socket says 172.21.15.22:41794) 2024-09-15T22:36:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.168+0000 7f7156800640 1 -- 172.21.15.22:0/1839812886 learned_addr learned my addr 172.21.15.22:0/1839812886 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7155e00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074fc0 0x7f715819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7157200640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 0x7f71581a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7156800640 1 -- 172.21.15.22:0/1839812886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074fc0 msgr2=0x7f715819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7156800640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074fc0 0x7f715819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7156800640 1 -- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 msgr2=0x7f71581a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7156800640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 0x7f71581a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7156800640 1 -- 172.21.15.22:0/1839812886 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71581a1be0 con 0x7f7158074680 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7157200640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 0x7f71581a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.169+0000 7f7156800640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 0x7f7158199fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71480314e0 tx=0x7f7148032d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.170+0000 7f714f400640 1 -- 172.21.15.22:0/1839812886 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714803f030 con 0x7f7158074680 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.170+0000 7f714f400640 1 -- 172.21.15.22:0/1839812886 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7148003ce0 con 0x7f7158074680 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.170+0000 7f714f400640 1 -- 172.21.15.22:0/1839812886 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148035070 con 0x7f7158074680 2024-09-15T22:36:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.170+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71581a1e70 con 0x7f7158074680 2024-09-15T22:36:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.170+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71581a2220 con 0x7f7158074680 2024-09-15T22:36:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.173+0000 7f714f400640 1 -- 172.21.15.22:0/1839812886 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7148042030 con 0x7f7158074680 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 Processor -- start 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 -- start start 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 0x55e5763d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2ba0 0x55e5763d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d7c30 0x55e5763da0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e576337100 con 0x55e5763d7c30 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e5762df1b0 con 0x55e5763d2260 2024-09-15T22:36:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f71603eb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e5763330c0 con 0x55e5763d2ba0 2024-09-15T22:36:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.174+0000 7f7157200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 0x55e5763d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2ba0 0x55e5763d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7157200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 0x55e5763d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:41802/0 (socket says 172.21.15.22:41802) 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7157200640 1 -- 172.21.15.22:0/3622357039 learned_addr learned my addr 172.21.15.22:0/3622357039 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7155e00640 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d7c30 0x55e5763da0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 -- 172.21.15.22:0/3622357039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 msgr2=0x55e5763d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 0x55e5763d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 -- 172.21.15.22:0/3622357039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d7c30 msgr2=0x55e5763da0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d7c30 0x55e5763da0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 -- 172.21.15.22:0/3622357039 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57604a210 con 0x55e5763d2ba0 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7157200640 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 0x55e5763d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7155e00640 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d7c30 0x55e5763da0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.175+0000 7f7156800640 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2ba0 0x55e5763d7660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f71480ed620 tx=0x7f71480f3d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2891c53a5239e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.176+0000 7f714f400640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f713c0a32c0 0x7f713c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.176+0000 7f7143400640 1 -- 172.21.15.22:0/3622357039 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480b8440 con 0x55e5763d2ba0 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.176+0000 7f7157200640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f713c0a32c0 0x7f713c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.176+0000 7f7143400640 1 -- 172.21.15.22:0/3622357039 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7148101070 con 0x55e5763d2ba0 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.176+0000 7f7143400640 1 -- 172.21.15.22:0/3622357039 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480bb5f0 con 0x55e5763d2ba0 2024-09-15T22:36:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.176+0000 7f714f400640 1 -- 172.21.15.22:0/1839812886 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f71480efbc0 con 0x7f7158074680 2024-09-15T22:36:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 -- 172.21.15.22:0/3622357039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2ba0 msgr2=0x55e5763d7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f7157200640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f713c0a32c0 0x7f713c0a5780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71500126a0 tx=0x7f7150009790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2ba0 0x55e5763d7660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f71480ed620 tx=0x7f71480f3d80 comp rx=0 tx=0).stop 2024-09-15T22:36:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 -- 172.21.15.22:0/3622357039 shutdown_connections 2024-09-15T22:36:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2ba0 0x55e5763d7660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d7c30 0x55e5763da0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 --2- 172.21.15.22:0/3622357039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2260 0x55e5763d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 -- 172.21.15.22:0/3622357039 >> 172.21.15.22:0/3622357039 conn(0x55e5763cd8d0 msgr2=0x55e5763cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 -- 172.21.15.22:0/3622357039 shutdown_connections 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.177+0000 7f71603eb740 1 -- 172.21.15.22:0/3622357039 wait complete. 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 -- start start 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 Processor -- start 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2260 0x55e5763dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2ba0 0x55e5763dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 0x55e5763e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e5763da9c0 con 0x55e5763d2260 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e5762c0090 con 0x55e5763d2ba0 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e5763dab40 con 0x55e5763d7c30 2024-09-15T22:36:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.178+0000 7f71603eb740 10 client.0 _ll_register_callbacks cb 0x55e576314f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 0x55e5763e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7155e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2ba0 0x55e5763dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 0x55e5763e36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58672/0 (socket says 172.21.15.22:58672) 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 -- 172.21.15.22:0/2630585248 learned_addr learned my addr 172.21.15.22:0/2630585248 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7156800640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2260 0x55e5763dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 -- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2ba0 msgr2=0x55e5763dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2ba0 0x55e5763dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 -- 172.21.15.22:0/2630585248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2260 msgr2=0x55e5763dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2260 0x55e5763dc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7157200640 1 -- 172.21.15.22:0/2630585248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e576116620 con 0x55e5763d7c30 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.179+0000 7f7156800640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2260 0x55e5763dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.180+0000 7f7157200640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 0x55e5763e36b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7150009cb0 tx=0x7f7150004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=568eb5b58c3dc659 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.180+0000 7f7137e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.180+0000 7f7137e00640 1 -- 172.21.15.22:0/2630585248 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150010ea0 con 0x55e5763d7c30 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.180+0000 7f7137e00640 1 -- 172.21.15.22:0/2630585248 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f715000fd50 con 0x55e5763d7c30 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.180+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7148101070 con 0x55e5763d7c30 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.181+0000 7f7137e00640 1 -- 172.21.15.22:0/2630585248 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7150028470 con 0x55e5763d7c30 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.181+0000 7f71603eb740 10 client.25390 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.181+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5763e6570 con 0x55e5763d7c30 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.181+0000 7f7137e00640 1 -- 172.21.15.22:0/2630585248 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7148101070 con 0x55e5763d7c30 2024-09-15T22:36:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f7137e00640 1 -- 172.21.15.22:0/2630585248 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f715001e860 con 0x55e5763d7c30 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f71603eb740 10 client.25390 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f71603eb740 10 client.25390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f71603eb740 20 client.25390 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f71603eb740 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e5763e7c90 0x55e5763ea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f71603eb740 4 client.25390 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.182+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e576344830 con 0x55e5763e7c90 2024-09-15T22:36:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.183+0000 7f7156800640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e5763e7c90 0x55e5763ea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.194+0000 7f7156800640 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e5763e7c90 0x55e5763ea0c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a060ed33f70954 server_cookie=c161169994a46bb8 in_seq=0 out_seq=0 2024-09-15T22:36:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.196+0000 7f7137e00640 10 client.25390 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.198+0000 7f7137e00640 1 -- 172.21.15.22:0/2630585248 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e576344830 con 0x55e5763e7c90 2024-09-15T22:36:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.198+0000 7f7137e00640 10 client.25390 handle_command_reply: tid=0 2024-09-15T22:36:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.198+0000 7f71603eb740 1 client.25390 shutdown 2024-09-15T22:36:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.207+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 msgr2=0x55e5763e36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.207+0000 7f71603eb740 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 0x55e5763e36b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7150009cb0 tx=0x7f7150004a40 comp rx=0 tx=0).stop 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 shutdown_connections 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f71603eb740 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e5763e7c90 0x55e5763ea0c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f71603eb740 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d7c30 0x55e5763e36b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f71603eb740 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d2ba0 0x55e5763dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f71603eb740 1 --2- 172.21.15.22:0/2630585248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2260 0x55e5763dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 >> 172.21.15.22:0/2630585248 conn(0x55e5763cd8d0 msgr2=0x55e5763cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.213+0000 7f7137e00640 0 client.25390 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.214+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 shutdown_connections 2024-09-15T22:36:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.214+0000 7f71603eb740 1 -- 172.21.15.22:0/2630585248 wait complete. 2024-09-15T22:36:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.215+0000 7f71603eb740 20 client.25390 trim_cache size 0 max 16384 2024-09-15T22:36:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.253+0000 7f71603eb740 1 Processor -- start 2024-09-15T22:36:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.253+0000 7f71603eb740 1 -- start start 2024-09-15T22:36:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f71603eb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f71603eb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f71603eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763ee960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f71603eb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71581ad970 con 0x55e5763d2ba0 2024-09-15T22:36:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f71603eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f71581ab240 con 0x55e5763d7c30 2024-09-15T22:36:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f71603eb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71581a9070 con 0x55e5763d2260 2024-09-15T22:36:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f7157200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f7157200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763ee960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:41820/0 (socket says 172.21.15.22:41820) 2024-09-15T22:36:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.254+0000 7f7157200640 1 -- 172.21.15.22:0/3360560324 learned_addr learned my addr 172.21.15.22:0/3360560324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7155e00640 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7156800640 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7155e00640 1 -- 172.21.15.22:0/3360560324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 msgr2=0x55e5763cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7155e00640 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7155e00640 1 -- 172.21.15.22:0/3360560324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 msgr2=0x55e5763ee960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7155e00640 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763ee960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7155e00640 1 -- 172.21.15.22:0/3360560324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5763d33f0 con 0x55e5763d2ba0 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.255+0000 7f7157200640 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.256+0000 7f7155e00640 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e3670 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55e5763ce750 tx=0x7f7144013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb8d6457914d4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.256+0000 7f7142a00640 1 -- 172.21.15.22:0/3360560324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144009d90 con 0x55e5763d2ba0 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.256+0000 7f7142a00640 1 -- 172.21.15.22:0/3360560324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7144005020 con 0x55e5763d2ba0 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.256+0000 7f7142a00640 1 -- 172.21.15.22:0/3360560324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144004bd0 con 0x55e5763d2ba0 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 -- 172.21.15.22:0/3360560324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 msgr2=0x55e5763e3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e3670 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55e5763ce750 tx=0x7f7144013830 comp rx=0 tx=0).stop 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 -- 172.21.15.22:0/3360560324 shutdown_connections 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e3670 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 --2- 172.21.15.22:0/3360560324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.257+0000 7f71603eb740 1 -- 172.21.15.22:0/3360560324 >> 172.21.15.22:0/3360560324 conn(0x55e5763cd8d0 msgr2=0x55e5763cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.258+0000 7f71603eb740 1 -- 172.21.15.22:0/3360560324 shutdown_connections 2024-09-15T22:36:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.259+0000 7f71603eb740 1 -- 172.21.15.22:0/3360560324 wait complete. 2024-09-15T22:36:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.259+0000 7f71603eb740 1 -- start start 2024-09-15T22:36:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.259+0000 7f71603eb740 1 Processor -- start 2024-09-15T22:36:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763e0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71581a9700 con 0x55e5763d2ba0 2024-09-15T22:36:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f71581aab70 con 0x55e5763d7c30 2024-09-15T22:36:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71581a9dd0 con 0x55e5763d2260 2024-09-15T22:36:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f71603eb740 10 client.0 _ll_register_callbacks cb 0x7f71500099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f7157200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f7157200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763e21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:41836/0 (socket says 172.21.15.22:41836) 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f7157200640 1 -- 172.21.15.22:0/244780297 learned_addr learned my addr 172.21.15.22:0/244780297 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f7155e00640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.260+0000 7f7156800640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763e0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7155e00640 1 -- 172.21.15.22:0/244780297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 msgr2=0x55e5763e0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7155e00640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763e0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7155e00640 1 -- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 msgr2=0x55e5763e21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7155e00640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763e21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7155e00640 1 -- 172.21.15.22:0/244780297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5763e27d0 con 0x55e5763d2ba0 2024-09-15T22:36:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7155e00640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e11b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55e5763ce750 tx=0x7f7144009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a4d01a0e25010 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.261+0000 7f7137e00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:36:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.262+0000 7f7137e00640 1 -- 172.21.15.22:0/244780297 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440042d0 con 0x55e5763d2ba0 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.262+0000 7f7137e00640 1 -- 172.21.15.22:0/244780297 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f7144004470 con 0x55e5763d2ba0 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.262+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7144005020 con 0x55e5763d2ba0 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.262+0000 7f7137e00640 1 -- 172.21.15.22:0/244780297 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7144004910 con 0x55e5763d2ba0 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.262+0000 7f71603eb740 10 client.15324 fetch_fsmap learned FSMap version 25 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.262+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e576452940 con 0x55e5763d2ba0 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.263+0000 7f7137e00640 1 -- 172.21.15.22:0/244780297 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7144005020 con 0x55e5763d2ba0 2024-09-15T22:36:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f7137e00640 1 -- 172.21.15.22:0/244780297 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7144004ab0 con 0x55e5763d2ba0 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f71603eb740 10 client.15324 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f71603eb740 10 client.15324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f71603eb740 20 client.15324 populate_metadata read hostname 'smithi022' 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f71603eb740 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e576453190 0x55e5764555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f71603eb740 4 client.15324 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.264+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e57633eb80 con 0x55e576453190 2024-09-15T22:36:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.265+0000 7f7156800640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e576453190 0x55e5764555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.266+0000 7f7156800640 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e576453190 0x55e5764555b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=308de6c02619a89a server_cookie=2fd5fa6852fe9013 in_seq=0 out_seq=0 2024-09-15T22:36:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.266+0000 7f7137e00640 10 client.15324 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.293+0000 7f7137e00640 1 -- 172.21.15.22:0/244780297 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e57633eb80 con 0x55e576453190 2024-09-15T22:36:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.293+0000 7f7137e00640 10 client.15324 handle_command_reply: tid=0 2024-09-15T22:36:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.293+0000 7f71603eb740 1 client.15324 shutdown 2024-09-15T22:36:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 msgr2=0x55e5763e11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e11b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55e5763ce750 tx=0x7f7144009a40 comp rx=0 tx=0).stop 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 shutdown_connections 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e576453190 0x55e5764555b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e5763d7c30 0x55e5763e21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e5763d2ba0 0x55e5763e11b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 --2- 172.21.15.22:0/244780297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e5763d2260 0x55e5763e0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 >> 172.21.15.22:0/244780297 conn(0x55e5763cd8d0 msgr2=0x55e5763cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.294+0000 7f7137e00640 0 client.15324 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:36:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.295+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 shutdown_connections 2024-09-15T22:36:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.295+0000 7f71603eb740 1 -- 172.21.15.22:0/244780297 wait complete. 2024-09-15T22:36:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.295+0000 7f71603eb740 20 client.15324 trim_cache size 0 max 16384 2024-09-15T22:36:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:36:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:36:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:36:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:36:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f713c0a32c0 msgr2=0x7f713c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f713c0a32c0 0x7f713c0a5780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71500126a0 tx=0x7f7150009790 comp rx=0 tx=0).stop 2024-09-15T22:36:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 msgr2=0x7f7158199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 0x7f7158199fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71480314e0 tx=0x7f7148032d90 comp rx=0 tx=0).stop 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 shutdown_connections 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7158074fc0 0x7f715819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f713c0a32c0 0x7f713c0a5780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7158109c90 0x7f71581a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 --2- 172.21.15.22:0/1839812886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7158074680 0x7f7158199fc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.298+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 >> 172.21.15.22:0/1839812886 conn(0x7f71580fd0d0 msgr2=0x7f7158105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.299+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 shutdown_connections 2024-09-15T22:36:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:36:58.299+0000 7f715ca00640 1 -- 172.21.15.22:0/1839812886 wait complete. 2024-09-15T22:36:59.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:36:59 smithi110 ceph-mon[35282]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 888 op/s 2024-09-15T22:37:00.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:36:59 smithi022 ceph-mon[30634]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 888 op/s 2024-09-15T22:37:00.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:36:59 smithi112 ceph-mon[35032]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 888 op/s 2024-09-15T22:37:01.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:00 smithi022 ceph-mon[30634]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 823 op/s 2024-09-15T22:37:01.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:00 smithi112 ceph-mon[35032]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 823 op/s 2024-09-15T22:37:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:00 smithi110 ceph-mon[35282]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 823 op/s 2024-09-15T22:37:03.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:02 smithi022 ceph-mon[30634]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 866 op/s 2024-09-15T22:37:03.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:02 smithi112 ceph-mon[35032]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 866 op/s 2024-09-15T22:37:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:02 smithi110 ceph-mon[35282]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 866 op/s 2024-09-15T22:37:05.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:04 smithi022 ceph-mon[30634]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 MiB/s wr, 856 op/s 2024-09-15T22:37:05.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:04 smithi112 ceph-mon[35032]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 MiB/s wr, 856 op/s 2024-09-15T22:37:05.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:04 smithi110 ceph-mon[35282]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 MiB/s wr, 856 op/s 2024-09-15T22:37:07.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:06 smithi022 ceph-mon[30634]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 826 op/s 2024-09-15T22:37:07.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:06 smithi112 ceph-mon[35032]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 826 op/s 2024-09-15T22:37:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:06 smithi110 ceph-mon[35282]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 826 op/s 2024-09-15T22:37:09.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:08 smithi022 ceph-mon[30634]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 883 op/s 2024-09-15T22:37:09.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:08 smithi112 ceph-mon[35032]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 883 op/s 2024-09-15T22:37:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:08 smithi110 ceph-mon[35282]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 883 op/s 2024-09-15T22:37:11.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:10 smithi022 ceph-mon[30634]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 250 MiB/s wr, 824 op/s 2024-09-15T22:37:11.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:10 smithi112 ceph-mon[35032]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 250 MiB/s wr, 824 op/s 2024-09-15T22:37:11.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:10 smithi110 ceph-mon[35282]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 250 MiB/s wr, 824 op/s 2024-09-15T22:37:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.521+0000 7ff446200640 1 -- 172.21.15.22:0/1546216595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440108410 msgr2=0x7ff440108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.521+0000 7ff446200640 1 --2- 172.21.15.22:0/1546216595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440108410 0x7ff440108810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff438009ca0 tx=0x7ff43802a8b0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.523+0000 7ff446200640 1 -- 172.21.15.22:0/1546216595 shutdown_connections 2024-09-15T22:37:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.523+0000 7ff446200640 1 --2- 172.21.15.22:0/1546216595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff440109b30 0x7ff4401103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.523+0000 7ff446200640 1 --2- 172.21.15.22:0/1546216595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 0x7ff4401095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.523+0000 7ff446200640 1 --2- 172.21.15.22:0/1546216595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440108410 0x7ff440108810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.523+0000 7ff446200640 1 -- 172.21.15.22:0/1546216595 >> 172.21.15.22:0/1546216595 conn(0x7ff440077200 msgr2=0x7ff440079640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.523+0000 7ff446200640 1 -- 172.21.15.22:0/1546216595 shutdown_connections 2024-09-15T22:37:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.525+0000 7ff446200640 1 -- 172.21.15.22:0/1546216595 wait complete. 2024-09-15T22:37:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.527+0000 7ff446200640 1 Processor -- start 2024-09-15T22:37:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.528+0000 7ff446200640 1 -- start start 2024-09-15T22:37:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.531+0000 7ff446200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff440108410 0x7ff44019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.532+0000 7ff446200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 0x7ff44019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.533+0000 7ff446200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 0x7ff4401a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.533+0000 7ff446200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff440113c40 con 0x7ff440109170 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.533+0000 7ff446200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff440113ac0 con 0x7ff440109b30 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.533+0000 7ff446200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff440113dc0 con 0x7ff440108410 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.532+0000 7ff444e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff440108410 0x7ff44019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.534+0000 7ff445800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 0x7ff4401a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.534+0000 7ff445800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 0x7ff4401a58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:49260/0 (socket says 172.21.15.22:49260) 2024-09-15T22:37:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.534+0000 7ff445800640 1 -- 172.21.15.22:0/2392731382 learned_addr learned my addr 172.21.15.22:0/2392731382 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.536+0000 7ff445800640 1 -- 172.21.15.22:0/2392731382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff440108410 msgr2=0x7ff44019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.536+0000 7ff445800640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff440108410 0x7ff44019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.536+0000 7ff445800640 1 -- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 msgr2=0x7ff44019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.536+0000 7ff43fe00640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 0x7ff44019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.537+0000 7ff445800640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 0x7ff44019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.537+0000 7ff445800640 1 -- 172.21.15.22:0/2392731382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4401a5f40 con 0x7ff440109b30 2024-09-15T22:37:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.538+0000 7ff43fe00640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 0x7ff44019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:37:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.539+0000 7ff445800640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 0x7ff4401a58d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00d750 tx=0x7ff42c00dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.541+0000 7ff43d600640 1 -- 172.21.15.22:0/2392731382 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c017070 con 0x7ff440109b30 2024-09-15T22:37:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.541+0000 7ff43d600640 1 -- 172.21.15.22:0/2392731382 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff42c005500 con 0x7ff440109b30 2024-09-15T22:37:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.542+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4401a6230 con 0x7ff440109b30 2024-09-15T22:37:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.542+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4401a6780 con 0x7ff440109b30 2024-09-15T22:37:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.542+0000 7ff43d600640 1 -- 172.21.15.22:0/2392731382 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c017070 con 0x7ff440109b30 2024-09-15T22:37:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.552+0000 7ff44a5ec740 1 Processor -- start 2024-09-15T22:37:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.555+0000 7ff43d600640 1 -- 172.21.15.22:0/2392731382 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff42c004b90 con 0x7ff440109b30 2024-09-15T22:37:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.556+0000 7ff44a5ec740 1 -- start start 2024-09-15T22:37:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.557+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8496e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.557+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 0x559d84973660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.557+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d849760f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.557+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d848d3100 con 0x559d8496eba0 2024-09-15T22:37:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.557+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559d8487b1b0 con 0x559d84973c30 2024-09-15T22:37:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.557+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559d848cf0c0 con 0x559d8496e260 2024-09-15T22:37:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.558+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8496e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.558+0000 7ff444e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 0x559d84973660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.558+0000 7ff444e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 0x559d84973660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59076/0 (socket says 172.21.15.22:59076) 2024-09-15T22:37:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.558+0000 7ff444e00640 1 -- 172.21.15.22:0/2997342491 learned_addr learned my addr 172.21.15.22:0/2997342491 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.559+0000 7ff43d600640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4240a3540 0x7ff4240a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.559+0000 7ff444e00640 1 -- 172.21.15.22:0/2997342491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 msgr2=0x559d8496e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.559+0000 7ff444e00640 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8496e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.559+0000 7ff444e00640 1 -- 172.21.15.22:0/2997342491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 msgr2=0x559d849760f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.559+0000 7ff444e00640 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d849760f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.559+0000 7ff444e00640 1 -- 172.21.15.22:0/2997342491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d845e6210 con 0x559d8496eba0 2024-09-15T22:37:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.560+0000 7ff43d600640 1 -- 172.21.15.22:0/2392731382 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff42c0ceec0 con 0x7ff440109b30 2024-09-15T22:37:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.560+0000 7ff444e00640 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 0x559d84973660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff438035000 tx=0x7ff438005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d95817c8e7ac522 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.561+0000 7ff445800640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4240a3540 0x7ff4240a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.561+0000 7ff436000640 1 -- 172.21.15.22:0/2997342491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438030d30 con 0x559d8496eba0 2024-09-15T22:37:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.562+0000 7ff445800640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4240a3540 0x7ff4240a5a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff42c09b430 tx=0x7ff42c097740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.562+0000 7ff436000640 1 -- 172.21.15.22:0/2997342491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff438036040 con 0x559d8496eba0 2024-09-15T22:37:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.562+0000 7ff436000640 1 -- 172.21.15.22:0/2997342491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438004410 con 0x559d8496eba0 2024-09-15T22:37:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2997342491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 msgr2=0x559d84973660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 0x559d84973660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff438035000 tx=0x7ff438005d80 comp rx=0 tx=0).stop 2024-09-15T22:37:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2997342491 shutdown_connections 2024-09-15T22:37:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d849760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496eba0 0x559d84973660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2997342491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8496e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.563+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2997342491 >> 172.21.15.22:0/2997342491 conn(0x559d849698d0 msgr2=0x559d84969cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.565+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2997342491 shutdown_connections 2024-09-15T22:37:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.565+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2997342491 wait complete. 2024-09-15T22:37:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.566+0000 7ff44a5ec740 1 -- start start 2024-09-15T22:37:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.566+0000 7ff44a5ec740 1 Processor -- start 2024-09-15T22:37:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496e260 0x559d849783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 0x559d84978930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d84973c30 0x559d8497f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d84976bf0 con 0x559d84973c30 2024-09-15T22:37:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559d8485c090 con 0x559d8496e260 2024-09-15T22:37:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559d84976d70 con 0x559d8496eba0 2024-09-15T22:37:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.567+0000 7ff44a5ec740 10 client.0 _ll_register_callbacks cb 0x559d848b0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.568+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d84973c30 0x559d8497f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.569+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496e260 0x559d849783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.569+0000 7ff444e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 0x559d84978930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.569+0000 7ff444e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 0x559d84978930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46606/0 (socket says 172.21.15.22:46606) 2024-09-15T22:37:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.569+0000 7ff444e00640 1 -- 172.21.15.22:0/2854563992 learned_addr learned my addr 172.21.15.22:0/2854563992 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.570+0000 7ff444e00640 1 -- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496e260 msgr2=0x559d849783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.570+0000 7ff444e00640 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496e260 0x559d849783f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.570+0000 7ff444e00640 1 -- 172.21.15.22:0/2854563992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d84973c30 msgr2=0x559d8497f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.570+0000 7ff444e00640 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d84973c30 0x559d8497f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.570+0000 7ff444e00640 1 -- 172.21.15.22:0/2854563992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d846b2620 con 0x559d8496eba0 2024-09-15T22:37:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.570+0000 7ff444e00640 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 0x559d84978930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff438006010 tx=0x7ff438003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=767d52eee1ac07df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.571+0000 7ff42aa00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:37:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.571+0000 7ff42aa00640 1 -- 172.21.15.22:0/2854563992 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43804a040 con 0x559d8496eba0 2024-09-15T22:37:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.571+0000 7ff42aa00640 1 -- 172.21.15.22:0/2854563992 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff438030ab0 con 0x559d8496eba0 2024-09-15T22:37:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.572+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff438036040 con 0x559d8496eba0 2024-09-15T22:37:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.572+0000 7ff42aa00640 1 -- 172.21.15.22:0/2854563992 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff438003970 con 0x559d8496eba0 2024-09-15T22:37:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.572+0000 7ff44a5ec740 10 client.25405 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.572+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d84976c20 con 0x559d8496eba0 2024-09-15T22:37:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.574+0000 7ff42aa00640 1 -- 172.21.15.22:0/2854563992 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff438036040 con 0x559d8496eba0 2024-09-15T22:37:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.574+0000 7ff42aa00640 1 -- 172.21.15.22:0/2854563992 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff43804d070 con 0x559d8496eba0 2024-09-15T22:37:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.577+0000 7ff44a5ec740 10 client.25405 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.577+0000 7ff44a5ec740 10 client.25405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.577+0000 7ff44a5ec740 20 client.25405 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.577+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84994b20 0x559d84996f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.577+0000 7ff44a5ec740 4 client.25405 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:37:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.577+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d848e0830 con 0x559d84994b20 2024-09-15T22:37:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.578+0000 7ff43fe00640 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84994b20 0x559d84996f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.578+0000 7ff43fe00640 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84994b20 0x559d84996f10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8725082083df5110 server_cookie=ce585592d95659a4 in_seq=0 out_seq=0 2024-09-15T22:37:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.579+0000 7ff42aa00640 10 client.25405 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.579+0000 7ff42aa00640 1 -- 172.21.15.22:0/2854563992 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d848e0830 con 0x559d84994b20 2024-09-15T22:37:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.580+0000 7ff42aa00640 10 client.25405 handle_command_reply: tid=0 2024-09-15T22:37:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.580+0000 7ff44a5ec740 1 client.25405 shutdown 2024-09-15T22:37:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.580+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 msgr2=0x559d84978930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.580+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 0x559d84978930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff438006010 tx=0x7ff438003ed0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.580+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 shutdown_connections 2024-09-15T22:37:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.580+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84994b20 0x559d84996f10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.581+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496eba0 0x559d84978930 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff438006010 tx=0x7ff438003ed0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.581+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d84973c30 0x559d8497f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.581+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/2854563992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496e260 0x559d849783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.581+0000 7ff42aa00640 0 client.25405 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.581+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 >> 172.21.15.22:0/2854563992 conn(0x559d849698d0 msgr2=0x559d8496b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.582+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 shutdown_connections 2024-09-15T22:37:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.583+0000 7ff44a5ec740 1 -- 172.21.15.22:0/2854563992 wait complete. 2024-09-15T22:37:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.583+0000 7ff44a5ec740 20 client.25405 trim_cache size 0 max 16384 2024-09-15T22:37:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.628+0000 7ff44a5ec740 1 Processor -- start 2024-09-15T22:37:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.628+0000 7ff44a5ec740 1 -- start start 2024-09-15T22:37:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.628+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496e260 0x559d84969cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.628+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d84973c30 0x559d8497f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.629+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 0x559d8496a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.629+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff420010ea0 con 0x559d8496e260 2024-09-15T22:37:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.629+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff42000e770 con 0x559d8496a1f0 2024-09-15T22:37:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.629+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff42000c5a0 con 0x559d84973c30 2024-09-15T22:37:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.633+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 0x559d8496a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.633+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 0x559d8496a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:49294/0 (socket says 172.21.15.22:49294) 2024-09-15T22:37:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.633+0000 7ff43fe00640 1 -- 172.21.15.22:0/3366009721 learned_addr learned my addr 172.21.15.22:0/3366009721 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.633+0000 7ff43fe00640 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496e260 0x559d84969cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.634+0000 7ff444e00640 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d84973c30 0x559d8497f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.634+0000 7ff43fe00640 1 -- 172.21.15.22:0/3366009721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d84973c30 msgr2=0x559d8497f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.634+0000 7ff43fe00640 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d84973c30 0x559d8497f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.634+0000 7ff43fe00640 1 -- 172.21.15.22:0/3366009721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496e260 msgr2=0x559d84969cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.635+0000 7ff43fe00640 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496e260 0x559d84969cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.635+0000 7ff43fe00640 1 -- 172.21.15.22:0/3366009721 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d84979270 con 0x559d8496a1f0 2024-09-15T22:37:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.635+0000 7ff43fe00640 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 0x559d8496a650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff430009f50 tx=0x7ff4300093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffa0bfb326a923f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.636+0000 7ff435600640 1 -- 172.21.15.22:0/3366009721 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43001c040 con 0x559d8496a1f0 2024-09-15T22:37:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.636+0000 7ff435600640 1 -- 172.21.15.22:0/3366009721 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff430005500 con 0x559d8496a1f0 2024-09-15T22:37:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.636+0000 7ff435600640 1 -- 172.21.15.22:0/3366009721 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4300035f0 con 0x559d8496a1f0 2024-09-15T22:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.641+0000 7ff44a5ec740 1 -- 172.21.15.22:0/3366009721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 msgr2=0x559d8496a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.641+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 0x559d8496a650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff430009f50 tx=0x7ff4300093b0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.643+0000 7ff44a5ec740 1 -- 172.21.15.22:0/3366009721 shutdown_connections 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.643+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d84973c30 0x559d8497f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.643+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d8496a1f0 0x559d8496a650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.643+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/3366009721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496e260 0x559d84969cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.643+0000 7ff44a5ec740 1 -- 172.21.15.22:0/3366009721 >> 172.21.15.22:0/3366009721 conn(0x559d849698d0 msgr2=0x559d84977a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.644+0000 7ff44a5ec740 1 -- 172.21.15.22:0/3366009721 shutdown_connections 2024-09-15T22:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.644+0000 7ff44a5ec740 1 -- 172.21.15.22:0/3366009721 wait complete. 2024-09-15T22:37:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.646+0000 7ff44a5ec740 1 -- start start 2024-09-15T22:37:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.649+0000 7ff44a5ec740 1 Processor -- start 2024-09-15T22:37:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496a1f0 0x559d8497d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8497d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d8497e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff42000cc30 con 0x559d8496a1f0 2024-09-15T22:37:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff42000e0a0 con 0x559d84973c30 2024-09-15T22:37:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff42000d300 con 0x559d8496e260 2024-09-15T22:37:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.650+0000 7ff44a5ec740 10 client.0 _ll_register_callbacks cb 0x7ff438009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.651+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496a1f0 0x559d8497d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.651+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496a1f0 0x559d8497d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59092/0 (socket says 172.21.15.22:59092) 2024-09-15T22:37:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.651+0000 7ff43fe00640 1 -- 172.21.15.22:0/1557779515 learned_addr learned my addr 172.21.15.22:0/1557779515 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.652+0000 7ff444e00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8497d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.652+0000 7ff43fe00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d8497e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.653+0000 7ff444e00640 1 -- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 msgr2=0x559d8497e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.653+0000 7ff444e00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d8497e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.653+0000 7ff444e00640 1 -- 172.21.15.22:0/1557779515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496a1f0 msgr2=0x559d8497d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.654+0000 7ff444e00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496a1f0 0x559d8497d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.654+0000 7ff444e00640 1 -- 172.21.15.22:0/1557779515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d8497ed20 con 0x559d8496e260 2024-09-15T22:37:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.655+0000 7ff444e00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8497d750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff43803d000 tx=0x7ff4380095d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=253637158012b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.655+0000 7ff42aa00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:37:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.655+0000 7ff42aa00640 1 -- 172.21.15.22:0/1557779515 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43805f070 con 0x559d8496e260 2024-09-15T22:37:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.656+0000 7ff42aa00640 1 -- 172.21.15.22:0/1557779515 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff438053070 con 0x559d8496e260 2024-09-15T22:37:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.656+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff430005500 con 0x559d8496e260 2024-09-15T22:37:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.656+0000 7ff42aa00640 1 -- 172.21.15.22:0/1557779515 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff438005cb0 con 0x559d8496e260 2024-09-15T22:37:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.657+0000 7ff44a5ec740 10 client.25408 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.657+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d84a10940 con 0x559d8496e260 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.657+0000 7ff42aa00640 1 -- 172.21.15.22:0/1557779515 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff438005cb0 con 0x559d8496e260 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.658+0000 7ff42aa00640 1 -- 172.21.15.22:0/1557779515 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff438062030 con 0x559d8496e260 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.659+0000 7ff44a5ec740 10 client.25408 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.659+0000 7ff44a5ec740 10 client.25408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.659+0000 7ff44a5ec740 20 client.25408 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.659+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84a11280 0x559d84a13670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.659+0000 7ff44a5ec740 4 client.25408 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:37:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.659+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d848dab80 con 0x559d84a11280 2024-09-15T22:37:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.660+0000 7ff43fe00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84a11280 0x559d84a13670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.661+0000 7ff43fe00640 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84a11280 0x559d84a13670 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d27786038023efe3 server_cookie=cdf506f36b6600a3 in_seq=0 out_seq=0 2024-09-15T22:37:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.661+0000 7ff42aa00640 10 client.25408 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff42aa00640 1 -- 172.21.15.22:0/1557779515 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d848dab80 con 0x559d84a11280 2024-09-15T22:37:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff42aa00640 10 client.25408 handle_command_reply: tid=0 2024-09-15T22:37:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 client.25408 shutdown 2024-09-15T22:37:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 msgr2=0x559d8497d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8497d750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff43803d000 tx=0x7ff4380095d0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 shutdown_connections 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d84a11280 0x559d84a13670 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d8496e260 0x559d8497d750 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d84973c30 0x559d8497e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 --2- 172.21.15.22:0/1557779515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d8496a1f0 0x559d8497d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 >> 172.21.15.22:0/1557779515 conn(0x559d849698d0 msgr2=0x559d849771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.688+0000 7ff42aa00640 0 client.25408 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.689+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 shutdown_connections 2024-09-15T22:37:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.689+0000 7ff44a5ec740 1 -- 172.21.15.22:0/1557779515 wait complete. 2024-09-15T22:37:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.689+0000 7ff44a5ec740 20 client.25408 trim_cache size 0 max 16384 2024-09-15T22:37:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:37:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:37:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:37:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4240a3540 msgr2=0x7ff4240a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4240a3540 0x7ff4240a5a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff42c09b430 tx=0x7ff42c097740 comp rx=0 tx=0).stop 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 msgr2=0x7ff4401a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 0x7ff4401a58d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00d750 tx=0x7ff42c00dc10 comp rx=0 tx=0).stop 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 shutdown_connections 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff4240a3540 0x7ff4240a5a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff440109b30 0x7ff4401a58d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440109170 0x7ff44019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 --2- 172.21.15.22:0/2392731382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff440108410 0x7ff44019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.690+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 >> 172.21.15.22:0/2392731382 conn(0x7ff440077200 msgr2=0x7ff44010c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.691+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 shutdown_connections 2024-09-15T22:37:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:11.691+0000 7ff446200640 1 -- 172.21.15.22:0/2392731382 wait complete. 2024-09-15T22:37:13.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:12 smithi022 ceph-mon[30634]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 262 MiB/s wr, 868 op/s 2024-09-15T22:37:13.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:12 smithi112 ceph-mon[35032]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 262 MiB/s wr, 868 op/s 2024-09-15T22:37:13.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:12 smithi110 ceph-mon[35282]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 262 MiB/s wr, 868 op/s 2024-09-15T22:37:15.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:14 smithi022 ceph-mon[30634]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 259 MiB/s wr, 869 op/s 2024-09-15T22:37:15.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:14 smithi112 ceph-mon[35032]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 259 MiB/s wr, 869 op/s 2024-09-15T22:37:15.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:14 smithi110 ceph-mon[35282]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 259 MiB/s wr, 869 op/s 2024-09-15T22:37:17.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:16 smithi022 ceph-mon[30634]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 855 op/s 2024-09-15T22:37:17.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:16 smithi112 ceph-mon[35032]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 855 op/s 2024-09-15T22:37:17.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:16 smithi110 ceph-mon[35282]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 855 op/s 2024-09-15T22:37:19.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:18 smithi022 ceph-mon[30634]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 274 MiB/s wr, 934 op/s 2024-09-15T22:37:19.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:18 smithi112 ceph-mon[35032]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 274 MiB/s wr, 934 op/s 2024-09-15T22:37:19.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:18 smithi110 ceph-mon[35282]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 274 MiB/s wr, 934 op/s 2024-09-15T22:37:21.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:20 smithi112 ceph-mon[35032]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 862 op/s 2024-09-15T22:37:21.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:20 smithi110 ceph-mon[35282]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 862 op/s 2024-09-15T22:37:21.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:20 smithi022 ceph-mon[30634]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 862 op/s 2024-09-15T22:37:23.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:22 smithi112 ceph-mon[35032]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 264 MiB/s wr, 910 op/s 2024-09-15T22:37:23.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:22 smithi110 ceph-mon[35282]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 264 MiB/s wr, 910 op/s 2024-09-15T22:37:23.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:22 smithi022 ceph-mon[30634]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 264 MiB/s wr, 910 op/s 2024-09-15T22:37:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.855+0000 7fd51da00640 1 -- 172.21.15.22:0/2346385205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518072cb0 msgr2=0x7fd5180730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.855+0000 7fd51da00640 1 --2- 172.21.15.22:0/2346385205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518072cb0 0x7fd5180730b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd510009890 tx=0x7fd51002a370 comp rx=0 tx=0).stop 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 -- 172.21.15.22:0/2346385205 shutdown_connections 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 --2- 172.21.15.22:0/2346385205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd518073680 0x7fd51810d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 --2- 172.21.15.22:0/2346385205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd51810dbb0 0x7fd518110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 --2- 172.21.15.22:0/2346385205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518072cb0 0x7fd5180730b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 -- 172.21.15.22:0/2346385205 >> 172.21.15.22:0/2346385205 conn(0x7fd51806eb50 msgr2=0x7fd518070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 -- 172.21.15.22:0/2346385205 shutdown_connections 2024-09-15T22:37:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.860+0000 7fd51da00640 1 -- 172.21.15.22:0/2346385205 wait complete. 2024-09-15T22:37:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.862+0000 7fd51da00640 1 Processor -- start 2024-09-15T22:37:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.862+0000 7fd51da00640 1 -- start start 2024-09-15T22:37:24.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.865+0000 7fd51da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd518072cb0 0x7fd51819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.865+0000 7fd51da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 0x7fd51819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.865+0000 7fd51da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd51810dbb0 0x7fd5181a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.865+0000 7fd51da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181135a0 con 0x7fd518072cb0 2024-09-15T22:37:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.865+0000 7fd51da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd518113420 con 0x7fd518073680 2024-09-15T22:37:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.865+0000 7fd51da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd518113720 con 0x7fd51810dbb0 2024-09-15T22:37:24.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.866+0000 7fd517400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 0x7fd51819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd51d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd51810dbb0 0x7fd5181a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd517400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 0x7fd51819ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55548/0 (socket says 172.21.15.22:55548) 2024-09-15T22:37:24.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd517400640 1 -- 172.21.15.22:0/2805630371 learned_addr learned my addr 172.21.15.22:0/2805630371 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:24.869 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd517400640 1 -- 172.21.15.22:0/2805630371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd51810dbb0 msgr2=0x7fd5181a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd517400640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd51810dbb0 0x7fd5181a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd517400640 1 -- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd518072cb0 msgr2=0x7fd51819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.868+0000 7fd517400640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd518072cb0 0x7fd51819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.869+0000 7fd517400640 1 -- 172.21.15.22:0/2805630371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5181a5f60 con 0x7fd518073680 2024-09-15T22:37:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.869+0000 7fd517400640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 0x7fd51819ec30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd50800eb90 tx=0x7fd50800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.870+0000 7fd514c00640 1 -- 172.21.15.22:0/2805630371 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508010630 con 0x7fd518073680 2024-09-15T22:37:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.870+0000 7fd514c00640 1 -- 172.21.15.22:0/2805630371 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd50800ee90 con 0x7fd518073680 2024-09-15T22:37:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.870+0000 7fd514c00640 1 -- 172.21.15.22:0/2805630371 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508018b90 con 0x7fd518073680 2024-09-15T22:37:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.870+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5181a6250 con 0x7fd518073680 2024-09-15T22:37:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.871+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5181a6750 con 0x7fd518073680 2024-09-15T22:37:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.877+0000 7fd521fd6740 1 Processor -- start 2024-09-15T22:37:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.877+0000 7fd521fd6740 1 -- start start 2024-09-15T22:37:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd514c00640 1 -- 172.21.15.22:0/2805630371 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd508004a40 con 0x7fd518073680 2024-09-15T22:37:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb14660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb14ba0 0x563eefb19660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 0x563eefb1c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd521fd6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563eefa79100 con 0x563eefb14260 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd521fd6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563eefa211b0 con 0x563eefb14ba0 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.878+0000 7fd521fd6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563eefa750c0 con 0x563eefb19c30 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.879+0000 7fd517400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 0x563eefb1c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.879+0000 7fd517400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 0x563eefb1c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:34752/0 (socket says 172.21.15.22:34752) 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.879+0000 7fd517400640 1 -- 172.21.15.22:0/2003746137 learned_addr learned my addr 172.21.15.22:0/2003746137 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.879+0000 7fd517e00640 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb14ba0 0x563eefb19660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.880+0000 7fd51d000640 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb14660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd517e00640 1 -- 172.21.15.22:0/2003746137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 msgr2=0x563eefb1c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd517e00640 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 0x563eefb1c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd517e00640 1 -- 172.21.15.22:0/2003746137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 msgr2=0x563eefb14660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd517e00640 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb14660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd517e00640 1 -- 172.21.15.22:0/2003746137 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eef78c210 con 0x563eefb14ba0 2024-09-15T22:37:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd517400640 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 0x563eefb1c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:37:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd514c00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4fc0a3450 0x7fd4fc0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.881+0000 7fd514c00640 1 -- 172.21.15.22:0/2805630371 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd5080d0030 con 0x7fd518073680 2024-09-15T22:37:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.882+0000 7fd51d000640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4fc0a3450 0x7fd4fc0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.882+0000 7fd517e00640 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb14ba0 0x563eefb19660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd510009780 tx=0x7fd5100056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6a876616148932d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.882+0000 7fd50d600640 1 -- 172.21.15.22:0/2003746137 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510037040 con 0x563eefb14ba0 2024-09-15T22:37:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.882+0000 7fd50d600640 1 -- 172.21.15.22:0/2003746137 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd510040070 con 0x563eefb14ba0 2024-09-15T22:37:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.882+0000 7fd50d600640 1 -- 172.21.15.22:0/2003746137 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5100037f0 con 0x563eefb14ba0 2024-09-15T22:37:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd51d000640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4fc0a3450 0x7fd4fc0a5910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd50401a540 tx=0x7fd50401a270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 -- 172.21.15.22:0/2003746137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb14ba0 msgr2=0x563eefb19660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb14ba0 0x563eefb19660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd510009780 tx=0x7fd5100056d0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 -- 172.21.15.22:0/2003746137 shutdown_connections 2024-09-15T22:37:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb19c30 0x563eefb1c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb14ba0 0x563eefb19660 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2003746137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb14660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.884+0000 7fd521fd6740 1 -- 172.21.15.22:0/2003746137 >> 172.21.15.22:0/2003746137 conn(0x563eefb0f8d0 msgr2=0x563eefb0fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.885+0000 7fd521fd6740 1 -- 172.21.15.22:0/2003746137 shutdown_connections 2024-09-15T22:37:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.885+0000 7fd521fd6740 1 -- 172.21.15.22:0/2003746137 wait complete. 2024-09-15T22:37:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.885+0000 7fd521fd6740 1 -- start start 2024-09-15T22:37:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.885+0000 7fd521fd6740 1 Processor -- start 2024-09-15T22:37:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.886+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb1e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.886+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 0x563eefb1e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.887+0000 7fd517e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb1e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.887+0000 7fd517400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 0x563eefb1e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.887+0000 7fd517400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 0x563eefb1e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44186/0 (socket says 172.21.15.22:44186) 2024-09-15T22:37:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.887+0000 7fd517e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb1e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:34756/0 (socket says 172.21.15.22:34756) 2024-09-15T22:37:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.887+0000 7fd517400640 1 -- 172.21.15.22:0/2529998223 learned_addr learned my addr 172.21.15.22:0/2529998223 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.887+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb25970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.888+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563eefb1cba0 con 0x563eefb14ba0 2024-09-15T22:37:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.888+0000 7fd51d000640 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb25970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.888+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563eefa02090 con 0x563eefb19c30 2024-09-15T22:37:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.888+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563eefb1cd20 con 0x563eefb14260 2024-09-15T22:37:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.889+0000 7fd521fd6740 10 client.0 _ll_register_callbacks cb 0x563eefa56f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.890+0000 7fd517400640 1 -- 172.21.15.22:0/2529998223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 msgr2=0x563eefb1e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.890+0000 7fd517400640 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb1e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.890+0000 7fd517400640 1 -- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 msgr2=0x563eefb25970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.890+0000 7fd517400640 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb25970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.890+0000 7fd517400640 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eef858620 con 0x563eefb14ba0 2024-09-15T22:37:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.890+0000 7fd517400640 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 0x563eefb1e930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd508018670 tx=0x7fd5080cdab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337256d4e17cd0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd502000640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd502000640 1 -- 172.21.15.22:0/2529998223 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50809bf70 con 0x563eefb14ba0 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd510040070 con 0x563eefb14ba0 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd502000640 1 -- 172.21.15.22:0/2529998223 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd5080d3d60 con 0x563eefb14ba0 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd502000640 1 -- 172.21.15.22:0/2529998223 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd50809cd10 con 0x563eefb14ba0 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd521fd6740 10 client.15348 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.891+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563eefb28800 con 0x563eefb14ba0 2024-09-15T22:37:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.892+0000 7fd502000640 1 -- 172.21.15.22:0/2529998223 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd510040070 con 0x563eefb14ba0 2024-09-15T22:37:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.893+0000 7fd502000640 1 -- 172.21.15.22:0/2529998223 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd5080b0c30 con 0x563eefb14ba0 2024-09-15T22:37:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.893+0000 7fd521fd6740 10 client.15348 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.893+0000 7fd521fd6740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.894+0000 7fd521fd6740 20 client.15348 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.894+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb29e80 0x563eefb2c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.894+0000 7fd521fd6740 4 client.15348 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:37:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.894+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eefa86830 con 0x563eefb29e80 2024-09-15T22:37:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.894+0000 7fd517e00640 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb29e80 0x563eefb2c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.895+0000 7fd502000640 10 client.15348 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.895+0000 7fd517e00640 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb29e80 0x563eefb2c270 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f4a478a0e16fc79 server_cookie=bca4ae48cccc8acb in_seq=0 out_seq=0 2024-09-15T22:37:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd502000640 1 -- 172.21.15.22:0/2529998223 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563eefa86830 con 0x563eefb29e80 2024-09-15T22:37:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd502000640 10 client.15348 handle_command_reply: tid=0 2024-09-15T22:37:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 client.15348 shutdown 2024-09-15T22:37:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 msgr2=0x563eefb1e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 0x563eefb1e930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd508018670 tx=0x7fd5080cdab0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 shutdown_connections 2024-09-15T22:37:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb29e80 0x563eefb2c270 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb25970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14ba0 0x563eefb1e930 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd508018670 tx=0x7fd5080cdab0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd502000640 0 client.15348 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2529998223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb1e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.896+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 >> 172.21.15.22:0/2529998223 conn(0x563eefb0f8d0 msgr2=0x563eefb110e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.897+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 shutdown_connections 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.897+0000 7fd521fd6740 1 -- 172.21.15.22:0/2529998223 wait complete. 2024-09-15T22:37:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.898+0000 7fd521fd6740 20 client.15348 trim_cache size 0 max 16384 2024-09-15T22:37:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.931+0000 7fd521fd6740 1 Processor -- start 2024-09-15T22:37:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 -- start start 2024-09-15T22:37:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb10780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb19c30 0x563eefb25930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb1eb00 0x563eefb10cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181b1d90 con 0x563eefb19c30 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181af660 con 0x563eefb1eb00 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.933+0000 7fd521fd6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181ad490 con 0x563eefb14260 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.934+0000 7fd517e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb10780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.934+0000 7fd517e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb10780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:34772/0 (socket says 172.21.15.22:34772) 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.934+0000 7fd517e00640 1 -- 172.21.15.22:0/2380908016 learned_addr learned my addr 172.21.15.22:0/2380908016 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.934+0000 7fd51d000640 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb1eb00 0x563eefb10cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.934+0000 7fd517400640 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb19c30 0x563eefb25930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.935+0000 7fd517e00640 1 -- 172.21.15.22:0/2380908016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb1eb00 msgr2=0x563eefb10cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.935+0000 7fd517e00640 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb1eb00 0x563eefb10cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.935+0000 7fd517e00640 1 -- 172.21.15.22:0/2380908016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb19c30 msgr2=0x563eefb25930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.935+0000 7fd517e00640 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb19c30 0x563eefb25930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.935+0000 7fd517e00640 1 -- 172.21.15.22:0/2380908016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eefb2c5e0 con 0x563eefb14260 2024-09-15T22:37:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.935+0000 7fd517e00640 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb10780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd51003d040 tx=0x7fd510030580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a5fec4715a4fb01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.936+0000 7fd50cc00640 1 -- 172.21.15.22:0/2380908016 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510037040 con 0x563eefb14260 2024-09-15T22:37:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.936+0000 7fd50cc00640 1 -- 172.21.15.22:0/2380908016 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd510052020 con 0x563eefb14260 2024-09-15T22:37:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.936+0000 7fd50cc00640 1 -- 172.21.15.22:0/2380908016 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510003850 con 0x563eefb14260 2024-09-15T22:37:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 -- 172.21.15.22:0/2380908016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 msgr2=0x563eefb10780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb10780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd51003d040 tx=0x7fd510030580 comp rx=0 tx=0).stop 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 -- 172.21.15.22:0/2380908016 shutdown_connections 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb1eb00 0x563eefb10cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb19c30 0x563eefb25930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 --2- 172.21.15.22:0/2380908016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb14260 0x563eefb10780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.939+0000 7fd521fd6740 1 -- 172.21.15.22:0/2380908016 >> 172.21.15.22:0/2380908016 conn(0x563eefb0f8d0 msgr2=0x563eefb1e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.940+0000 7fd521fd6740 1 -- 172.21.15.22:0/2380908016 shutdown_connections 2024-09-15T22:37:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.940+0000 7fd521fd6740 1 -- 172.21.15.22:0/2380908016 wait complete. 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.940+0000 7fd521fd6740 1 -- start start 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 Processor -- start 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb22d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb23280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb1eb00 0x563eefb24290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181adb20 con 0x563eefb14260 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181aef90 con 0x563eefb19c30 2024-09-15T22:37:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181ae1f0 con 0x563eefb1eb00 2024-09-15T22:37:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.941+0000 7fd521fd6740 10 client.0 _ll_register_callbacks cb 0x7fd5080981f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.942+0000 7fd517e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb22d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.942+0000 7fd517e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb22d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44216/0 (socket says 172.21.15.22:44216) 2024-09-15T22:37:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.942+0000 7fd517e00640 1 -- 172.21.15.22:0/75605783 learned_addr learned my addr 172.21.15.22:0/75605783 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.942+0000 7fd517400640 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb23280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.943+0000 7fd517e00640 1 -- 172.21.15.22:0/75605783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb1eb00 msgr2=0x563eefb24290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.943+0000 7fd517e00640 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb1eb00 0x563eefb24290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.943+0000 7fd517e00640 1 -- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 msgr2=0x563eefb23280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.943+0000 7fd517e00640 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb23280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.943+0000 7fd517e00640 1 -- 172.21.15.22:0/75605783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eefb248a0 con 0x563eefb14260 2024-09-15T22:37:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.944+0000 7fd517e00640 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb22d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5100304b0 tx=0x7fd5100058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98336fe25121a6a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.944+0000 7fd502000640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:37:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.944+0000 7fd502000640 1 -- 172.21.15.22:0/75605783 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51005d020 con 0x563eefb14260 2024-09-15T22:37:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.945+0000 7fd502000640 1 -- 172.21.15.22:0/75605783 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd510005040 con 0x563eefb14260 2024-09-15T22:37:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.945+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd510052020 con 0x563eefb14260 2024-09-15T22:37:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.945+0000 7fd502000640 1 -- 172.21.15.22:0/75605783 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd510037050 con 0x563eefb14260 2024-09-15T22:37:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.948+0000 7fd521fd6740 10 client.15351 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.948+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563eefb25bb0 con 0x563eefb14260 2024-09-15T22:37:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.951+0000 7fd502000640 1 -- 172.21.15.22:0/75605783 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd510052020 con 0x563eefb14260 2024-09-15T22:37:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.951+0000 7fd502000640 1 -- 172.21.15.22:0/75605783 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd51003a070 con 0x563eefb14260 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.951+0000 7fd521fd6740 10 client.15351 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.952+0000 7fd521fd6740 10 client.15351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.952+0000 7fd521fd6740 20 client.15351 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.952+0000 7fd521fd6740 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb94d70 0x563eefb97190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.952+0000 7fd521fd6740 4 client.15351 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.952+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563eefa80b80 con 0x563eefb94d70 2024-09-15T22:37:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.952+0000 7fd517400640 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb94d70 0x563eefb97190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.954+0000 7fd502000640 10 client.15351 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.954+0000 7fd517400640 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb94d70 0x563eefb97190 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb8dd7736c43c32c server_cookie=1448b02d8f2a8c1c in_seq=0 out_seq=0 2024-09-15T22:37:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.983+0000 7fd502000640 1 -- 172.21.15.22:0/75605783 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563eefa80b80 con 0x563eefb94d70 2024-09-15T22:37:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.983+0000 7fd502000640 10 client.15351 handle_command_reply: tid=0 2024-09-15T22:37:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.983+0000 7fd521fd6740 1 client.15351 shutdown 2024-09-15T22:37:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.984+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 msgr2=0x563eefb22d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.987+0000 7fd521fd6740 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb22d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5100304b0 tx=0x7fd5100058e0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 shutdown_connections 2024-09-15T22:37:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd521fd6740 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563eefb94d70 0x563eefb97190 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd521fd6740 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563eefb1eb00 0x563eefb24290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd521fd6740 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563eefb19c30 0x563eefb23280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd521fd6740 1 --2- 172.21.15.22:0/75605783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563eefb14260 0x563eefb22d40 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5100304b0 tx=0x7fd5100058e0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 >> 172.21.15.22:0/75605783 conn(0x563eefb0f8d0 msgr2=0x563eefb0e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.988+0000 7fd502000640 0 client.15351 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.990+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 shutdown_connections 2024-09-15T22:37:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.992+0000 7fd521fd6740 1 -- 172.21.15.22:0/75605783 wait complete. 2024-09-15T22:37:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.992+0000 7fd521fd6740 20 client.15351 trim_cache size 0 max 16384 2024-09-15T22:37:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:37:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:37:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:37:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:37:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4fc0a3450 msgr2=0x7fd4fc0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4fc0a3450 0x7fd4fc0a5910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd50401a540 tx=0x7fd50401a270 comp rx=0 tx=0).stop 2024-09-15T22:37:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 msgr2=0x7fd51819ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 0x7fd51819ec30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd50800eb90 tx=0x7fd50800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 shutdown_connections 2024-09-15T22:37:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd51810dbb0 0x7fd5181a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd4fc0a3450 0x7fd4fc0a5910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518073680 0x7fd51819ec30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 --2- 172.21.15.22:0/2805630371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd518072cb0 0x7fd51819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.994+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 >> 172.21.15.22:0/2805630371 conn(0x7fd51806eb50 msgr2=0x7fd51806fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.995+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 shutdown_connections 2024-09-15T22:37:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:24.996+0000 7fd51da00640 1 -- 172.21.15.22:0/2805630371 wait complete. 2024-09-15T22:37:25.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:24 smithi110 ceph-mon[35282]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 903 op/s 2024-09-15T22:37:25.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:24 smithi022 ceph-mon[30634]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 903 op/s 2024-09-15T22:37:25.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:24 smithi112 ceph-mon[35032]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 903 op/s 2024-09-15T22:37:27.153 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:26 smithi112 ceph-mon[35032]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 251 MiB/s wr, 856 op/s 2024-09-15T22:37:27.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:26 smithi110 ceph-mon[35282]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 251 MiB/s wr, 856 op/s 2024-09-15T22:37:27.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:26 smithi022 ceph-mon[30634]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 251 MiB/s wr, 856 op/s 2024-09-15T22:37:29.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:28 smithi110 ceph-mon[35282]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 264 MiB/s wr, 891 op/s 2024-09-15T22:37:29.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:28 smithi022 ceph-mon[30634]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 264 MiB/s wr, 891 op/s 2024-09-15T22:37:29.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:28 smithi112 ceph-mon[35032]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 264 MiB/s wr, 891 op/s 2024-09-15T22:37:31.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:30 smithi022 ceph-mon[30634]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 248 MiB/s wr, 824 op/s 2024-09-15T22:37:31.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:30 smithi112 ceph-mon[35032]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 248 MiB/s wr, 824 op/s 2024-09-15T22:37:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:30 smithi110 ceph-mon[35282]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 248 MiB/s wr, 824 op/s 2024-09-15T22:37:33.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:33 smithi022 ceph-mon[30634]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 264 MiB/s wr, 894 op/s 2024-09-15T22:37:33.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:33 smithi112 ceph-mon[35032]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 264 MiB/s wr, 894 op/s 2024-09-15T22:37:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:33 smithi110 ceph-mon[35282]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 264 MiB/s wr, 894 op/s 2024-09-15T22:37:35.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:35 smithi112 ceph-mon[35032]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 880 op/s 2024-09-15T22:37:35.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:35 smithi110 ceph-mon[35282]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 880 op/s 2024-09-15T22:37:35.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:35 smithi022 ceph-mon[30634]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 880 op/s 2024-09-15T22:37:37.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:37 smithi112 ceph-mon[35032]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 251 MiB/s wr, 858 op/s 2024-09-15T22:37:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:37 smithi110 ceph-mon[35282]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 251 MiB/s wr, 858 op/s 2024-09-15T22:37:37.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:37 smithi022 ceph-mon[30634]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 251 MiB/s wr, 858 op/s 2024-09-15T22:37:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 -- 172.21.15.22:0/3403944940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988102b40 msgr2=0x7f1988102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 --2- 172.21.15.22:0/3403944940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988102b40 0x7f1988102fc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1970009860 tx=0x7f197002a340 comp rx=0 tx=0).stop 2024-09-15T22:37:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 -- 172.21.15.22:0/3403944940 shutdown_connections 2024-09-15T22:37:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 --2- 172.21.15.22:0/3403944940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988103500 0x7f1988109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 --2- 172.21.15.22:0/3403944940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988102b40 0x7f1988102fc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 --2- 172.21.15.22:0/3403944940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f1988101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 -- 172.21.15.22:0/3403944940 >> 172.21.15.22:0/3403944940 conn(0x7f19880fd0d0 msgr2=0x7f19880ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 -- 172.21.15.22:0/3403944940 shutdown_connections 2024-09-15T22:37:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.290+0000 7f198cc00640 1 -- 172.21.15.22:0/3403944940 wait complete. 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 Processor -- start 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 -- start start 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f19881095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988102b40 0x7f1988109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988103500 0x7f1988107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1988072c50 con 0x7f1988102b40 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1988072ad0 con 0x7f1988103500 2024-09-15T22:37:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f198cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1988072dd0 con 0x7f1988101950 2024-09-15T22:37:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f1987400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f19881095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f1987400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f19881095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41218/0 (socket says 172.21.15.22:41218) 2024-09-15T22:37:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f1987e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988103500 0x7f1988107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.292+0000 7f1987400640 1 -- 172.21.15.22:0/3985809281 learned_addr learned my addr 172.21.15.22:0/3985809281 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f197ea00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988102b40 0x7f1988109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f1987400640 1 -- 172.21.15.22:0/3985809281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988103500 msgr2=0x7f1988107bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f1987400640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988103500 0x7f1988107bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f1987400640 1 -- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988102b40 msgr2=0x7f1988109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f1987400640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988102b40 0x7f1988109af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f1987400640 1 -- 172.21.15.22:0/3985809281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1988108370 con 0x7f1988101950 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f1987e00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988103500 0x7f1988107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.293+0000 7f197ea00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988102b40 0x7f1988109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:37:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.294+0000 7f1987400640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f19881095b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f197801fa20 tx=0x7f197801fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.294+0000 7f1984c00640 1 -- 172.21.15.22:0/3985809281 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197801dc50 con 0x7f1988101950 2024-09-15T22:37:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.294+0000 7f1984c00640 1 -- 172.21.15.22:0/3985809281 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197801ddf0 con 0x7f1988101950 2024-09-15T22:37:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.294+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1988108660 con 0x7f1988101950 2024-09-15T22:37:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.294+0000 7f1984c00640 1 -- 172.21.15.22:0/3985809281 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780216a0 con 0x7f1988101950 2024-09-15T22:37:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.294+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198819df30 con 0x7f1988101950 2024-09-15T22:37:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.299+0000 7f19911bb740 1 Processor -- start 2024-09-15T22:37:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.301+0000 7f19911bb740 1 -- start start 2024-09-15T22:37:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.301+0000 7f19911bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.301+0000 7f1984c00640 1 -- 172.21.15.22:0/3985809281 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1978004ef0 con 0x7f1988101950 2024-09-15T22:37:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f19911bb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f19911bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114b2c30 0x55b7114b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f19911bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b711412100 con 0x55b7114b2c30 2024-09-15T22:37:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f19911bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b7113ba1b0 con 0x55b7114ad260 2024-09-15T22:37:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f19911bb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b71140e0c0 con 0x55b7114adba0 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f1987e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f1987e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:50290/0 (socket says 172.21.15.22:50290) 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f1987e00640 1 -- 172.21.15.22:0/661066163 learned_addr learned my addr 172.21.15.22:0/661066163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f1987400640 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.304+0000 7f197ea00640 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114b2c30 0x55b7114b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1984c00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f196c0a3240 0x7f196c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1987400640 1 -- 172.21.15.22:0/661066163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 msgr2=0x55b7114ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1987400640 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1987400640 1 -- 172.21.15.22:0/661066163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114b2c30 msgr2=0x55b7114b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1987400640 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114b2c30 0x55b7114b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1987400640 1 -- 172.21.15.22:0/661066163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b711125210 con 0x55b7114adba0 2024-09-15T22:37:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f197ea00640 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114b2c30 0x55b7114b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:37:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1984c00640 1 -- 172.21.15.22:0/3985809281 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f19780e0e00 con 0x7f1988101950 2024-09-15T22:37:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.305+0000 7f1987400640 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b2660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f19780de860 tx=0x7f19780049d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d73940ad02a8a643 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.306+0000 7f1977e00640 1 -- 172.21.15.22:0/661066163 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780acd40 con 0x55b7114adba0 2024-09-15T22:37:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.306+0000 7f1977e00640 1 -- 172.21.15.22:0/661066163 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19780adae0 con 0x55b7114adba0 2024-09-15T22:37:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.306+0000 7f1977e00640 1 -- 172.21.15.22:0/661066163 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780e4310 con 0x55b7114adba0 2024-09-15T22:37:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.306+0000 7f1987e00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f196c0a3240 0x7f196c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.307+0000 7f19911bb740 1 -- 172.21.15.22:0/661066163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 msgr2=0x55b7114b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.307+0000 7f19911bb740 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b2660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f19780de860 tx=0x7f19780049d0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 -- 172.21.15.22:0/661066163 shutdown_connections 2024-09-15T22:37:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b2660 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114b2c30 0x55b7114b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 --2- 172.21.15.22:0/661066163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 -- 172.21.15.22:0/661066163 >> 172.21.15.22:0/661066163 conn(0x55b7114a88d0 msgr2=0x55b7114a8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 -- 172.21.15.22:0/661066163 shutdown_connections 2024-09-15T22:37:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.309+0000 7f19911bb740 1 -- 172.21.15.22:0/661066163 wait complete. 2024-09-15T22:37:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.310+0000 7f19911bb740 1 -- start start 2024-09-15T22:37:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.310+0000 7f19911bb740 1 Processor -- start 2024-09-15T22:37:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.311+0000 7f1987e00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f196c0a3240 0x7f196c0a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1980009fd0 tx=0x7f1980004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.312+0000 7f19911bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.312+0000 7f19911bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.312+0000 7f19911bb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114b2c30 0x55b7114be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.313+0000 7f1987400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.313+0000 7f1987e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114b2c30 0x55b7114be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.313+0000 7f197ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.314+0000 7f197ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41834/0 (socket says 172.21.15.22:41834) 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.314+0000 7f197ea00640 1 -- 172.21.15.22:0/483288384 learned_addr learned my addr 172.21.15.22:0/483288384 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.314+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b7114b5ba0 con 0x55b7114adba0 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.314+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b71139b090 con 0x55b7114ad260 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.314+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b7114b5d20 con 0x55b7114b2c30 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.314+0000 7f19911bb740 10 client.0 _ll_register_callbacks cb 0x55b7113eff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.315+0000 7f1987e00640 1 -- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 msgr2=0x55b7114b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.315+0000 7f1987e00640 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.315+0000 7f1987e00640 1 -- 172.21.15.22:0/483288384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 msgr2=0x55b7114b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.316+0000 7f1987e00640 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.316+0000 7f1987e00640 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7111f1620 con 0x55b7114b2c30 2024-09-15T22:37:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.316+0000 7f197ea00640 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:37:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.316+0000 7f1987e00640 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114b2c30 0x55b7114be8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1980004410 tx=0x7f1980004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba81c88d53272de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.316+0000 7f1974c00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:37:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.317+0000 7f1974c00640 1 -- 172.21.15.22:0/483288384 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980019070 con 0x55b7114b2c30 2024-09-15T22:37:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.317+0000 7f1974c00640 1 -- 172.21.15.22:0/483288384 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1980010d40 con 0x55b7114b2c30 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.317+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19780adae0 con 0x55b7114b2c30 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.317+0000 7f1974c00640 1 -- 172.21.15.22:0/483288384 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1980032050 con 0x55b7114b2c30 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.317+0000 7f19911bb740 10 client.25435 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.317+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7114c17a0 con 0x55b7114b2c30 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.318+0000 7f1974c00640 1 -- 172.21.15.22:0/483288384 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19780adae0 con 0x55b7114b2c30 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.318+0000 7f1974c00640 1 -- 172.21.15.22:0/483288384 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f198001e3e0 con 0x55b7114b2c30 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.318+0000 7f19911bb740 10 client.25435 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.318+0000 7f19911bb740 10 client.25435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.318+0000 7f19911bb740 20 client.25435 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.318+0000 7f19911bb740 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b7114c2ec0 0x55b7114c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.319+0000 7f19911bb740 4 client.25435 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.319+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b71141f830 con 0x55b7114c2ec0 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.319+0000 7f1987400640 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b7114c2ec0 0x55b7114c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.319+0000 7f1987400640 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b7114c2ec0 0x55b7114c52f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8dd35dec285cc57 server_cookie=3e76d7daded039ad in_seq=0 out_seq=0 2024-09-15T22:37:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.319+0000 7f1974c00640 10 client.25435 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.320+0000 7f1974c00640 1 -- 172.21.15.22:0/483288384 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b71141f830 con 0x55b7114c2ec0 2024-09-15T22:37:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.320+0000 7f1974c00640 10 client.25435 handle_command_reply: tid=0 2024-09-15T22:37:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.320+0000 7f19911bb740 1 client.25435 shutdown 2024-09-15T22:37:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.321+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114b2c30 msgr2=0x55b7114be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.321+0000 7f19911bb740 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114b2c30 0x55b7114be8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1980004410 tx=0x7f1980004a40 comp rx=0 tx=0).stop 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 shutdown_connections 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b7114c2ec0 0x55b7114c52f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114b2c30 0x55b7114be8e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 --2- 172.21.15.22:0/483288384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 >> 172.21.15.22:0/483288384 conn(0x55b7114a88d0 msgr2=0x55b7114aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f1974c00640 0 client.25435 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 shutdown_connections 2024-09-15T22:37:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 1 -- 172.21.15.22:0/483288384 wait complete. 2024-09-15T22:37:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.322+0000 7f19911bb740 20 client.25435 trim_cache size 0 max 16384 2024-09-15T22:37:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.346+0000 7f19911bb740 1 Processor -- start 2024-09-15T22:37:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.346+0000 7f19911bb740 1 -- start start 2024-09-15T22:37:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f19911bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f19911bb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f19911bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f19911bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19881a94d0 con 0x55b7114ad260 2024-09-15T22:37:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f19911bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f19881a6da0 con 0x55b7114b2c30 2024-09-15T22:37:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f19911bb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19881a4bd0 con 0x55b7114adba0 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f1987e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f197ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f197ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41248/0 (socket says 172.21.15.22:41248) 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.347+0000 7f197ea00640 1 -- 172.21.15.22:0/2754293286 learned_addr learned my addr 172.21.15.22:0/2754293286 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987400640 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987e00640 1 -- 172.21.15.22:0/2754293286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 msgr2=0x55b7114b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987e00640 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987e00640 1 -- 172.21.15.22:0/2754293286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 msgr2=0x55b7114b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987e00640 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987e00640 1 -- 172.21.15.22:0/2754293286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7114bf9f0 con 0x55b7114b2c30 2024-09-15T22:37:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1987e00640 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114be8a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1980006010 tx=0x7f1980009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06ff963ecff5724 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1977400640 1 -- 172.21.15.22:0/2754293286 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980019070 con 0x55b7114b2c30 2024-09-15T22:37:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1977400640 1 -- 172.21.15.22:0/2754293286 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1980027020 con 0x55b7114b2c30 2024-09-15T22:37:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.348+0000 7f1977400640 1 -- 172.21.15.22:0/2754293286 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980026020 con 0x55b7114b2c30 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.349+0000 7f19911bb740 1 -- 172.21.15.22:0/2754293286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 msgr2=0x55b7114be8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.349+0000 7f19911bb740 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114be8a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1980006010 tx=0x7f1980009610 comp rx=0 tx=0).stop 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.349+0000 7f19911bb740 1 -- 172.21.15.22:0/2754293286 shutdown_connections 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.349+0000 7f19911bb740 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.349+0000 7f19911bb740 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114be8a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.350+0000 7f19911bb740 1 --2- 172.21.15.22:0/2754293286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.350+0000 7f19911bb740 1 -- 172.21.15.22:0/2754293286 >> 172.21.15.22:0/2754293286 conn(0x55b7114a88d0 msgr2=0x55b7114aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.350+0000 7f19911bb740 1 -- 172.21.15.22:0/2754293286 shutdown_connections 2024-09-15T22:37:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.350+0000 7f19911bb740 1 -- 172.21.15.22:0/2754293286 wait complete. 2024-09-15T22:37:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.350+0000 7f19911bb740 1 -- start start 2024-09-15T22:37:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.350+0000 7f19911bb740 1 Processor -- start 2024-09-15T22:37:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19881a5260 con 0x55b7114ad260 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f19881a66d0 con 0x55b7114b2c30 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19881a5930 con 0x55b7114adba0 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f19911bb740 10 client.0 _ll_register_callbacks cb 0x7f1980013590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f197ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f197ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114bb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41252/0 (socket says 172.21.15.22:41252) 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f197ea00640 1 -- 172.21.15.22:0/1022177005 learned_addr learned my addr 172.21.15.22:0/1022177005 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.351+0000 7f1987e00640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f1987400640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f197ea00640 1 -- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 msgr2=0x55b7114bbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f197ea00640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114bbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f197ea00640 1 -- 172.21.15.22:0/1022177005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 msgr2=0x55b7114be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f197ea00640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f197ea00640 1 -- 172.21.15.22:0/1022177005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b71152bc90 con 0x55b7114adba0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f197ea00640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114bb4a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1970035040 tx=0x7f19700306e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6371e11285193519 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.352+0000 7f1974c00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f1974c00640 1 -- 172.21.15.22:0/1022177005 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970037040 con 0x55b7114adba0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f1974c00640 1 -- 172.21.15.22:0/1022177005 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1970004250 con 0x55b7114adba0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1980027020 con 0x55b7114adba0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f1974c00640 1 -- 172.21.15.22:0/1022177005 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19700309e0 con 0x55b7114adba0 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f19911bb740 10 client.25441 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b71152d010 con 0x55b7114adba0 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.353+0000 7f1974c00640 1 -- 172.21.15.22:0/1022177005 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1980027020 con 0x55b7114adba0 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f1974c00640 1 -- 172.21.15.22:0/1022177005 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1970004be0 con 0x55b7114adba0 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f19911bb740 10 client.25441 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f19911bb740 10 client.25441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f19911bb740 20 client.25441 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f19911bb740 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b71152da40 0x55b71152fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f19911bb740 4 client.25441 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:37:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.354+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b711419b80 con 0x55b71152da40 2024-09-15T22:37:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.355+0000 7f1987400640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b71152da40 0x55b71152fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.356+0000 7f1987400640 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b71152da40 0x55b71152fe60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=511e2bc1631e043d server_cookie=8f0b476c9ed18922 in_seq=0 out_seq=0 2024-09-15T22:37:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.356+0000 7f1974c00640 10 client.25441 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.376+0000 7f1974c00640 1 -- 172.21.15.22:0/1022177005 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b711419b80 con 0x55b71152da40 2024-09-15T22:37:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.376+0000 7f1974c00640 10 client.25441 handle_command_reply: tid=0 2024-09-15T22:37:38.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.376+0000 7f19911bb740 1 client.25441 shutdown 2024-09-15T22:37:38.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 msgr2=0x55b7114bb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114bb4a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1970035040 tx=0x7f19700306e0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 shutdown_connections 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b71152da40 0x55b71152fe60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f1974c00640 0 client.25441 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b7114adba0 0x55b7114bb4a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b7114b2c30 0x55b7114bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 --2- 172.21.15.22:0/1022177005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b7114ad260 0x55b7114be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 >> 172.21.15.22:0/1022177005 conn(0x55b7114a88d0 msgr2=0x55b7114b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 shutdown_connections 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.377+0000 7f19911bb740 1 -- 172.21.15.22:0/1022177005 wait complete. 2024-09-15T22:37:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.378+0000 7f19911bb740 20 client.25441 trim_cache size 0 max 16384 2024-09-15T22:37:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:37:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:37:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:37:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f196c0a3240 msgr2=0x7f196c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f196c0a3240 0x7f196c0a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1980009fd0 tx=0x7f1980004ab0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 msgr2=0x7f19881095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f19881095b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f197801fa20 tx=0x7f197801fee0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 shutdown_connections 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f196c0a3240 0x7f196c0a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1988103500 0x7f1988107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1988102b40 0x7f1988109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 --2- 172.21.15.22:0/3985809281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1988101950 0x7f19881095b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 >> 172.21.15.22:0/3985809281 conn(0x7f19880fd0d0 msgr2=0x7f19880757e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 shutdown_connections 2024-09-15T22:37:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:38.379+0000 7f198cc00640 1 -- 172.21.15.22:0/3985809281 wait complete. 2024-09-15T22:37:39.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:39 smithi110 ceph-mon[35282]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 947 op/s 2024-09-15T22:37:39.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:39 smithi022 ceph-mon[30634]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 947 op/s 2024-09-15T22:37:39.689 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:39 smithi112 ceph-mon[35032]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 275 MiB/s wr, 947 op/s 2024-09-15T22:37:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:41 smithi110 ceph-mon[35282]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 898 op/s 2024-09-15T22:37:41.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:41 smithi022 ceph-mon[30634]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 898 op/s 2024-09-15T22:37:41.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:41 smithi112 ceph-mon[35032]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 898 op/s 2024-09-15T22:37:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:43 smithi110 ceph-mon[35282]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 263 MiB/s wr, 923 op/s 2024-09-15T22:37:43.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:43 smithi022 ceph-mon[30634]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 263 MiB/s wr, 923 op/s 2024-09-15T22:37:43.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:43 smithi112 ceph-mon[35032]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 263 MiB/s wr, 923 op/s 2024-09-15T22:37:45.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:45 smithi110 ceph-mon[35282]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 261 MiB/s wr, 900 op/s 2024-09-15T22:37:45.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:45 smithi022 ceph-mon[30634]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 261 MiB/s wr, 900 op/s 2024-09-15T22:37:45.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:45 smithi112 ceph-mon[35032]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 261 MiB/s wr, 900 op/s 2024-09-15T22:37:47.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:47 smithi110 ceph-mon[35282]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 248 MiB/s wr, 857 op/s 2024-09-15T22:37:47.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:47 smithi022 ceph-mon[30634]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 248 MiB/s wr, 857 op/s 2024-09-15T22:37:47.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:47 smithi112 ceph-mon[35032]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 248 MiB/s wr, 857 op/s 2024-09-15T22:37:49.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:49 smithi110 ceph-mon[35282]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 921 op/s 2024-09-15T22:37:49.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:49 smithi022 ceph-mon[30634]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 921 op/s 2024-09-15T22:37:49.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:49 smithi112 ceph-mon[35032]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 921 op/s 2024-09-15T22:37:50.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:50 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:50.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:50 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:50.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:50 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:51.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:51 smithi110 ceph-mon[35282]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 247 MiB/s wr, 851 op/s 2024-09-15T22:37:51.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:51 smithi022 ceph-mon[30634]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 247 MiB/s wr, 851 op/s 2024-09-15T22:37:51.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:51 smithi112 ceph-mon[35032]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 247 MiB/s wr, 851 op/s 2024-09-15T22:37:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 -- 172.21.15.22:0/3870405998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1858100af0 msgr2=0x7f1858100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 --2- 172.21.15.22:0/3870405998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1858100af0 0x7f1858100f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1844009900 tx=0x7f184402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 -- 172.21.15.22:0/3870405998 shutdown_connections 2024-09-15T22:37:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 --2- 172.21.15.22:0/3870405998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1858101490 0x7f1858101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 --2- 172.21.15.22:0/3870405998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1858100af0 0x7f1858100f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 --2- 172.21.15.22:0/3870405998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18581001b0 0x7f18581005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 -- 172.21.15.22:0/3870405998 >> 172.21.15.22:0/3870405998 conn(0x7f18580fbfa0 msgr2=0x7f18580fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 -- 172.21.15.22:0/3870405998 shutdown_connections 2024-09-15T22:37:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.642+0000 7f1857e00640 1 -- 172.21.15.22:0/3870405998 wait complete. 2024-09-15T22:37:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.644+0000 7f1857e00640 1 Processor -- start 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.644+0000 7f1857e00640 1 -- start start 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.644+0000 7f1857e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 0x7f1858199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.644+0000 7f1857e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1858100af0 0x7f185819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.644+0000 7f1857e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1858101490 0x7f18581a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1857e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f185810f7e0 con 0x7f1858101490 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1857e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f185810f660 con 0x7f18581001b0 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1857e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f185810f960 con 0x7f1858100af0 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 0x7f1858199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 0x7f1858199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59310/0 (socket says 172.21.15.22:59310) 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 -- 172.21.15.22:0/2313087422 learned_addr learned my addr 172.21.15.22:0/2313087422 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856000640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1858100af0 0x7f185819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1857400640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1858101490 0x7f18581a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 -- 172.21.15.22:0/2313087422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1858100af0 msgr2=0x7f185819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1858100af0 0x7f185819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 -- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1858101490 msgr2=0x7f18581a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1858101490 0x7f18581a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.645+0000 7f1856a00640 1 -- 172.21.15.22:0/2313087422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18581a1ab0 con 0x7f18581001b0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.646+0000 7f1856a00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 0x7f1858199e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f184800e9f0 tx=0x7f184800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.646+0000 7f185ca00640 1 -- 172.21.15.22:0/2313087422 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184800cd80 con 0x7f18581001b0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.646+0000 7f185ca00640 1 -- 172.21.15.22:0/2313087422 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1848010910 con 0x7f18581001b0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.646+0000 7f185ca00640 1 -- 172.21.15.22:0/2313087422 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1848018990 con 0x7f18581001b0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.646+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18581a1da0 con 0x7f18581001b0 2024-09-15T22:37:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.646+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18581a2260 con 0x7f18581001b0 2024-09-15T22:37:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.650+0000 7f185ca00640 1 -- 172.21.15.22:0/2313087422 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1848010ac0 con 0x7f18581001b0 2024-09-15T22:37:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 Processor -- start 2024-09-15T22:37:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 -- start start 2024-09-15T22:37:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6260 0x559d74ad6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 0x559d74adb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ade0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d74a3b100 con 0x559d74ad6260 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559d749e31b0 con 0x559d74ad6ba0 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.651+0000 7f1860e0a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559d74a370c0 con 0x559d74adbc30 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 0x559d74adb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ade0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 0x559d74adb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59316/0 (socket says 172.21.15.22:59316) 2024-09-15T22:37:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 -- 172.21.15.22:0/3906538380 learned_addr learned my addr 172.21.15.22:0/3906538380 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1857400640 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6260 0x559d74ad6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 -- 172.21.15.22:0/3906538380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 msgr2=0x559d74ade0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ade0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 -- 172.21.15.22:0/3906538380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6260 msgr2=0x559d74ad6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6260 0x559d74ad6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.652+0000 7f1856a00640 1 -- 172.21.15.22:0/3906538380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7474e210 con 0x559d74ad6ba0 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f185ca00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f183c0a32c0 0x7f183c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f1856a00640 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 0x559d74adb660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18480d3e90 tx=0x7f18480d87b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd7963efe345b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f185ca00640 1 -- 172.21.15.22:0/2313087422 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f18480cfd60 con 0x7f18581001b0 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f1857400640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f183c0a32c0 0x7f183c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f1843e00640 1 -- 172.21.15.22:0/3906538380 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18480985e0 con 0x559d74ad6ba0 2024-09-15T22:37:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f1843e00640 1 -- 172.21.15.22:0/3906538380 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18480dd070 con 0x559d74ad6ba0 2024-09-15T22:37:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.653+0000 7f1843e00640 1 -- 172.21.15.22:0/3906538380 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184809bca0 con 0x559d74ad6ba0 2024-09-15T22:37:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.654+0000 7f1857400640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f183c0a32c0 0x7f183c0a5780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1850005fd0 tx=0x7f1850009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.654+0000 7f1860e0a740 1 -- 172.21.15.22:0/3906538380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 msgr2=0x559d74adb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.654+0000 7f1860e0a740 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 0x559d74adb660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18480d3e90 tx=0x7f18480d87b0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 -- 172.21.15.22:0/3906538380 shutdown_connections 2024-09-15T22:37:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ade0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6ba0 0x559d74adb660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 --2- 172.21.15.22:0/3906538380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6260 0x559d74ad6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 -- 172.21.15.22:0/3906538380 >> 172.21.15.22:0/3906538380 conn(0x559d74ad18d0 msgr2=0x559d74ad1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 -- 172.21.15.22:0/3906538380 shutdown_connections 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 -- 172.21.15.22:0/3906538380 wait complete. 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.655+0000 7f1860e0a740 1 -- start start 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 Processor -- start 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ae7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d74adec00 con 0x559d74ad6ba0 2024-09-15T22:37:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559d749c4090 con 0x559d74ad6260 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.656+0000 7f1860e0a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559d74aded80 con 0x559d74adbc30 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1860e0a740 10 client.0 _ll_register_callbacks cb 0x559d74a18f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1857400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ae7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59326/0 (socket says 172.21.15.22:59326) 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 -- 172.21.15.22:0/1666345324 learned_addr learned my addr 172.21.15.22:0/1666345324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856000640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 -- 172.21.15.22:0/1666345324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 msgr2=0x559d74ae7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ae7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 -- 172.21.15.22:0/1666345324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 msgr2=0x559d74ae09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.657+0000 7f1856a00640 1 -- 172.21.15.22:0/1666345324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7481a620 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1856000640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1856a00640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae04b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18480d8cb0 tx=0x7f18480d8d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19329f913049f00f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1840c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1840c00640 1 -- 172.21.15.22:0/1666345324 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184809be80 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1840c00640 1 -- 172.21.15.22:0/1666345324 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f18480a4b20 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18480dd070 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1840c00640 1 -- 172.21.15.22:0/1666345324 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f184809c110 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1860e0a740 10 client.25445 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.658+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d74adec00 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1840c00640 1 -- 172.21.15.22:0/1666345324 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18480dd070 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1840c00640 1 -- 172.21.15.22:0/1666345324 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f18480cdce0 con 0x559d74ad6260 2024-09-15T22:37:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1860e0a740 10 client.25445 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1860e0a740 10 client.25445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1860e0a740 20 client.25445 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74aeb9f0 0x559d74aedde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1860e0a740 4 client.25445 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d74a48830 con 0x559d74aeb9f0 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.659+0000 7f1856000640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74aeb9f0 0x559d74aedde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.660+0000 7f1840c00640 10 client.25445 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.660+0000 7f1856000640 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74aeb9f0 0x559d74aedde0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18611092378a1c82 server_cookie=11b486cdff2ab55c in_seq=0 out_seq=0 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.661+0000 7f1840c00640 1 -- 172.21.15.22:0/1666345324 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d74a48830 con 0x559d74aeb9f0 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.661+0000 7f1840c00640 10 client.25445 handle_command_reply: tid=0 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.661+0000 7f1860e0a740 1 client.25445 shutdown 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.661+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 msgr2=0x559d74ae04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.661+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae04b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18480d8cb0 tx=0x7f18480d8d60 comp rx=0 tx=0).stop 2024-09-15T22:37:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 shutdown_connections 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74aeb9f0 0x559d74aedde0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ae7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1666345324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae04b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 >> 172.21.15.22:0/1666345324 conn(0x559d74ad18d0 msgr2=0x559d74ad30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1840c00640 0 client.25445 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 shutdown_connections 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 1 -- 172.21.15.22:0/1666345324 wait complete. 2024-09-15T22:37:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.662+0000 7f1860e0a740 20 client.25445 trim_cache size 0 max 16384 2024-09-15T22:37:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.695+0000 7f1860e0a740 1 Processor -- start 2024-09-15T22:37:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 -- start start 2024-09-15T22:37:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ad1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18581ada80 con 0x559d74ad6ba0 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18581ab350 con 0x559d74ad6260 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.696+0000 7f1860e0a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18581a9180 con 0x559d74adbc30 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.697+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.697+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59338/0 (socket says 172.21.15.22:59338) 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.697+0000 7f1856a00640 1 -- 172.21.15.22:0/1302100615 learned_addr learned my addr 172.21.15.22:0/1302100615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.697+0000 7f1856000640 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.697+0000 7f1857400640 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ad1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.698+0000 7f1856a00640 1 -- 172.21.15.22:0/1302100615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 msgr2=0x559d74ad1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.698+0000 7f1856a00640 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ad1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.698+0000 7f1856a00640 1 -- 172.21.15.22:0/1302100615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 msgr2=0x559d74ae79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.698+0000 7f1856a00640 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.698+0000 7f1856a00640 1 -- 172.21.15.22:0/1302100615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d74ad16f0 con 0x559d74ad6260 2024-09-15T22:37:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.698+0000 7f1856000640 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:37:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.699+0000 7f1856a00640 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae0970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18480987a0 tx=0x7f18480d37a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a9c7dd585b8f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.699+0000 7f1843400640 1 -- 172.21.15.22:0/1302100615 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18480d32d0 con 0x559d74ad6260 2024-09-15T22:37:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.699+0000 7f1843400640 1 -- 172.21.15.22:0/1302100615 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184809ca40 con 0x559d74ad6260 2024-09-15T22:37:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.700+0000 7f1843400640 1 -- 172.21.15.22:0/1302100615 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184809a6d0 con 0x559d74ad6260 2024-09-15T22:37:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 -- 172.21.15.22:0/1302100615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 msgr2=0x559d74ae0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae0970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18480987a0 tx=0x7f18480d37a0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 -- 172.21.15.22:0/1302100615 shutdown_connections 2024-09-15T22:37:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74adbc30 0x559d74ad1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74ad6ba0 0x559d74ae79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 --2- 172.21.15.22:0/1302100615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae0970 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 -- 172.21.15.22:0/1302100615 >> 172.21.15.22:0/1302100615 conn(0x559d74ad18d0 msgr2=0x559d74ae0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.701+0000 7f1860e0a740 1 -- 172.21.15.22:0/1302100615 shutdown_connections 2024-09-15T22:37:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.702+0000 7f1860e0a740 1 -- 172.21.15.22:0/1302100615 wait complete. 2024-09-15T22:37:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.702+0000 7f1860e0a740 1 -- start start 2024-09-15T22:37:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.702+0000 7f1860e0a740 1 Processor -- start 2024-09-15T22:37:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 0x559d74ae4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74adbc30 0x559d74b54620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18581a9810 con 0x559d74adbc30 2024-09-15T22:37:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18581aac80 con 0x559d74ad6260 2024-09-15T22:37:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18581a9ee0 con 0x559d74ad6ba0 2024-09-15T22:37:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.703+0000 7f1860e0a740 10 client.0 _ll_register_callbacks cb 0x7f18500095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.704+0000 7f1856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.704+0000 7f1856000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 0x559d74ae4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.704+0000 7f1856000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 0x559d74ae4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:34894/0 (socket says 172.21.15.22:34894) 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.704+0000 7f1856000640 1 -- 172.21.15.22:0/941002990 learned_addr learned my addr 172.21.15.22:0/941002990 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.705+0000 7f1857400640 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74adbc30 0x559d74b54620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.705+0000 7f1856000640 1 -- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 msgr2=0x559d74ae4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.705+0000 7f1856000640 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.705+0000 7f1856000640 1 -- 172.21.15.22:0/941002990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74adbc30 msgr2=0x559d74b54620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:37:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.705+0000 7f1856000640 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74adbc30 0x559d74b54620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.705+0000 7f1856000640 1 -- 172.21.15.22:0/941002990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d74ae7b40 con 0x559d74ad6ba0 2024-09-15T22:37:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.706+0000 7f1856000640 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 0x559d74ae4aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1844009850 tx=0x7f18440058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfef7384c357e9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.706+0000 7f1840c00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:37:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.707+0000 7f1840c00640 1 -- 172.21.15.22:0/941002990 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844035040 con 0x559d74ad6ba0 2024-09-15T22:37:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.707+0000 7f1840c00640 1 -- 172.21.15.22:0/941002990 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f18440316b0 con 0x559d74ad6ba0 2024-09-15T22:37:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.707+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f184809ca40 con 0x559d74ad6ba0 2024-09-15T22:37:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.707+0000 7f1840c00640 1 -- 172.21.15.22:0/941002990 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f18440318b0 con 0x559d74ad6ba0 2024-09-15T22:37:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.707+0000 7f1860e0a740 10 client.25459 fetch_fsmap learned FSMap version 25 2024-09-15T22:37:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.707+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d74b5e360 con 0x559d74ad6ba0 2024-09-15T22:37:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.708+0000 7f1840c00640 1 -- 172.21.15.22:0/941002990 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184809ca40 con 0x559d74ad6ba0 2024-09-15T22:37:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.708+0000 7f1840c00640 1 -- 172.21.15.22:0/941002990 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f18440035f0 con 0x559d74ad6ba0 2024-09-15T22:37:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.709+0000 7f1860e0a740 10 client.25459 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:37:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.709+0000 7f1860e0a740 10 client.25459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:37:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.709+0000 7f1860e0a740 20 client.25459 populate_metadata read hostname 'smithi022' 2024-09-15T22:37:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.709+0000 7f1860e0a740 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74b5ec90 0x559d74b610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.709+0000 7f1860e0a740 4 client.25459 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:37:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.709+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d74a42b80 con 0x559d74b5ec90 2024-09-15T22:37:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.710+0000 7f1856a00640 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74b5ec90 0x559d74b610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.712+0000 7f1856a00640 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74b5ec90 0x559d74b610b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48c82a76f7987ca7 server_cookie=e797501fdfc1074b in_seq=0 out_seq=0 2024-09-15T22:37:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.712+0000 7f1840c00640 10 client.25459 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.748+0000 7f1840c00640 1 -- 172.21.15.22:0/941002990 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d74a42b80 con 0x559d74b5ec90 2024-09-15T22:37:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.748+0000 7f1840c00640 10 client.25459 handle_command_reply: tid=0 2024-09-15T22:37:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.748+0000 7f1860e0a740 1 client.25459 shutdown 2024-09-15T22:37:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.748+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 msgr2=0x559d74ae4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.748+0000 7f1860e0a740 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 0x559d74ae4aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1844009850 tx=0x7f18440058d0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 shutdown_connections 2024-09-15T22:37:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559d74b5ec90 0x559d74b610b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559d74ad6ba0 0x559d74ae4aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d74adbc30 0x559d74b54620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 --2- 172.21.15.22:0/941002990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559d74ad6260 0x559d74ae4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1840c00640 0 client.25459 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:37:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 >> 172.21.15.22:0/941002990 conn(0x559d74ad18d0 msgr2=0x559d74ad01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 shutdown_connections 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 1 -- 172.21.15.22:0/941002990 wait complete. 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.749+0000 7f1860e0a740 20 client.25459 trim_cache size 0 max 16384 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:37:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:37:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.750+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f183c0a32c0 msgr2=0x7f183c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.750+0000 7f1857e00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f183c0a32c0 0x7f183c0a5780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1850005fd0 tx=0x7f1850009740 comp rx=0 tx=0).stop 2024-09-15T22:37:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 msgr2=0x7f1858199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 0x7f1858199e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f184800e9f0 tx=0x7f184800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 shutdown_connections 2024-09-15T22:37:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1858100af0 0x7f185819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f183c0a32c0 0x7f183c0a5780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1858101490 0x7f18581a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 --2- 172.21.15.22:0/2313087422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18581001b0 0x7f1858199e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 >> 172.21.15.22:0/2313087422 conn(0x7f18580fbfa0 msgr2=0x7f18580fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 shutdown_connections 2024-09-15T22:37:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:37:51.751+0000 7f1857e00640 1 -- 172.21.15.22:0/2313087422 wait complete. 2024-09-15T22:37:52.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:52 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:52.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:52 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:52.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:52 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:37:52.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:52.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:52.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:52 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:37:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:52.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:52 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:37:53.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:53 smithi112 ceph-mon[35032]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 916 op/s 2024-09-15T22:37:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:53 smithi110 ceph-mon[35282]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 916 op/s 2024-09-15T22:37:53.787 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:53 smithi022 ceph-mon[30634]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 916 op/s 2024-09-15T22:37:55.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:55 smithi112 ceph-mon[35032]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 886 op/s 2024-09-15T22:37:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:55 smithi110 ceph-mon[35282]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 886 op/s 2024-09-15T22:37:55.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:55 smithi022 ceph-mon[30634]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 886 op/s 2024-09-15T22:37:57.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:57 smithi112 ceph-mon[35032]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 240 MiB/s wr, 822 op/s 2024-09-15T22:37:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:57 smithi110 ceph-mon[35282]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 240 MiB/s wr, 822 op/s 2024-09-15T22:37:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:57 smithi022 ceph-mon[30634]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 240 MiB/s wr, 822 op/s 2024-09-15T22:37:59.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:37:59 smithi110 ceph-mon[35282]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 894 op/s 2024-09-15T22:37:59.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:37:59 smithi022 ceph-mon[30634]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 894 op/s 2024-09-15T22:37:59.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:37:59 smithi112 ceph-mon[35032]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 894 op/s 2024-09-15T22:38:01.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:01 smithi110 ceph-mon[35282]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 249 MiB/s wr, 839 op/s 2024-09-15T22:38:01.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:01 smithi022 ceph-mon[30634]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 249 MiB/s wr, 839 op/s 2024-09-15T22:38:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:01 smithi112 ceph-mon[35032]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 249 MiB/s wr, 839 op/s 2024-09-15T22:38:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:03 smithi110 ceph-mon[35282]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 265 MiB/s wr, 904 op/s 2024-09-15T22:38:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:03 smithi022 ceph-mon[30634]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 265 MiB/s wr, 904 op/s 2024-09-15T22:38:03.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:03 smithi112 ceph-mon[35032]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 265 MiB/s wr, 904 op/s 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.942+0000 7fd5b4a00640 1 -- 172.21.15.22:0/1491370800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101f40 msgr2=0x7fd5b0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.942+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/1491370800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101f40 0x7fd5b0109db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009be0 tx=0x7fd5a802a6d0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 -- 172.21.15.22:0/1491370800 shutdown_connections 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/1491370800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b0101580 0x7fd5b0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/1491370800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101f40 0x7fd5b0109db0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/1491370800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b0103050 0x7fd5b0103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 -- 172.21.15.22:0/1491370800 >> 172.21.15.22:0/1491370800 conn(0x7fd5b00fd0d0 msgr2=0x7fd5b00ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 -- 172.21.15.22:0/1491370800 shutdown_connections 2024-09-15T22:38:04.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.943+0000 7fd5b4a00640 1 -- 172.21.15.22:0/1491370800 wait complete. 2024-09-15T22:38:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.944+0000 7fd5b4a00640 1 Processor -- start 2024-09-15T22:38:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.944+0000 7fd5b4a00640 1 -- start start 2024-09-15T22:38:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5b4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 0x7fd5b0199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5b4a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b0101f40 0x7fd5b019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5b4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b0103050 0x7fd5b01a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5b4a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b010d6d0 con 0x7fd5b0101f40 2024-09-15T22:38:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5b4a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b010d550 con 0x7fd5b0101580 2024-09-15T22:38:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5b4a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b010d850 con 0x7fd5b0103050 2024-09-15T22:38:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 0x7fd5b0199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 0x7fd5b0199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:33810/0 (socket says 172.21.15.22:33810) 2024-09-15T22:38:04.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5af400640 1 -- 172.21.15.22:0/3343690471 learned_addr learned my addr 172.21.15.22:0/3343690471 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5aea00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b0101f40 0x7fd5b019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.945+0000 7fd5afe00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b0103050 0x7fd5b01a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5af400640 1 -- 172.21.15.22:0/3343690471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b0103050 msgr2=0x7fd5b01a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5af400640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b0103050 0x7fd5b01a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5af400640 1 -- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b0101f40 msgr2=0x7fd5b019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5af400640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b0101f40 0x7fd5b019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5af400640 1 -- 172.21.15.22:0/3343690471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01a1b40 con 0x7fd5b0101580 2024-09-15T22:38:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5af400640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 0x7fd5b0199f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000e9a0 tx=0x7fd5a000ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5a7e00640 1 -- 172.21.15.22:0/3343690471 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a000cd80 con 0x7fd5b0101580 2024-09-15T22:38:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5a7e00640 1 -- 172.21.15.22:0/3343690471 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a0010910 con 0x7fd5b0101580 2024-09-15T22:38:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5a7e00640 1 -- 172.21.15.22:0/3343690471 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0018a30 con 0x7fd5b0101580 2024-09-15T22:38:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.946+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b01a1e30 con 0x7fd5b0101580 2024-09-15T22:38:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.947+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b01a21e0 con 0x7fd5b0101580 2024-09-15T22:38:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.950+0000 7fd5a7e00640 1 -- 172.21.15.22:0/3343690471 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd5a0010ac0 con 0x7fd5b0101580 2024-09-15T22:38:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.951+0000 7fd5b9009740 1 Processor -- start 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.951+0000 7fd5b9009740 1 -- start start 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a4a70 0x5591891a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 0x5591891a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891ac900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5b9009740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559189101100 con 0x5591891aa440 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5b9009740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5591890a91b0 con 0x5591891a53b0 2024-09-15T22:38:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5b9009740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5591890fd0c0 con 0x5591891a4a70 2024-09-15T22:38:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.952+0000 7fd5a7e00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd5940a32c0 0x7fd5940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.953+0000 7fd5a7e00640 1 -- 172.21.15.22:0/3343690471 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd5a00cfd90 con 0x7fd5b0101580 2024-09-15T22:38:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.954+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 0x5591891a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.954+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 0x5591891a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:33812/0 (socket says 172.21.15.22:33812) 2024-09-15T22:38:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.954+0000 7fd5af400640 1 -- 172.21.15.22:0/1249764020 learned_addr learned my addr 172.21.15.22:0/1249764020 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.954+0000 7fd5aea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.954+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a4a70 0x5591891a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.955+0000 7fd5af400640 1 -- 172.21.15.22:0/1249764020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a4a70 msgr2=0x5591891a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.955+0000 7fd5af400640 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a4a70 0x5591891a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.955+0000 7fd5af400640 1 -- 172.21.15.22:0/1249764020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 msgr2=0x5591891ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.955+0000 7fd5af400640 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.955+0000 7fd5af400640 1 -- 172.21.15.22:0/1249764020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559188e14210 con 0x5591891a53b0 2024-09-15T22:38:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.956+0000 7fd5aea00640 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.956+0000 7fd5afe00640 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a4a70 0x5591891a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.956+0000 7fd5af400640 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 0x5591891a9e70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5a009c070 tx=0x7fd5a0098740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6a4cf2c81aa607d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.957+0000 7fd5afe00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd5940a32c0 0x7fd5940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.957+0000 7fd59be00640 1 -- 172.21.15.22:0/1249764020 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a009c370 con 0x5591891a53b0 2024-09-15T22:38:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.958+0000 7fd59be00640 1 -- 172.21.15.22:0/1249764020 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a00a0720 con 0x5591891a53b0 2024-09-15T22:38:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.958+0000 7fd59be00640 1 -- 172.21.15.22:0/1249764020 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00c0660 con 0x5591891a53b0 2024-09-15T22:38:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.961+0000 7fd5b9009740 1 -- 172.21.15.22:0/1249764020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 msgr2=0x5591891a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.961+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 0x5591891a9e70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5a009c070 tx=0x7fd5a0098740 comp rx=0 tx=0).stop 2024-09-15T22:38:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.961+0000 7fd5afe00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd5940a32c0 0x7fd5940a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5a802abf0 tx=0x7fd5a802a6d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.965+0000 7fd5b9009740 1 -- 172.21.15.22:0/1249764020 shutdown_connections 2024-09-15T22:38:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.965+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.965+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a53b0 0x5591891a9e70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.965+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1249764020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a4a70 0x5591891a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.965+0000 7fd5b9009740 1 -- 172.21.15.22:0/1249764020 >> 172.21.15.22:0/1249764020 conn(0x5591891978d0 msgr2=0x559189197cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.972+0000 7fd5b9009740 1 -- 172.21.15.22:0/1249764020 shutdown_connections 2024-09-15T22:38:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.972+0000 7fd5b9009740 1 -- 172.21.15.22:0/1249764020 wait complete. 2024-09-15T22:38:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.973+0000 7fd5b9009740 1 -- start start 2024-09-15T22:38:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.974+0000 7fd5b9009740 1 Processor -- start 2024-09-15T22:38:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.975+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x55918919dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.976+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x55918919e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.976+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.976+0000 7fd5b9009740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55918919c2a0 con 0x5591891aa440 2024-09-15T22:38:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.976+0000 7fd5b9009740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55918908a090 con 0x5591891a4a70 2024-09-15T22:38:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.976+0000 7fd5b9009740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55918919c420 con 0x5591891a53b0 2024-09-15T22:38:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.976+0000 7fd5b9009740 10 client.0 _ll_register_callbacks cb 0x5591890def30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x55918919dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5aea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x55918919e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5aea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x55918919e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:55018/0 (socket says 172.21.15.22:55018) 2024-09-15T22:38:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5aea00640 1 -- 172.21.15.22:0/904918354 learned_addr learned my addr 172.21.15.22:0/904918354 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5af400640 1 -- 172.21.15.22:0/904918354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 msgr2=0x55918919e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5af400640 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x55918919e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5af400640 1 -- 172.21.15.22:0/904918354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 msgr2=0x5591891a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.977+0000 7fd5af400640 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.978+0000 7fd5af400640 1 -- 172.21.15.22:0/904918354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559188ee0620 con 0x5591891a4a70 2024-09-15T22:38:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.979+0000 7fd5af400640 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x55918919dc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0098d40 tx=0x7fd5a00cd960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d124c31e45c904 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.982+0000 7fd598c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:38:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.982+0000 7fd598c00640 1 -- 172.21.15.22:0/904918354 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a009c370 con 0x5591891a4a70 2024-09-15T22:38:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.982+0000 7fd598c00640 1 -- 172.21.15.22:0/904918354 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd5a00c01b0 con 0x5591891a4a70 2024-09-15T22:38:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.983+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a00a0720 con 0x5591891a4a70 2024-09-15T22:38:04.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:04.991+0000 7fd598c00640 1 -- 172.21.15.22:0/904918354 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5a009b7c0 con 0x5591891a4a70 2024-09-15T22:38:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.002+0000 7fd5b9009740 10 client.25463 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.002+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591891c1800 con 0x5591891a4a70 2024-09-15T22:38:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.003+0000 7fd598c00640 1 -- 172.21.15.22:0/904918354 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a00a0720 con 0x5591891a4a70 2024-09-15T22:38:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.003+0000 7fd598c00640 1 -- 172.21.15.22:0/904918354 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd5a00980c0 con 0x5591891a4a70 2024-09-15T22:38:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5b9009740 10 client.25463 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5b9009740 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5b9009740 20 client.25463 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5b9009740 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5591891c2b50 0x5591891c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5b9009740 4 client.25463 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:38:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55918910e830 con 0x5591891c2b50 2024-09-15T22:38:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.005+0000 7fd5aea00640 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5591891c2b50 0x5591891c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.010+0000 7fd598c00640 10 client.25463 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:05.012 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.010+0000 7fd5aea00640 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5591891c2b50 0x5591891c4f40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bbc52e882dda0de server_cookie=6b987c4da1b14d83 in_seq=0 out_seq=0 2024-09-15T22:38:05.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.011+0000 7fd598c00640 1 -- 172.21.15.22:0/904918354 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55918910e830 con 0x5591891c2b50 2024-09-15T22:38:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.011+0000 7fd598c00640 10 client.25463 handle_command_reply: tid=0 2024-09-15T22:38:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.013+0000 7fd5b9009740 1 client.25463 shutdown 2024-09-15T22:38:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.016+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 msgr2=0x55918919dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.017+0000 7fd5b9009740 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x55918919dc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0098d40 tx=0x7fd5a00cd960 comp rx=0 tx=0).stop 2024-09-15T22:38:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 shutdown_connections 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd5b9009740 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5591891c2b50 0x5591891c4f40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd598c00640 0 client.25463 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd5b9009740 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x55918919e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd5b9009740 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x5591891a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd5b9009740 1 --2- 172.21.15.22:0/904918354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x55918919dc00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.020+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 >> 172.21.15.22:0/904918354 conn(0x5591891978d0 msgr2=0x5591891990e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.021+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 shutdown_connections 2024-09-15T22:38:05.023 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.021+0000 7fd5b9009740 1 -- 172.21.15.22:0/904918354 wait complete. 2024-09-15T22:38:05.024 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.022+0000 7fd5b9009740 20 client.25463 trim_cache size 0 max 16384 2024-09-15T22:38:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.058+0000 7fd5b9009740 1 Processor -- start 2024-09-15T22:38:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.059+0000 7fd5b9009740 1 -- start start 2024-09-15T22:38:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x559189196900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x559189196e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x559189198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5b9009740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01a9740 con 0x5591891aa440 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5b9009740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01a7010 con 0x5591891a4a70 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5b9009740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01a4e40 con 0x5591891a53b0 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x559189198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x559189198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40646/0 (socket says 172.21.15.22:40646) 2024-09-15T22:38:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.060+0000 7fd5afe00640 1 -- 172.21.15.22:0/1838019720 learned_addr learned my addr 172.21.15.22:0/1838019720 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5af400640 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x559189196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5afe00640 1 -- 172.21.15.22:0/1838019720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 msgr2=0x559189196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5aea00640 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x559189196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5afe00640 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x559189196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5afe00640 1 -- 172.21.15.22:0/1838019720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 msgr2=0x559189196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5afe00640 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x559189196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.061+0000 7fd5afe00640 1 -- 172.21.15.22:0/1838019720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591891c52b0 con 0x5591891aa440 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.062+0000 7fd5afe00640 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x559189198cc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009be0 tx=0x7fd5a8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282159c62a94f1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.062+0000 7fd59b400640 1 -- 172.21.15.22:0/1838019720 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a804d020 con 0x5591891aa440 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.063+0000 7fd59b400640 1 -- 172.21.15.22:0/1838019720 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a8003b70 con 0x5591891aa440 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.063+0000 7fd59b400640 1 -- 172.21.15.22:0/1838019720 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8042030 con 0x5591891aa440 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 -- 172.21.15.22:0/1838019720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 msgr2=0x559189198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x559189198cc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009be0 tx=0x7fd5a8005fd0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 -- 172.21.15.22:0/1838019720 shutdown_connections 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891a53b0 0x559189196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891aa440 0x559189198cc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 --2- 172.21.15.22:0/1838019720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891a4a70 0x559189196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.064+0000 7fd5b9009740 1 -- 172.21.15.22:0/1838019720 >> 172.21.15.22:0/1838019720 conn(0x5591891978d0 msgr2=0x5591891961f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.067+0000 7fd5b9009740 1 -- 172.21.15.22:0/1838019720 shutdown_connections 2024-09-15T22:38:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.067+0000 7fd5b9009740 1 -- 172.21.15.22:0/1838019720 wait complete. 2024-09-15T22:38:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.068+0000 7fd5b9009740 1 -- start start 2024-09-15T22:38:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.068+0000 7fd5b9009740 1 Processor -- start 2024-09-15T22:38:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.070+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891aa440 0x5591891d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.070+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891d4c40 0x5591891d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.070+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891aa440 0x5591891d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.070+0000 7fd5b9009740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891d50c0 0x5591891d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.071+0000 7fd5b9009740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01a54d0 con 0x5591891d50c0 2024-09-15T22:38:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.071+0000 7fd5b9009740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01a6940 con 0x5591891aa440 2024-09-15T22:38:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.071+0000 7fd5b9009740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01a5ba0 con 0x5591891d4c40 2024-09-15T22:38:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.071+0000 7fd5aea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891d4c40 0x5591891d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.071+0000 7fd5af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891aa440 0x5591891d4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:33834/0 (socket says 172.21.15.22:33834) 2024-09-15T22:38:05.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.072+0000 7fd5af400640 1 -- 172.21.15.22:0/901441081 learned_addr learned my addr 172.21.15.22:0/901441081 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:05.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.072+0000 7fd5b9009740 10 client.0 _ll_register_callbacks cb 0x7fd5a00a0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:05.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.072+0000 7fd5afe00640 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891d50c0 0x5591891d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.073+0000 7fd5afe00640 1 -- 172.21.15.22:0/901441081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891d4c40 msgr2=0x5591891d5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:05.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.073+0000 7fd5afe00640 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891d4c40 0x5591891d5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.073+0000 7fd5afe00640 1 -- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891aa440 msgr2=0x5591891d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:05.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.073+0000 7fd5afe00640 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891aa440 0x5591891d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.073+0000 7fd5afe00640 1 -- 172.21.15.22:0/901441081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591891d6a20 con 0x5591891d50c0 2024-09-15T22:38:05.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.074+0000 7fd598c00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:38:05.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.074+0000 7fd5afe00640 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891d50c0 0x5591891d61f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009b30 tx=0x7fd5a8004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f50b3ff198b361 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:05.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.076+0000 7fd598c00640 1 -- 172.21.15.22:0/901441081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a804d030 con 0x5591891d50c0 2024-09-15T22:38:05.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.077+0000 7fd598c00640 1 -- 172.21.15.22:0/901441081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fd5a8004580 con 0x5591891d50c0 2024-09-15T22:38:05.079 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.077+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a8003b70 con 0x5591891d50c0 2024-09-15T22:38:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.078+0000 7fd598c00640 1 -- 172.21.15.22:0/901441081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5a8042040 con 0x5591891d50c0 2024-09-15T22:38:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.078+0000 7fd5b9009740 10 client.15399 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.078+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55918922e050 con 0x5591891d50c0 2024-09-15T22:38:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.079+0000 7fd598c00640 1 -- 172.21.15.22:0/901441081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a8003b70 con 0x5591891d50c0 2024-09-15T22:38:05.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.080+0000 7fd598c00640 1 -- 172.21.15.22:0/901441081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd5a8048070 con 0x5591891d50c0 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.081+0000 7fd5b9009740 10 client.15399 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.081+0000 7fd5b9009740 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.081+0000 7fd5b9009740 20 client.15399 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.083+0000 7fd5b9009740 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55918922e930 0x559189230d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.083+0000 7fd5b9009740 4 client.15399 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.083+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559189108b80 con 0x55918922e930 2024-09-15T22:38:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.084+0000 7fd5af400640 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55918922e930 0x559189230d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.084+0000 7fd5af400640 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55918922e930 0x559189230d50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8af646193111684f server_cookie=5643e256ac73513c in_seq=0 out_seq=0 2024-09-15T22:38:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.084+0000 7fd598c00640 10 client.15399 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.116+0000 7fd598c00640 1 -- 172.21.15.22:0/901441081 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559189108b80 con 0x55918922e930 2024-09-15T22:38:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.116+0000 7fd598c00640 10 client.15399 handle_command_reply: tid=0 2024-09-15T22:38:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.116+0000 7fd5b9009740 1 client.15399 shutdown 2024-09-15T22:38:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891d50c0 msgr2=0x5591891d61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891d50c0 0x5591891d61f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009b30 tx=0x7fd5a8004390 comp rx=0 tx=0).stop 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 shutdown_connections 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55918922e930 0x559189230d50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5591891d4c40 0x5591891d5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5591891d50c0 0x5591891d61f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 --2- 172.21.15.22:0/901441081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5591891aa440 0x5591891d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 >> 172.21.15.22:0/901441081 conn(0x5591891978d0 msgr2=0x559189196a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.117+0000 7fd598c00640 0 client.15399 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.118+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 shutdown_connections 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.118+0000 7fd5b9009740 1 -- 172.21.15.22:0/901441081 wait complete. 2024-09-15T22:38:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.118+0000 7fd5b9009740 20 client.15399 trim_cache size 0 max 16384 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd5940a32c0 msgr2=0x7fd5940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd5940a32c0 0x7fd5940a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5a802abf0 tx=0x7fd5a802a6d0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 msgr2=0x7fd5b0199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 0x7fd5b0199f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000e9a0 tx=0x7fd5a000ee60 comp rx=0 tx=0).stop 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 shutdown_connections 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b0103050 0x7fd5b01a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fd5940a32c0 0x7fd5940a5780 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b0101f40 0x7fd5b019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 --2- 172.21.15.22:0/3343690471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5b0101580 0x7fd5b0199f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.120+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 >> 172.21.15.22:0/3343690471 conn(0x7fd5b00fd0d0 msgr2=0x7fd5b0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.121+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 shutdown_connections 2024-09-15T22:38:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:05.121+0000 7fd5b4a00640 1 -- 172.21.15.22:0/3343690471 wait complete. 2024-09-15T22:38:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:05 smithi110 ceph-mon[35282]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 870 op/s 2024-09-15T22:38:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:05 smithi022 ceph-mon[30634]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 870 op/s 2024-09-15T22:38:05.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:05 smithi112 ceph-mon[35032]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 870 op/s 2024-09-15T22:38:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:07 smithi110 ceph-mon[35282]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 254 MiB/s wr, 873 op/s 2024-09-15T22:38:07.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:07 smithi022 ceph-mon[30634]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 254 MiB/s wr, 873 op/s 2024-09-15T22:38:07.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:07 smithi112 ceph-mon[35032]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 254 MiB/s wr, 873 op/s 2024-09-15T22:38:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:09 smithi110 ceph-mon[35282]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 968 op/s 2024-09-15T22:38:09.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:09 smithi022 ceph-mon[30634]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 968 op/s 2024-09-15T22:38:09.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:09 smithi112 ceph-mon[35032]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 279 MiB/s wr, 968 op/s 2024-09-15T22:38:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:11 smithi110 ceph-mon[35282]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 909 op/s 2024-09-15T22:38:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:11 smithi022 ceph-mon[30634]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 909 op/s 2024-09-15T22:38:11.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:11 smithi112 ceph-mon[35032]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 909 op/s 2024-09-15T22:38:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:13 smithi110 ceph-mon[35282]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 936 op/s 2024-09-15T22:38:13.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:13 smithi022 ceph-mon[30634]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 936 op/s 2024-09-15T22:38:13.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:13 smithi112 ceph-mon[35032]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 936 op/s 2024-09-15T22:38:15.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:15 smithi110 ceph-mon[35282]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 900 op/s 2024-09-15T22:38:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:15 smithi022 ceph-mon[30634]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 900 op/s 2024-09-15T22:38:15.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:15 smithi112 ceph-mon[35032]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 900 op/s 2024-09-15T22:38:17.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:17 smithi110 ceph-mon[35282]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 882 op/s 2024-09-15T22:38:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:17 smithi022 ceph-mon[30634]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 882 op/s 2024-09-15T22:38:17.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:17 smithi112 ceph-mon[35032]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 253 MiB/s wr, 882 op/s 2024-09-15T22:38:18.315 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 -- 172.21.15.22:0/1297113828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 msgr2=0x7ff3501047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.315 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 --2- 172.21.15.22:0/1297113828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff3501047b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff340009860 tx=0x7ff34002a340 comp rx=0 tx=0).stop 2024-09-15T22:38:18.315 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 -- 172.21.15.22:0/1297113828 shutdown_connections 2024-09-15T22:38:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 --2- 172.21.15.22:0/1297113828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350107620 0x7ff350109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 --2- 172.21.15.22:0/1297113828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350104cf0 0x7ff3501070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 --2- 172.21.15.22:0/1297113828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff3501047b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 -- 172.21.15.22:0/1297113828 >> 172.21.15.22:0/1297113828 conn(0x7ff3500fbfa0 msgr2=0x7ff3500fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 -- 172.21.15.22:0/1297113828 shutdown_connections 2024-09-15T22:38:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.313+0000 7ff355200640 1 -- 172.21.15.22:0/1297113828 wait complete. 2024-09-15T22:38:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.314+0000 7ff355200640 1 Processor -- start 2024-09-15T22:38:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.314+0000 7ff355200640 1 -- start start 2024-09-15T22:38:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff355200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff350197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff355200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350104cf0 0x7ff3501982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff355200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350107620 0x7ff35019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff355200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff35010d620 con 0x7ff350104cf0 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff355200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff35010d4a0 con 0x7ff350107620 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff355200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff35010d7a0 con 0x7ff3501023c0 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff350197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff350197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41214/0 (socket says 172.21.15.22:41214) 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 -- 172.21.15.22:0/3522594013 learned_addr learned my addr 172.21.15.22:0/3522594013 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34ea00640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350104cf0 0x7ff3501982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34fe00640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350107620 0x7ff35019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 -- 172.21.15.22:0/3522594013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350107620 msgr2=0x7ff35019f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350107620 0x7ff35019f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 -- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350104cf0 msgr2=0x7ff3501982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350104cf0 0x7ff3501982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.319 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34f400640 1 -- 172.21.15.22:0/3522594013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35019f980 con 0x7ff3501023c0 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.315+0000 7ff34fe00640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350107620 0x7ff35019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.316+0000 7ff34f400640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff350197d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff340035040 tx=0x7ff340033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.316+0000 7ff347e00640 1 -- 172.21.15.22:0/3522594013 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340037040 con 0x7ff3501023c0 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.316+0000 7ff347e00640 1 -- 172.21.15.22:0/3522594013 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff340030850 con 0x7ff3501023c0 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.316+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35019fc10 con 0x7ff3501023c0 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.316+0000 7ff347e00640 1 -- 172.21.15.22:0/3522594013 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340004920 con 0x7ff3501023c0 2024-09-15T22:38:18.320 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.316+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3501a0150 con 0x7ff3501023c0 2024-09-15T22:38:18.321 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.319+0000 7ff35985f740 1 Processor -- start 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 -- start start 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350b9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350bc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559f35019100 con 0x559f350b4ba0 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559f34fc11b0 con 0x559f350b9c30 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff35985f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f350150c0 con 0x559f350b4260 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff34ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350bc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff34ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350bc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55824/0 (socket says 172.21.15.22:55824) 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff34ea00640 1 -- 172.21.15.22:0/1118521805 learned_addr learned my addr 172.21.15.22:0/1118521805 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.320+0000 7ff34fe00640 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff34ea00640 1 -- 172.21.15.22:0/1118521805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 msgr2=0x559f350b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff34ea00640 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff34ea00640 1 -- 172.21.15.22:0/1118521805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 msgr2=0x559f350b9660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff34ea00640 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350b9660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff34ea00640 1 -- 172.21.15.22:0/1118521805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f34d2c210 con 0x559f350b9c30 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff34ea00640 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350bc0f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009cc0 tx=0x7ff33c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ffcd772017f387 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff344c00640 1 -- 172.21.15.22:0/1118521805 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c012450 con 0x559f350b9c30 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff344c00640 1 -- 172.21.15.22:0/1118521805 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff33c012ad0 con 0x559f350b9c30 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff347e00640 1 -- 172.21.15.22:0/3522594013 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff340004050 con 0x7ff3501023c0 2024-09-15T22:38:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.321+0000 7ff344c00640 1 -- 172.21.15.22:0/1118521805 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00fc60 con 0x559f350b9c30 2024-09-15T22:38:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 -- 172.21.15.22:0/1118521805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 msgr2=0x559f350bc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350bc0f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009cc0 tx=0x7ff33c0117b0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 -- 172.21.15.22:0/1118521805 shutdown_connections 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350bc0f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 --2- 172.21.15.22:0/1118521805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 -- 172.21.15.22:0/1118521805 >> 172.21.15.22:0/1118521805 conn(0x559f350af8d0 msgr2=0x559f350afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 -- 172.21.15.22:0/1118521805 shutdown_connections 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.322+0000 7ff35985f740 1 -- 172.21.15.22:0/1118521805 wait complete. 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.323+0000 7ff347e00640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3340a31d0 0x7ff3340a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.323+0000 7ff347e00640 1 -- 172.21.15.22:0/3522594013 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff3400ef920 con 0x7ff3501023c0 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.323+0000 7ff34fe00640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3340a31d0 0x7ff3340a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.323+0000 7ff35985f740 1 -- start start 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.323+0000 7ff35985f740 1 Processor -- start 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff34fe00640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3340a31d0 0x7ff3340a5690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff35006a980 tx=0x7ff3480098a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350be980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559f350bcc00 con 0x559f350b4ba0 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559f34fa2090 con 0x559f350b9c30 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f350bcd80 con 0x559f350b4260 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff35985f740 10 client.0 _ll_register_callbacks cb 0x559f34ff6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff34ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff34ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350be980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33092/0 (socket says 172.21.15.22:33092) 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff34fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.324+0000 7ff34ea00640 1 -- 172.21.15.22:0/581368107 learned_addr learned my addr 172.21.15.22:0/581368107 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34f400640 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34ea00640 1 -- 172.21.15.22:0/581368107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 msgr2=0x559f350be440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34ea00640 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350be440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34ea00640 1 -- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 msgr2=0x559f350c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34ea00640 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34ea00640 1 -- 172.21.15.22:0/581368107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f34df8620 con 0x559f350b4ba0 2024-09-15T22:38:18.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff34ea00640 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350be980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff33c011cb0 tx=0x7ff33c012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83356c8743fcc627 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:18.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff339600640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:38:18.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.325+0000 7ff339600640 1 -- 172.21.15.22:0/581368107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c028070 con 0x559f350b4ba0 2024-09-15T22:38:18.331 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff339600640 1 -- 172.21.15.22:0/581368107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff33c00f9a0 con 0x559f350b4ba0 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff33c012ad0 con 0x559f350b4ba0 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff339600640 1 -- 172.21.15.22:0/581368107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff33c00fba0 con 0x559f350b4ba0 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff35985f740 10 client.15408 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f350ccbc0 con 0x559f350b4ba0 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff339600640 1 -- 172.21.15.22:0/581368107 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff33c012ad0 con 0x559f350b4ba0 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff339600640 1 -- 172.21.15.22:0/581368107 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff33c005490 con 0x559f350b4ba0 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff35985f740 10 client.15408 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff35985f740 10 client.15408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.326+0000 7ff35985f740 20 client.15408 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.327+0000 7ff35985f740 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350ce030 0x559f350d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.327+0000 7ff35985f740 4 client.15408 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:38:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.327+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f35026830 con 0x559f350ce030 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.327+0000 7ff34f400640 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350ce030 0x559f350d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.327+0000 7ff34f400640 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350ce030 0x559f350d0420 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=627b3c6c878caa20 server_cookie=ea6c5cb836c8b7c8 in_seq=0 out_seq=0 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.327+0000 7ff339600640 10 client.15408 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff339600640 1 -- 172.21.15.22:0/581368107 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f35026830 con 0x559f350ce030 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff339600640 10 client.15408 handle_command_reply: tid=0 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 client.15408 shutdown 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 msgr2=0x559f350be980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350be980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff33c011cb0 tx=0x7ff33c012eb0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 shutdown_connections 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350ce030 0x559f350d0420 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350be980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 --2- 172.21.15.22:0/581368107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350be440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff339600640 0 client.15408 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.328+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 >> 172.21.15.22:0/581368107 conn(0x559f350af8d0 msgr2=0x559f350b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.329+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 shutdown_connections 2024-09-15T22:38:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.329+0000 7ff35985f740 1 -- 172.21.15.22:0/581368107 wait complete. 2024-09-15T22:38:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.329+0000 7ff35985f740 20 client.15408 trim_cache size 0 max 16384 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 Processor -- start 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 -- start start 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501a9520 con 0x559f350b4ba0 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501a6df0 con 0x559f350b9c30 2024-09-15T22:38:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff35985f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501a4c20 con 0x559f350b4260 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff34fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff34fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55834/0 (socket says 172.21.15.22:55834) 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff34fe00640 1 -- 172.21.15.22:0/2679197023 learned_addr learned my addr 172.21.15.22:0/2679197023 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.365+0000 7ff34f400640 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.366+0000 7ff34ea00640 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.366+0000 7ff34fe00640 1 -- 172.21.15.22:0/2679197023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 msgr2=0x559f350ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.366+0000 7ff34fe00640 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.366+0000 7ff34fe00640 1 -- 172.21.15.22:0/2679197023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 msgr2=0x559f350c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.367+0000 7ff34fe00640 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.367+0000 7ff34fe00640 1 -- 172.21.15.22:0/2679197023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f350d0a50 con 0x559f350b9c30 2024-09-15T22:38:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.367+0000 7ff34ea00640 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.370+0000 7ff34fe00640 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350b0cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff348010740 tx=0x7ff348015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839acaea4096b82d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:18.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.371+0000 7ff33be00640 1 -- 172.21.15.22:0/2679197023 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348004b20 con 0x559f350b9c30 2024-09-15T22:38:18.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.371+0000 7ff33be00640 1 -- 172.21.15.22:0/2679197023 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff348004cc0 con 0x559f350b9c30 2024-09-15T22:38:18.373 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.371+0000 7ff33be00640 1 -- 172.21.15.22:0/2679197023 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348027670 con 0x559f350b9c30 2024-09-15T22:38:18.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.372+0000 7ff35985f740 1 -- 172.21.15.22:0/2679197023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 msgr2=0x559f350b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.372+0000 7ff35985f740 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350b0cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff348010740 tx=0x7ff348015000 comp rx=0 tx=0).stop 2024-09-15T22:38:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 -- 172.21.15.22:0/2679197023 shutdown_connections 2024-09-15T22:38:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b9c30 0x559f350b0cc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4ba0 0x559f350c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 --2- 172.21.15.22:0/2679197023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b4260 0x559f350ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 -- 172.21.15.22:0/2679197023 >> 172.21.15.22:0/2679197023 conn(0x559f350af8d0 msgr2=0x559f350ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 -- 172.21.15.22:0/2679197023 shutdown_connections 2024-09-15T22:38:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 -- 172.21.15.22:0/2679197023 wait complete. 2024-09-15T22:38:18.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.374+0000 7ff35985f740 1 -- start start 2024-09-15T22:38:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 Processor -- start 2024-09-15T22:38:18.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 0x559f350c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b4ba0 0x559f350c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b9c30 0x559f350c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501a52b0 con 0x559f350b4260 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501a6720 con 0x559f350b4ba0 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501a5980 con 0x559f350b9c30 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.375+0000 7ff35985f740 10 client.0 _ll_register_callbacks cb 0x7ff348009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.376+0000 7ff34f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 0x559f350c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.376+0000 7ff34fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b9c30 0x559f350c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.376+0000 7ff34fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b9c30 0x559f350c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41254/0 (socket says 172.21.15.22:41254) 2024-09-15T22:38:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.376+0000 7ff34f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 0x559f350c2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33110/0 (socket says 172.21.15.22:33110) 2024-09-15T22:38:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.376+0000 7ff34fe00640 1 -- 172.21.15.22:0/1022696803 learned_addr learned my addr 172.21.15.22:0/1022696803 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.376+0000 7ff34ea00640 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b4ba0 0x559f350c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff34f400640 1 -- 172.21.15.22:0/1022696803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b9c30 msgr2=0x559f350c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff34f400640 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b9c30 0x559f350c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff34f400640 1 -- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b4ba0 msgr2=0x559f350c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff34f400640 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b4ba0 0x559f350c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff34f400640 1 -- 172.21.15.22:0/1022696803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f350c46b0 con 0x559f350b4260 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff34f400640 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 0x559f350c2c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x559f350b55d0 tx=0x7ff340005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09c18f32de6f5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff339600640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff339600640 1 -- 172.21.15.22:0/1022696803 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400bbf40 con 0x559f350b4260 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff339600640 1 -- 172.21.15.22:0/1022696803 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff340004340 con 0x559f350b4260 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.377+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff348004cc0 con 0x559f350b4260 2024-09-15T22:38:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.378+0000 7ff339600640 1 -- 172.21.15.22:0/1022696803 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff3400c02f0 con 0x559f350b4260 2024-09-15T22:38:18.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.378+0000 7ff35985f740 10 client.15414 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:18.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.378+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f350c5a90 con 0x559f350b4260 2024-09-15T22:38:18.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.378+0000 7ff339600640 1 -- 172.21.15.22:0/1022696803 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff348004cc0 con 0x559f350b4260 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.378+0000 7ff339600640 1 -- 172.21.15.22:0/1022696803 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff34003a070 con 0x559f350b4260 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff35985f740 10 client.15414 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff35985f740 10 client.15414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff35985f740 20 client.15414 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff35985f740 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350c6570 0x559f350c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff35985f740 4 client.15414 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f350aac80 con 0x559f350c6570 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.379+0000 7ff34ea00640 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350c6570 0x559f350c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.380+0000 7ff34ea00640 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350c6570 0x559f350c8990 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce2473b13dc0681a server_cookie=329a1f12fe746bb2 in_seq=0 out_seq=0 2024-09-15T22:38:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.380+0000 7ff339600640 10 client.15414 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.395+0000 7ff339600640 1 -- 172.21.15.22:0/1022696803 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f350aac80 con 0x559f350c6570 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.395+0000 7ff339600640 10 client.15414 handle_command_reply: tid=0 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.395+0000 7ff35985f740 1 client.15414 shutdown 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 msgr2=0x559f350c2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 0x559f350c2c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x559f350b55d0 tx=0x7ff340005f90 comp rx=0 tx=0).stop 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 shutdown_connections 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559f350c6570 0x559f350c8990 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f350b9c30 0x559f350c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559f350b4ba0 0x559f350c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 --2- 172.21.15.22:0/1022696803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559f350b4260 0x559f350c2c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 >> 172.21.15.22:0/1022696803 conn(0x559f350af8d0 msgr2=0x559f350aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff339600640 0 client.15414 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 shutdown_connections 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 1 -- 172.21.15.22:0/1022696803 wait complete. 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.396+0000 7ff35985f740 20 client.15414 trim_cache size 0 max 16384 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:38:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3340a31d0 msgr2=0x7ff3340a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3340a31d0 0x7ff3340a5690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff35006a980 tx=0x7ff3480098a0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 msgr2=0x7ff350197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff350197d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff340035040 tx=0x7ff340033d90 comp rx=0 tx=0).stop 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 shutdown_connections 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff3340a31d0 0x7ff3340a5690 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff350107620 0x7ff35019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350104cf0 0x7ff3501982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 --2- 172.21.15.22:0/3522594013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3501023c0 0x7ff350197d60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 >> 172.21.15.22:0/3522594013 conn(0x7ff3500fbfa0 msgr2=0x7ff350102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 shutdown_connections 2024-09-15T22:38:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:18.397+0000 7ff355200640 1 -- 172.21.15.22:0/3522594013 wait complete. 2024-09-15T22:38:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:19 smithi110 ceph-mon[35282]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 936 op/s 2024-09-15T22:38:19.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:19 smithi022 ceph-mon[30634]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 936 op/s 2024-09-15T22:38:19.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:19 smithi112 ceph-mon[35032]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 936 op/s 2024-09-15T22:38:21.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:21 smithi110 ceph-mon[35282]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 863 op/s 2024-09-15T22:38:21.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:21 smithi022 ceph-mon[30634]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 863 op/s 2024-09-15T22:38:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:21 smithi112 ceph-mon[35032]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 863 op/s 2024-09-15T22:38:23.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:23 smithi110 ceph-mon[35282]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 267 MiB/s wr, 912 op/s 2024-09-15T22:38:23.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:23 smithi022 ceph-mon[30634]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 267 MiB/s wr, 912 op/s 2024-09-15T22:38:23.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:23 smithi112 ceph-mon[35032]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 267 MiB/s wr, 912 op/s 2024-09-15T22:38:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:25 smithi022 ceph-mon[30634]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 890 op/s 2024-09-15T22:38:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:25 smithi112 ceph-mon[35032]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 890 op/s 2024-09-15T22:38:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:25 smithi110 ceph-mon[35282]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 890 op/s 2024-09-15T22:38:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:27 smithi022 ceph-mon[30634]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 249 MiB/s wr, 854 op/s 2024-09-15T22:38:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:27 smithi112 ceph-mon[35032]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 249 MiB/s wr, 854 op/s 2024-09-15T22:38:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:27 smithi110 ceph-mon[35282]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 249 MiB/s wr, 854 op/s 2024-09-15T22:38:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:29 smithi022 ceph-mon[30634]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 923 op/s 2024-09-15T22:38:29.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:29 smithi112 ceph-mon[35032]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 923 op/s 2024-09-15T22:38:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:29 smithi110 ceph-mon[35282]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 923 op/s 2024-09-15T22:38:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 -- 172.21.15.22:0/2859085961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 msgr2=0x7fbe481088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 --2- 172.21.15.22:0/2859085961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe481088c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe380098b0 tx=0x7fbe3802a390 comp rx=0 tx=0).stop 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 -- 172.21.15.22:0/2859085961 shutdown_connections 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 --2- 172.21.15.22:0/2859085961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109310 0x7fbe48109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 --2- 172.21.15.22:0/2859085961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe48109cd0 0x7fbe48110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 --2- 172.21.15.22:0/2859085961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe481088c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 -- 172.21.15.22:0/2859085961 >> 172.21.15.22:0/2859085961 conn(0x7fbe4806b6d0 msgr2=0x7fbe48079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 -- 172.21.15.22:0/2859085961 shutdown_connections 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.592+0000 7fbe4d600640 1 -- 172.21.15.22:0/2859085961 wait complete. 2024-09-15T22:38:31.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 Processor -- start 2024-09-15T22:38:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 -- start start 2024-09-15T22:38:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe4819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe48109310 0x7fbe4819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109cd0 0x7fbe481a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe48113e70 con 0x7fbe481084c0 2024-09-15T22:38:31.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe48113cf0 con 0x7fbe48109310 2024-09-15T22:38:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.594+0000 7fbe4d600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe48113ff0 con 0x7fbe48109cd0 2024-09-15T22:38:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.595+0000 7fbe46a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe4819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.595+0000 7fbe46a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe4819e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33884/0 (socket says 172.21.15.22:33884) 2024-09-15T22:38:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.595+0000 7fbe46a00640 1 -- 172.21.15.22:0/1652023880 learned_addr learned my addr 172.21.15.22:0/1652023880 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.595+0000 7fbe46000640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe48109310 0x7fbe4819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.595+0000 7fbe47400640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109cd0 0x7fbe481a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe46a00640 1 -- 172.21.15.22:0/1652023880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109cd0 msgr2=0x7fbe481a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe46a00640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109cd0 0x7fbe481a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe46a00640 1 -- 172.21.15.22:0/1652023880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe48109310 msgr2=0x7fbe4819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe46a00640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe48109310 0x7fbe4819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe46a00640 1 -- 172.21.15.22:0/1652023880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4807ab70 con 0x7fbe481084c0 2024-09-15T22:38:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe47400640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109cd0 0x7fbe481a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.596+0000 7fbe46a00640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe4819e430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe38030550 tx=0x7fbe38033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.597+0000 7fbe3f400640 1 -- 172.21.15.22:0/1652023880 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38037040 con 0x7fbe481084c0 2024-09-15T22:38:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.597+0000 7fbe3f400640 1 -- 172.21.15.22:0/1652023880 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe38030920 con 0x7fbe481084c0 2024-09-15T22:38:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.597+0000 7fbe3f400640 1 -- 172.21.15.22:0/1652023880 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe380046c0 con 0x7fbe481084c0 2024-09-15T22:38:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.598+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4807ae00 con 0x7fbe481084c0 2024-09-15T22:38:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.598+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4807b320 con 0x7fbe481084c0 2024-09-15T22:38:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.605+0000 7fbe503ff740 1 Processor -- start 2024-09-15T22:38:31.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.607+0000 7fbe3f400640 1 -- 172.21.15.22:0/1652023880 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fbe38004050 con 0x7fbe481084c0 2024-09-15T22:38:31.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.607+0000 7fbe503ff740 1 -- start start 2024-09-15T22:38:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478da490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478df490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe503ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56274783f100 con 0x5627478da9d0 2024-09-15T22:38:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe503ff740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627477e71b0 con 0x5627478da090 2024-09-15T22:38:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe503ff740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56274783b0c0 con 0x5627478dfa60 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe47400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe47400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478da490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39746/0 (socket says 172.21.15.22:39746) 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe47400640 1 -- 172.21.15.22:0/4148508002 learned_addr learned my addr 172.21.15.22:0/4148508002 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.608+0000 7fbe46a00640 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.609+0000 7fbe47400640 1 -- 172.21.15.22:0/4148508002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 msgr2=0x5627478e1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.609+0000 7fbe47400640 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.609+0000 7fbe47400640 1 -- 172.21.15.22:0/4148508002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 msgr2=0x5627478df490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.609+0000 7fbe47400640 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478df490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.609+0000 7fbe47400640 1 -- 172.21.15.22:0/4148508002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562747552210 con 0x5627478da090 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.609+0000 7fbe47400640 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478da490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c450 tx=0x7fbe4000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f29ba94dc8a8fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.610+0000 7fbe33400640 1 -- 172.21.15.22:0/4148508002 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40007430 con 0x5627478da090 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.610+0000 7fbe33400640 1 -- 172.21.15.22:0/4148508002 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe40007ab0 con 0x5627478da090 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.610+0000 7fbe33400640 1 -- 172.21.15.22:0/4148508002 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000ab00 con 0x5627478da090 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.610+0000 7fbe3f400640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe2c0a3460 0x7fbe2c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.610+0000 7fbe3f400640 1 -- 172.21.15.22:0/1652023880 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbe380ef680 con 0x7fbe481084c0 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 -- 172.21.15.22:0/4148508002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 msgr2=0x5627478da490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478da490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c450 tx=0x7fbe4000c910 comp rx=0 tx=0).stop 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 -- 172.21.15.22:0/4148508002 shutdown_connections 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478e1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478df490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 --2- 172.21.15.22:0/4148508002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478da490 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 -- 172.21.15.22:0/4148508002 >> 172.21.15.22:0/4148508002 conn(0x5627478d5700 msgr2=0x5627478d5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 -- 172.21.15.22:0/4148508002 shutdown_connections 2024-09-15T22:38:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.611+0000 7fbe503ff740 1 -- 172.21.15.22:0/4148508002 wait complete. 2024-09-15T22:38:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.612+0000 7fbe503ff740 1 -- start start 2024-09-15T22:38:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.612+0000 7fbe503ff740 1 Processor -- start 2024-09-15T22:38:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.613+0000 7fbe46a00640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe2c0a3460 0x7fbe2c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.614+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.614+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.615+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.615+0000 7fbe503ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627478e2a30 con 0x5627478da9d0 2024-09-15T22:38:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.615+0000 7fbe503ff740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627477c8090 con 0x5627478da090 2024-09-15T22:38:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.615+0000 7fbe503ff740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5627478e2bb0 con 0x5627478dfa60 2024-09-15T22:38:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.616+0000 7fbe503ff740 10 client.0 _ll_register_callbacks cb 0x56274781cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.615+0000 7fbe46000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.616+0000 7fbe46000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478e47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33912/0 (socket says 172.21.15.22:33912) 2024-09-15T22:38:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.616+0000 7fbe46000640 1 -- 172.21.15.22:0/313111103 learned_addr learned my addr 172.21.15.22:0/313111103 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.616+0000 7fbe46a00640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe2c0a3460 0x7fbe2c0a5920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbe380bb9a0 tx=0x7fbe38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:31.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.616+0000 7fbe47400640 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.617+0000 7fbe47400640 1 -- 172.21.15.22:0/313111103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 msgr2=0x5627478eb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.617+0000 7fbe47400640 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.617+0000 7fbe47400640 1 -- 172.21.15.22:0/313111103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 msgr2=0x5627478e47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.617+0000 7fbe47400640 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478e47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.617+0000 7fbe47400640 1 -- 172.21.15.22:0/313111103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274761e620 con 0x5627478da090 2024-09-15T22:38:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.620+0000 7fbe47400640 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478e4270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000ce10 tx=0x7fbe40007660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d0dfd028ead54c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.621+0000 7fbe27e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:38:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.621+0000 7fbe27e00640 1 -- 172.21.15.22:0/313111103 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40009c30 con 0x5627478da090 2024-09-15T22:38:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.621+0000 7fbe27e00640 1 -- 172.21.15.22:0/313111103 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbe40012040 con 0x5627478da090 2024-09-15T22:38:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.622+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe40007ab0 con 0x5627478da090 2024-09-15T22:38:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.622+0000 7fbe27e00640 1 -- 172.21.15.22:0/313111103 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe4000a880 con 0x5627478da090 2024-09-15T22:38:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.622+0000 7fbe503ff740 10 client.25493 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.622+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627478ee630 con 0x5627478da090 2024-09-15T22:38:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe27e00640 1 -- 172.21.15.22:0/313111103 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe40007ab0 con 0x5627478da090 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe27e00640 1 -- 172.21.15.22:0/313111103 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe40028b40 con 0x5627478da090 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe503ff740 10 client.25493 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe503ff740 10 client.25493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe503ff740 20 client.25493 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe503ff740 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5627478efae0 0x5627478f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe503ff740 4 client.25493 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:38:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.623+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56274784c830 con 0x5627478efae0 2024-09-15T22:38:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.624+0000 7fbe46000640 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5627478efae0 0x5627478f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.625+0000 7fbe46000640 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5627478efae0 0x5627478f1ed0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98c09aacb711e8a server_cookie=4f0dfbee01f6f47c in_seq=0 out_seq=0 2024-09-15T22:38:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.625+0000 7fbe27e00640 10 client.25493 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.626+0000 7fbe27e00640 1 -- 172.21.15.22:0/313111103 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56274784c830 con 0x5627478efae0 2024-09-15T22:38:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.626+0000 7fbe27e00640 10 client.25493 handle_command_reply: tid=0 2024-09-15T22:38:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.626+0000 7fbe503ff740 1 client.25493 shutdown 2024-09-15T22:38:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 msgr2=0x5627478e4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478e4270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000ce10 tx=0x7fbe40007660 comp rx=0 tx=0).stop 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 shutdown_connections 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5627478efae0 0x5627478f1ed0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 --2- 172.21.15.22:0/313111103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478e4270 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 >> 172.21.15.22:0/313111103 conn(0x5627478d5700 msgr2=0x5627478d6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.627+0000 7fbe27e00640 0 client.25493 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.628+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 shutdown_connections 2024-09-15T22:38:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.628+0000 7fbe503ff740 1 -- 172.21.15.22:0/313111103 wait complete. 2024-09-15T22:38:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.628+0000 7fbe503ff740 20 client.25493 trim_cache size 0 max 16384 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 Processor -- start 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 -- start start 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478d6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478d7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4806f400 con 0x5627478da9d0 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4806ccd0 con 0x5627478da090 2024-09-15T22:38:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.650+0000 7fbe503ff740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe48082140 con 0x5627478dfa60 2024-09-15T22:38:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe47400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478d6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe47400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478d6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39768/0 (socket says 172.21.15.22:39768) 2024-09-15T22:38:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe47400640 1 -- 172.21.15.22:0/2811279463 learned_addr learned my addr 172.21.15.22:0/2811279463 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe46000640 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe47400640 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe46000640 1 -- 172.21.15.22:0/2811279463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 msgr2=0x5627478d7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe46000640 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478d7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe46000640 1 -- 172.21.15.22:0/2811279463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 msgr2=0x5627478d6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.651+0000 7fbe46000640 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478d6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.652+0000 7fbe46000640 1 -- 172.21.15.22:0/2811279463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627478daeb0 con 0x5627478da9d0 2024-09-15T22:38:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.652+0000 7fbe47400640 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478d6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:38:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.652+0000 7fbe46000640 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478eb7b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5627478f26b0 tx=0x7fbe34012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746ede1863b47c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.653+0000 7fbe32a00640 1 -- 172.21.15.22:0/2811279463 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34004050 con 0x5627478da9d0 2024-09-15T22:38:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.653+0000 7fbe32a00640 1 -- 172.21.15.22:0/2811279463 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe340041f0 con 0x5627478da9d0 2024-09-15T22:38:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.653+0000 7fbe32a00640 1 -- 172.21.15.22:0/2811279463 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34010690 con 0x5627478da9d0 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 -- 172.21.15.22:0/2811279463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 msgr2=0x5627478eb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478eb7b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5627478f26b0 tx=0x7fbe34012820 comp rx=0 tx=0).stop 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 -- 172.21.15.22:0/2811279463 shutdown_connections 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478dfa60 0x5627478d7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478da9d0 0x5627478eb7b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 --2- 172.21.15.22:0/2811279463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da090 0x5627478d6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 -- 172.21.15.22:0/2811279463 >> 172.21.15.22:0/2811279463 conn(0x5627478d5700 msgr2=0x5627478d4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 -- 172.21.15.22:0/2811279463 shutdown_connections 2024-09-15T22:38:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.654+0000 7fbe503ff740 1 -- 172.21.15.22:0/2811279463 wait complete. 2024-09-15T22:38:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.655+0000 7fbe503ff740 1 -- start start 2024-09-15T22:38:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.655+0000 7fbe503ff740 1 Processor -- start 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.655+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478da090 0x5627478e8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 0x5627478e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe503ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478dfa60 0x562747958730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe503ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe480827d0 con 0x5627478dfa60 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe503ff740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4806c600 con 0x5627478da9d0 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe503ff740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe48082ea0 con 0x5627478da090 2024-09-15T22:38:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe503ff740 10 client.0 _ll_register_callbacks cb 0x7fbe40009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478da090 0x5627478e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe46000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 0x5627478e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe47400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478da090 0x5627478e8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:53248/0 (socket says 172.21.15.22:53248) 2024-09-15T22:38:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe47400640 1 -- 172.21.15.22:0/329808452 learned_addr learned my addr 172.21.15.22:0/329808452 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe46000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 0x5627478e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39776/0 (socket says 172.21.15.22:39776) 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.656+0000 7fbe47400640 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478dfa60 0x562747958730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe46000640 1 -- 172.21.15.22:0/329808452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478da090 msgr2=0x5627478e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe46000640 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478da090 0x5627478e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe46000640 1 -- 172.21.15.22:0/329808452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478dfa60 msgr2=0x562747958730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe46000640 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478dfa60 0x562747958730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe46000640 1 -- 172.21.15.22:0/329808452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562747958c70 con 0x5627478da9d0 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe46000640 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 0x5627478e8bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5627478ec1e0 tx=0x7fbe34003ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e0ffe06dfb4364 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe27e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe27e00640 1 -- 172.21.15.22:0/329808452 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3402a020 con 0x5627478da9d0 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe340041f0 con 0x5627478da9d0 2024-09-15T22:38:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.657+0000 7fbe27e00640 1 -- 172.21.15.22:0/329808452 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbe340035f0 con 0x5627478da9d0 2024-09-15T22:38:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe27e00640 1 -- 172.21.15.22:0/329808452 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe34004050 con 0x5627478da9d0 2024-09-15T22:38:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe503ff740 10 client.25499 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562747959f00 con 0x5627478da9d0 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe27e00640 1 -- 172.21.15.22:0/329808452 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe340041f0 con 0x5627478da9d0 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe27e00640 1 -- 172.21.15.22:0/329808452 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe34004730 con 0x5627478da9d0 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe503ff740 10 client.25499 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe503ff740 10 client.25499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe503ff740 20 client.25499 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.658+0000 7fbe503ff740 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56274795a860 0x56274795cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.659+0000 7fbe503ff740 4 client.25499 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.659+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562747846b80 con 0x56274795a860 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.659+0000 7fbe47400640 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56274795a860 0x56274795cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.660+0000 7fbe47400640 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56274795a860 0x56274795cc80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d4a53d0806258a7 server_cookie=740a2682bca7327 in_seq=0 out_seq=0 2024-09-15T22:38:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.660+0000 7fbe27e00640 10 client.25499 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe27e00640 1 -- 172.21.15.22:0/329808452 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562747846b80 con 0x56274795a860 2024-09-15T22:38:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe27e00640 10 client.25499 handle_command_reply: tid=0 2024-09-15T22:38:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 client.25499 shutdown 2024-09-15T22:38:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 msgr2=0x5627478e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 0x5627478e8bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5627478ec1e0 tx=0x7fbe34003ec0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 shutdown_connections 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56274795a860 0x56274795cc80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627478dfa60 0x562747958730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627478da9d0 0x5627478e8bc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 --2- 172.21.15.22:0/329808452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5627478da090 0x5627478e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe27e00640 0 client.25499 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 >> 172.21.15.22:0/329808452 conn(0x5627478d5700 msgr2=0x5627478d5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 shutdown_connections 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 1 -- 172.21.15.22:0/329808452 wait complete. 2024-09-15T22:38:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.675+0000 7fbe503ff740 20 client.25499 trim_cache size 0 max 16384 2024-09-15T22:38:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:38:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:38:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:38:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:38:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe2c0a3460 msgr2=0x7fbe2c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe2c0a3460 0x7fbe2c0a5920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbe380bb9a0 tx=0x7fbe38005f90 comp rx=0 tx=0).stop 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 msgr2=0x7fbe4819e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe4819e430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe38030550 tx=0x7fbe38033d90 comp rx=0 tx=0).stop 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 shutdown_connections 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe48109cd0 0x7fbe481a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbe2c0a3460 0x7fbe2c0a5920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe48109310 0x7fbe4819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 --2- 172.21.15.22:0/1652023880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe481084c0 0x7fbe4819e430 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.676+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 >> 172.21.15.22:0/1652023880 conn(0x7fbe4806b6d0 msgr2=0x7fbe4810c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.677+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 shutdown_connections 2024-09-15T22:38:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:31.677+0000 7fbe4d600640 1 -- 172.21.15.22:0/1652023880 wait complete. 2024-09-15T22:38:31.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:31 smithi112 ceph-mon[35032]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 881 op/s 2024-09-15T22:38:31.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:31 smithi110 ceph-mon[35282]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 881 op/s 2024-09-15T22:38:32.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:31 smithi022 ceph-mon[30634]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 881 op/s 2024-09-15T22:38:33.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:33 smithi112 ceph-mon[35032]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 946 op/s 2024-09-15T22:38:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:33 smithi110 ceph-mon[35282]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 946 op/s 2024-09-15T22:38:34.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:33 smithi022 ceph-mon[30634]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 946 op/s 2024-09-15T22:38:35.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:35 smithi112 ceph-mon[35032]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 264 MiB/s wr, 929 op/s 2024-09-15T22:38:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:35 smithi110 ceph-mon[35282]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 264 MiB/s wr, 929 op/s 2024-09-15T22:38:36.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:35 smithi022 ceph-mon[30634]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 264 MiB/s wr, 929 op/s 2024-09-15T22:38:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:37 smithi112 ceph-mon[35032]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 920 op/s 2024-09-15T22:38:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:37 smithi110 ceph-mon[35282]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 920 op/s 2024-09-15T22:38:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:37 smithi022 ceph-mon[30634]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 920 op/s 2024-09-15T22:38:39.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:39 smithi112 ceph-mon[35032]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 283 MiB/s wr, 1.00k op/s 2024-09-15T22:38:39.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:39 smithi110 ceph-mon[35282]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 283 MiB/s wr, 1.00k op/s 2024-09-15T22:38:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:39 smithi022 ceph-mon[30634]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 283 MiB/s wr, 1.00k op/s 2024-09-15T22:38:41.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:41 smithi112 ceph-mon[35032]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 934 op/s 2024-09-15T22:38:41.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:41 smithi110 ceph-mon[35282]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 934 op/s 2024-09-15T22:38:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:41 smithi022 ceph-mon[30634]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 934 op/s 2024-09-15T22:38:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:43 smithi110 ceph-mon[35282]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 269 MiB/s wr, 954 op/s 2024-09-15T22:38:44.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:43 smithi022 ceph-mon[30634]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 269 MiB/s wr, 954 op/s 2024-09-15T22:38:44.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:43 smithi112 ceph-mon[35032]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 269 MiB/s wr, 954 op/s 2024-09-15T22:38:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2477491409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc109930 msgr2=0x7ff8bc109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2477491409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc109930 0x7ff8bc109d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009900 tx=0x7ff8a802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2477491409 shutdown_connections 2024-09-15T22:38:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2477491409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc0737d0 0x7ff8bc112540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2477491409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc072d20 0x7ff8bc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2477491409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc109930 0x7ff8bc109d30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.897+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2477491409 >> 172.21.15.22:0/2477491409 conn(0x7ff8bc06ece0 msgr2=0x7ff8bc071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.898+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2477491409 shutdown_connections 2024-09-15T22:38:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.898+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2477491409 wait complete. 2024-09-15T22:38:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.899+0000 7ff8c0a00640 1 Processor -- start 2024-09-15T22:38:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 -- start start 2024-09-15T22:38:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc072d20 0x7ff8bc19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc0737d0 0x7ff8bc19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc1a3ab0 0x7ff8bc1a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc113e10 con 0x7ff8bc1a3ab0 2024-09-15T22:38:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc113c90 con 0x7ff8bc0737d0 2024-09-15T22:38:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8c0a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc113f90 con 0x7ff8bc072d20 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc072d20 0x7ff8bc19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8b9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc0737d0 0x7ff8bc19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc072d20 0x7ff8bc19e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35876/0 (socket says 172.21.15.22:35876) 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.900+0000 7ff8b9e00640 1 -- 172.21.15.22:0/2193038874 learned_addr learned my addr 172.21.15.22:0/2193038874 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.901+0000 7ff8b9400640 1 -- 172.21.15.22:0/2193038874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc072d20 msgr2=0x7ff8bc19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.901+0000 7ff8b9400640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc072d20 0x7ff8bc19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.901+0000 7ff8b9400640 1 -- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc1a3ab0 msgr2=0x7ff8bc1a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.901+0000 7ff8b9400640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc1a3ab0 0x7ff8bc1a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.901+0000 7ff8b9400640 1 -- 172.21.15.22:0/2193038874 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc1a6510 con 0x7ff8bc0737d0 2024-09-15T22:38:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.901+0000 7ff8b9400640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc0737d0 0x7ff8bc19ea50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400eb00 tx=0x7ff8b400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.906+0000 7ff8b2a00640 1 -- 172.21.15.22:0/2193038874 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4010430 con 0x7ff8bc0737d0 2024-09-15T22:38:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.906+0000 7ff8b2a00640 1 -- 172.21.15.22:0/2193038874 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8b4010ab0 con 0x7ff8bc0737d0 2024-09-15T22:38:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.906+0000 7ff8b2a00640 1 -- 172.21.15.22:0/2193038874 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4017bb0 con 0x7ff8bc0737d0 2024-09-15T22:38:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.906+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc1a6800 con 0x7ff8bc0737d0 2024-09-15T22:38:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.906+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc1a6d00 con 0x7ff8bc0737d0 2024-09-15T22:38:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.913+0000 7ff8c38c8740 1 Processor -- start 2024-09-15T22:38:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 -- start start 2024-09-15T22:38:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbdd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbdff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9bbb3d100 con 0x55b9bbbdda60 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b9bbae51b0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b9bbb390c0 con 0x55b9bbbd8090 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.914+0000 7ff8ba800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.915+0000 7ff8ba800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35888/0 (socket says 172.21.15.22:35888) 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.915+0000 7ff8ba800640 1 -- 172.21.15.22:0/39032677 learned_addr learned my addr 172.21.15.22:0/39032677 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8b9400640 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbdff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8b2a00640 1 -- 172.21.15.22:0/2193038874 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff8b4010c60 con 0x7ff8bc0737d0 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8ba800640 1 -- 172.21.15.22:0/39032677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 msgr2=0x55b9bbbdd490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8ba800640 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbdd490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8ba800640 1 -- 172.21.15.22:0/39032677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 msgr2=0x55b9bbbdff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8ba800640 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbdff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.916+0000 7ff8ba800640 1 -- 172.21.15.22:0/39032677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9bb850210 con 0x55b9bbbd8090 2024-09-15T22:38:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.917+0000 7ff8ba800640 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd8490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00a9f0 tx=0x7ff8ac00aeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a68ed69b3dcae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.918+0000 7ff8b2a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8a00a7940 0x7ff8a00a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.921+0000 7ff8b2a00640 1 -- 172.21.15.22:0/2193038874 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff8b40d02b0 con 0x7ff8bc0737d0 2024-09-15T22:38:44.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.921+0000 7ff8a7000640 1 -- 172.21.15.22:0/39032677 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00cde0 con 0x55b9bbbd8090 2024-09-15T22:38:44.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.921+0000 7ff8a7000640 1 -- 172.21.15.22:0/39032677 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac00f930 con 0x55b9bbbd8090 2024-09-15T22:38:44.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.921+0000 7ff8a7000640 1 -- 172.21.15.22:0/39032677 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac018b50 con 0x55b9bbbd8090 2024-09-15T22:38:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.925+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8a00a7940 0x7ff8a00a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.928+0000 7ff8c38c8740 1 -- 172.21.15.22:0/39032677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 msgr2=0x55b9bbbd8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.928+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd8490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00a9f0 tx=0x7ff8ac00aeb0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.929+0000 7ff8c38c8740 1 -- 172.21.15.22:0/39032677 shutdown_connections 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.929+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbdff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.929+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbdd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.929+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/39032677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd8490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.929+0000 7ff8c38c8740 1 -- 172.21.15.22:0/39032677 >> 172.21.15.22:0/39032677 conn(0x55b9bbbd3700 msgr2=0x55b9bbbd3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.930+0000 7ff8c38c8740 1 -- 172.21.15.22:0/39032677 shutdown_connections 2024-09-15T22:38:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.930+0000 7ff8c38c8740 1 -- 172.21.15.22:0/39032677 wait complete. 2024-09-15T22:38:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.931+0000 7ff8c38c8740 1 -- start start 2024-09-15T22:38:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.931+0000 7ff8c38c8740 1 Processor -- start 2024-09-15T22:38:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.932+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8a00a7940 0x7ff8a00a9e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8000c00 tx=0x7ff8a8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.932+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.933+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.933+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.933+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:40192/0 (socket says 172.21.15.22:40192) 2024-09-15T22:38:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.933+0000 7ff8b9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.934+0000 7ff8b9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35894/0 (socket says 172.21.15.22:35894) 2024-09-15T22:38:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.934+0000 7ff8b9e00640 1 -- 172.21.15.22:0/1937556721 learned_addr learned my addr 172.21.15.22:0/1937556721 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.934+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.935+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9bbbe0a30 con 0x55b9bbbdda60 2024-09-15T22:38:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.935+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b9bbac6090 con 0x55b9bbbd8090 2024-09-15T22:38:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.935+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b9bbbe0bb0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.935+0000 7ff8c38c8740 10 client.0 _ll_register_callbacks cb 0x55b9bbb1af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.935+0000 7ff8b9400640 1 -- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd8090 msgr2=0x55b9bbbe2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.936+0000 7ff8b9400640 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.936+0000 7ff8b9400640 1 -- 172.21.15.22:0/1937556721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 msgr2=0x55b9bbbe97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.936+0000 7ff8b9400640 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.936+0000 7ff8b9400640 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9bb91c620 con 0x55b9bbbd89d0 2024-09-15T22:38:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.936+0000 7ff89b400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:38:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.936+0000 7ff8b9400640 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe27b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4099260 tx=0x7ff8b409c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e0281c51538d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.937+0000 7ff89b400640 1 -- 172.21.15.22:0/1937556721 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b409c890 con 0x55b9bbbd89d0 2024-09-15T22:38:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.937+0000 7ff89b400640 1 -- 172.21.15.22:0/1937556721 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff8b409dbc0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.937+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac00f930 con 0x55b9bbbd89d0 2024-09-15T22:38:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.938+0000 7ff89b400640 1 -- 172.21.15.22:0/1937556721 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8b40a0c40 con 0x55b9bbbd89d0 2024-09-15T22:38:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.941+0000 7ff8c38c8740 10 client.25513 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.941+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b9bbbec650 con 0x55b9bbbd89d0 2024-09-15T22:38:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.942+0000 7ff89b400640 1 -- 172.21.15.22:0/1937556721 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac00f930 con 0x55b9bbbd89d0 2024-09-15T22:38:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.942+0000 7ff89b400640 1 -- 172.21.15.22:0/1937556721 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8b409bde0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.942+0000 7ff8c38c8740 10 client.25513 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.942+0000 7ff8c38c8740 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.943+0000 7ff8c38c8740 20 client.25513 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.943+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbbedc80 0x55b9bbbf0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.943+0000 7ff8c38c8740 4 client.25513 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:38:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.943+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9bbb4a830 con 0x55b9bbbedc80 2024-09-15T22:38:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.945+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbbedc80 0x55b9bbbf0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.946+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbbedc80 0x55b9bbbf0070 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=925c74551e43813e server_cookie=211642957482234e in_seq=0 out_seq=0 2024-09-15T22:38:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.946+0000 7ff89b400640 10 client.25513 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.947+0000 7ff89b400640 1 -- 172.21.15.22:0/1937556721 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9bbb4a830 con 0x55b9bbbedc80 2024-09-15T22:38:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.947+0000 7ff89b400640 10 client.25513 handle_command_reply: tid=0 2024-09-15T22:38:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.947+0000 7ff8c38c8740 1 client.25513 shutdown 2024-09-15T22:38:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.948+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 msgr2=0x55b9bbbe27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.948+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe27b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4099260 tx=0x7ff8b409c3d0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 shutdown_connections 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbbedc80 0x55b9bbbf0070 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe27b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/1937556721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 >> 172.21.15.22:0/1937556721 conn(0x55b9bbbd3700 msgr2=0x55b9bbbd4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.949+0000 7ff89b400640 0 client.25513 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.950+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 shutdown_connections 2024-09-15T22:38:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.950+0000 7ff8c38c8740 1 -- 172.21.15.22:0/1937556721 wait complete. 2024-09-15T22:38:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.950+0000 7ff8c38c8740 20 client.25513 trim_cache size 0 max 16384 2024-09-15T22:38:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.974+0000 7ff8c38c8740 1 Processor -- start 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 -- start start 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbdda60 0x55b9bbbd4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1b24e0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1afdb0 con 0x55b9bbbdda60 2024-09-15T22:38:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1adbe0 con 0x55b9bbbd8090 2024-09-15T22:38:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35910/0 (socket says 172.21.15.22:35910) 2024-09-15T22:38:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8b9e00640 1 -- 172.21.15.22:0/280673029 learned_addr learned my addr 172.21.15.22:0/280673029 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8b9400640 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.975+0000 7ff8ba800640 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbdda60 0x55b9bbbd4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8b9e00640 1 -- 172.21.15.22:0/280673029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbdda60 msgr2=0x55b9bbbd4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbdda60 0x55b9bbbd4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8b9e00640 1 -- 172.21.15.22:0/280673029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd89d0 msgr2=0x55b9bbbe97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8b9e00640 1 -- 172.21.15.22:0/280673029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9bbbf03e0 con 0x55b9bbbd8090 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8ba800640 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbdda60 0x55b9bbbd4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd4650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80096c0 tx=0x7ff8a8040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9590f4b06948794 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8a6600640 1 -- 172.21.15.22:0/280673029 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8057070 con 0x55b9bbbd8090 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8a6600640 1 -- 172.21.15.22:0/280673029 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a8004ba0 con 0x55b9bbbd8090 2024-09-15T22:38:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.976+0000 7ff8a6600640 1 -- 172.21.15.22:0/280673029 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8035040 con 0x55b9bbbd8090 2024-09-15T22:38:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 -- 172.21.15.22:0/280673029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 msgr2=0x55b9bbbd4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd4650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80096c0 tx=0x7ff8a8040000 comp rx=0 tx=0).stop 2024-09-15T22:38:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 -- 172.21.15.22:0/280673029 shutdown_connections 2024-09-15T22:38:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbdda60 0x55b9bbbd4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/280673029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbd8090 0x55b9bbbd4650 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 -- 172.21.15.22:0/280673029 >> 172.21.15.22:0/280673029 conn(0x55b9bbbd3700 msgr2=0x55b9bbbe2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 -- 172.21.15.22:0/280673029 shutdown_connections 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.977+0000 7ff8c38c8740 1 -- 172.21.15.22:0/280673029 wait complete. 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 -- start start 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 Processor -- start 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1ae270 con 0x55b9bbbd8090 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1af6e0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1ae940 con 0x55b9bbbdda60 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8c38c8740 10 client.0 _ll_register_callbacks cb 0x7ff8b4098b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8b9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8b9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:40220/0 (socket says 172.21.15.22:40220) 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8b9400640 1 -- 172.21.15.22:0/3620940299 learned_addr learned my addr 172.21.15.22:0/3620940299 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.978+0000 7ff8b9e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8ba800640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8b9400640 1 -- 172.21.15.22:0/3620940299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbdda60 msgr2=0x55b9bbbe82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8b9400640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8b9400640 1 -- 172.21.15.22:0/3620940299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd8090 msgr2=0x55b9bbbe6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8b9400640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8b9400640 1 -- 172.21.15.22:0/3620940299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9bbbe88f0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8ba800640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8b9400640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe72d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4099210 tx=0x7ff8b4098c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b060097620b1642 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff89b400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff89b400640 1 -- 172.21.15.22:0/3620940299 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b409bee0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff89b400640 1 -- 172.21.15.22:0/3620940299 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff8b409b820 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.979+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8a8004ba0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff89b400640 1 -- 172.21.15.22:0/3620940299 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8b40bb2a0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 10 client.25514 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b9bbc589a0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff89b400640 1 -- 172.21.15.22:0/3620940299 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a8004ba0 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff89b400640 1 -- 172.21.15.22:0/3620940299 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8b40b5b20 con 0x55b9bbbd89d0 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 10 client.25514 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 10 client.25514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 20 client.25514 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbc58fe0 0x55b9bbc5b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 4 client.25514 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.980+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9bbb44b80 con 0x55b9bbc58fe0 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.981+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbc58fe0 0x55b9bbc5b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.981+0000 7ff89b400640 10 client.25514 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.981+0000 7ff8b9e00640 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbc58fe0 0x55b9bbc5b400 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f435db6ea6dec613 server_cookie=5f3db77d9cbdecb7 in_seq=0 out_seq=0 2024-09-15T22:38:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.999+0000 7ff89b400640 1 -- 172.21.15.22:0/3620940299 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9bbb44b80 con 0x55b9bbc58fe0 2024-09-15T22:38:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:44.999+0000 7ff89b400640 10 client.25514 handle_command_reply: tid=0 2024-09-15T22:38:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.000+0000 7ff8c38c8740 1 client.25514 shutdown 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 msgr2=0x55b9bbbe72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe72d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4099210 tx=0x7ff8b4098c50 comp rx=0 tx=0).stop 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 shutdown_connections 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b9bbc58fe0 0x55b9bbc5b400 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b9bbbdda60 0x55b9bbbe82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b9bbbd89d0 0x55b9bbbe72d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 --2- 172.21.15.22:0/3620940299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9bbbd8090 0x55b9bbbe6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 >> 172.21.15.22:0/3620940299 conn(0x55b9bbbd3700 msgr2=0x55b9bbbd4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff89b400640 0 client.25514 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.001+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 shutdown_connections 2024-09-15T22:38:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.002+0000 7ff8c38c8740 1 -- 172.21.15.22:0/3620940299 wait complete. 2024-09-15T22:38:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.005+0000 7ff8c38c8740 20 client.25514 trim_cache size 0 max 16384 2024-09-15T22:38:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:38:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:38:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:38:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:38:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8a00a7940 msgr2=0x7ff8a00a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8a00a7940 0x7ff8a00a9e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8000c00 tx=0x7ff8a8031400 comp rx=0 tx=0).stop 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc0737d0 msgr2=0x7ff8bc19ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc0737d0 0x7ff8bc19ea50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400eb00 tx=0x7ff8b400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 shutdown_connections 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff8a00a7940 0x7ff8a00a9e00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8bc1a3ab0 0x7ff8bc1a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8bc0737d0 0x7ff8bc19ea50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 --2- 172.21.15.22:0/2193038874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8bc072d20 0x7ff8bc19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.009+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 >> 172.21.15.22:0/2193038874 conn(0x7ff8bc06ece0 msgr2=0x7ff8bc10e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.010+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 shutdown_connections 2024-09-15T22:38:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:45.010+0000 7ff8c0a00640 1 -- 172.21.15.22:0/2193038874 wait complete. 2024-09-15T22:38:46.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:45 smithi022 ceph-mon[30634]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 945 op/s 2024-09-15T22:38:46.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:45 smithi112 ceph-mon[35032]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 945 op/s 2024-09-15T22:38:46.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:45 smithi110 ceph-mon[35282]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 945 op/s 2024-09-15T22:38:47.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:46 smithi022 ceph-mon[30634]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 901 op/s 2024-09-15T22:38:47.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:46 smithi112 ceph-mon[35032]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 901 op/s 2024-09-15T22:38:47.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:46 smithi110 ceph-mon[35282]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 901 op/s 2024-09-15T22:38:49.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:48 smithi110 ceph-mon[35282]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 269 MiB/s wr, 948 op/s 2024-09-15T22:38:49.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:48 smithi022 ceph-mon[30634]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 269 MiB/s wr, 948 op/s 2024-09-15T22:38:49.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:48 smithi112 ceph-mon[35032]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 269 MiB/s wr, 948 op/s 2024-09-15T22:38:51.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:50 smithi110 ceph-mon[35282]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 249 MiB/s wr, 879 op/s 2024-09-15T22:38:51.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:50 smithi022 ceph-mon[30634]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 249 MiB/s wr, 879 op/s 2024-09-15T22:38:51.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:50 smithi112 ceph-mon[35032]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 249 MiB/s wr, 879 op/s 2024-09-15T22:38:52.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:51 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:52.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:51 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:52.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:51 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:53.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:52 smithi110 ceph-mon[35282]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 264 MiB/s wr, 933 op/s 2024-09-15T22:38:53.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:52 smithi022 ceph-mon[30634]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 264 MiB/s wr, 933 op/s 2024-09-15T22:38:53.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:52 smithi112 ceph-mon[35032]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 264 MiB/s wr, 933 op/s 2024-09-15T22:38:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi022 to 177.5M 2024-09-15T22:38:54.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: Unable to set osd_memory_target on smithi022 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-15T22:38:54.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:54.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:54.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi022 to 177.5M 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: Unable to set osd_memory_target on smithi022 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:54.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:54.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi022 to 177.5M 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: Unable to set osd_memory_target on smithi022 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:54.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:38:55.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:55 smithi022 ceph-mon[30634]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 259 MiB/s wr, 916 op/s 2024-09-15T22:38:55.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:55 smithi112 ceph-mon[35032]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 259 MiB/s wr, 916 op/s 2024-09-15T22:38:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:55 smithi110 ceph-mon[35282]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 259 MiB/s wr, 916 op/s 2024-09-15T22:38:57.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:57 smithi112 ceph-mon[35032]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 866 op/s 2024-09-15T22:38:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:57 smithi110 ceph-mon[35282]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 866 op/s 2024-09-15T22:38:57.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:57 smithi022 ceph-mon[30634]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 866 op/s 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.213+0000 7f5e16600640 1 -- 172.21.15.22:0/2476289485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a5aa0 msgr2=0x7f5e080a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.213+0000 7f5e16600640 1 --2- 172.21.15.22:0/2476289485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a5aa0 0x7f5e080a5f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e10065360 tx=0x7f5e1008e0f0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.214+0000 7f5e16600640 1 -- 172.21.15.22:0/2476289485 shutdown_connections 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.214+0000 7f5e16600640 1 --2- 172.21.15.22:0/2476289485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a5aa0 0x7f5e080a5f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.214+0000 7f5e16600640 1 --2- 172.21.15.22:0/2476289485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a6460 0x7f5e080accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.214+0000 7f5e16600640 1 --2- 172.21.15.22:0/2476289485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e080a48b0 0x7f5e080a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.214+0000 7f5e16600640 1 -- 172.21.15.22:0/2476289485 >> 172.21.15.22:0/2476289485 conn(0x7f5e0809fd80 msgr2=0x7f5e080a21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.214+0000 7f5e16600640 1 -- 172.21.15.22:0/2476289485 shutdown_connections 2024-09-15T22:38:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.215+0000 7f5e16600640 1 -- 172.21.15.22:0/2476289485 wait complete. 2024-09-15T22:38:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.216+0000 7f5e16600640 1 Processor -- start 2024-09-15T22:38:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.216+0000 7f5e16600640 1 -- start start 2024-09-15T22:38:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.217+0000 7f5e16600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e080a48b0 0x7f5e080b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.217+0000 7f5e16600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 0x7f5e080b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.217+0000 7f5e16600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a6460 0x7f5e080b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.217+0000 7f5e16600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e080b4420 con 0x7f5e080a5aa0 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e16600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e080b42a0 con 0x7f5e080a48b0 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e16600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e080b45a0 con 0x7f5e080a6460 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e080a48b0 0x7f5e080b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e0e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 0x7f5e080b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e0e000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 0x7f5e080b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60000/0 (socket says 172.21.15.22:60000) 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e0e000640 1 -- 172.21.15.22:0/487226665 learned_addr learned my addr 172.21.15.22:0/487226665 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.218+0000 7f5e0f400640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a6460 0x7f5e080b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.219+0000 7f5e0e000640 1 -- 172.21.15.22:0/487226665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a6460 msgr2=0x7f5e080b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.219+0000 7f5e0e000640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a6460 0x7f5e080b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.219+0000 7f5e0e000640 1 -- 172.21.15.22:0/487226665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e080a48b0 msgr2=0x7f5e080b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.219+0000 7f5e0e000640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e080a48b0 0x7f5e080b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.219+0000 7f5e0e000640 1 -- 172.21.15.22:0/487226665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080b0900 con 0x7f5e080a5aa0 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.219+0000 7f5e0e000640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 0x7f5e080b3a10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5e10050d60 tx=0x7f5e1006a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.220+0000 7f5e03e00640 1 -- 172.21.15.22:0/487226665 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e100a5070 con 0x7f5e080a5aa0 2024-09-15T22:38:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.220+0000 7f5e03e00640 1 -- 172.21.15.22:0/487226665 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e1008ec00 con 0x7f5e080a5aa0 2024-09-15T22:38:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.220+0000 7f5e03e00640 1 -- 172.21.15.22:0/487226665 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e100a0670 con 0x7f5e080a5aa0 2024-09-15T22:38:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.223+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0814af60 con 0x7f5e080a5aa0 2024-09-15T22:38:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.223+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0814b310 con 0x7f5e080a5aa0 2024-09-15T22:38:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.232+0000 7f5e1941b740 1 Processor -- start 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 -- start start 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c86901660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901ba0 0x555c86906660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c869090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c86866100 con 0x555c86901ba0 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555c8680e1b0 con 0x555c86906c30 2024-09-15T22:38:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.237+0000 7f5e1941b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555c868620c0 con 0x555c86901260 2024-09-15T22:38:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.238+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c86901660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.238+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c86901660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47084/0 (socket says 172.21.15.22:47084) 2024-09-15T22:38:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.238+0000 7f5e0f400640 1 -- 172.21.15.22:0/719559921 learned_addr learned my addr 172.21.15.22:0/719559921 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.239+0000 7f5e03e00640 1 -- 172.21.15.22:0/487226665 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5e100a0810 con 0x7f5e080a5aa0 2024-09-15T22:38:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.239+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901ba0 0x555c86906660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e0f400640 1 -- 172.21.15.22:0/719559921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 msgr2=0x555c869090f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:38:58.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e0f400640 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c869090f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e0f400640 1 -- 172.21.15.22:0/719559921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901ba0 msgr2=0x555c86906660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:58.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e0f400640 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901ba0 0x555c86906660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e0f400640 1 -- 172.21.15.22:0/719559921 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c86579210 con 0x555c86901260 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e0f400640 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c86901660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009ee0 tx=0x7f5e04010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f282ce478962020f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e00c00640 1 -- 172.21.15.22:0/719559921 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04016070 con 0x555c86901260 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e00c00640 1 -- 172.21.15.22:0/719559921 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e04004d20 con 0x555c86901260 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.240+0000 7f5e00c00640 1 -- 172.21.15.22:0/719559921 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04012830 con 0x555c86901260 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.241+0000 7f5e03e00640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5df80a32b0 0x7f5df80a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.241+0000 7f5e1941b740 1 -- 172.21.15.22:0/719559921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 msgr2=0x555c86901660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.241+0000 7f5e1941b740 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c86901660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009ee0 tx=0x7f5e04010740 comp rx=0 tx=0).stop 2024-09-15T22:38:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.241+0000 7f5e03e00640 1 -- 172.21.15.22:0/487226665 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5e10152950 con 0x7f5e080a5aa0 2024-09-15T22:38:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.242+0000 7f5e1941b740 1 -- 172.21.15.22:0/719559921 shutdown_connections 2024-09-15T22:38:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.242+0000 7f5e1941b740 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c869090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.242+0000 7f5e1941b740 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901ba0 0x555c86906660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.242+0000 7f5e1941b740 1 --2- 172.21.15.22:0/719559921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c86901660 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.242+0000 7f5e1941b740 1 -- 172.21.15.22:0/719559921 >> 172.21.15.22:0/719559921 conn(0x555c868fc8d0 msgr2=0x555c868fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.242+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5df80a32b0 0x7f5df80a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.243+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5df80a32b0 0x7f5df80a5770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x555c868fd750 tx=0x7f5dfc00c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.245+0000 7f5e1941b740 1 -- 172.21.15.22:0/719559921 shutdown_connections 2024-09-15T22:38:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.246+0000 7f5e1941b740 1 -- 172.21.15.22:0/719559921 wait complete. 2024-09-15T22:38:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.246+0000 7f5e1941b740 1 -- start start 2024-09-15T22:38:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.247+0000 7f5e1941b740 1 Processor -- start 2024-09-15T22:38:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c8691c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c8691cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86906c30 0x555c86923af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c8691ac10 con 0x555c86906c30 2024-09-15T22:38:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555c867ef090 con 0x555c86901ba0 2024-09-15T22:38:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555c8691ad90 con 0x555c86901260 2024-09-15T22:38:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.249+0000 7f5e1941b740 10 client.0 _ll_register_callbacks cb 0x555c86843f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.250+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86906c30 0x555c86923af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.250+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c8691c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.250+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c8691c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47094/0 (socket says 172.21.15.22:47094) 2024-09-15T22:38:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.250+0000 7f5e0ea00640 1 -- 172.21.15.22:0/788906356 learned_addr learned my addr 172.21.15.22:0/788906356 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.251+0000 7f5e0ea00640 1 -- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 msgr2=0x555c8691cab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.251+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c8691cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.251+0000 7f5e0ea00640 1 -- 172.21.15.22:0/788906356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86906c30 msgr2=0x555c86923af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.251+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86906c30 0x555c86923af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.251+0000 7f5e0ea00640 1 -- 172.21.15.22:0/788906356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c86645620 con 0x555c86901260 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.252+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c8691c570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc017830 tx=0x7f5dfc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b321bff60d0237e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.252+0000 7f5df5600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:38:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.252+0000 7f5df5600640 1 -- 172.21.15.22:0/788906356 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc016890 con 0x555c86901260 2024-09-15T22:38:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.253+0000 7f5df5600640 1 -- 172.21.15.22:0/788906356 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5dfc016a30 con 0x555c86901260 2024-09-15T22:38:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.255+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e04004d20 con 0x555c86901260 2024-09-15T22:38:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.255+0000 7f5df5600640 1 -- 172.21.15.22:0/788906356 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5dfc016c30 con 0x555c86901260 2024-09-15T22:38:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.255+0000 7f5e1941b740 10 client.25531 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.255+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c86926a30 con 0x555c86901260 2024-09-15T22:38:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5df5600640 1 -- 172.21.15.22:0/788906356 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e04004d20 con 0x555c86901260 2024-09-15T22:38:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5df5600640 1 -- 172.21.15.22:0/788906356 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5dfc0233a0 con 0x555c86901260 2024-09-15T22:38:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5e1941b740 10 client.25531 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5e1941b740 10 client.25531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5e1941b740 20 client.25531 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5e1941b740 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c86928120 0x555c8692a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5e1941b740 4 client.25531 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:38:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.256+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c86873830 con 0x555c86928120 2024-09-15T22:38:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.257+0000 7f5e0e000640 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c86928120 0x555c8692a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.258+0000 7f5e0e000640 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c86928120 0x555c8692a5c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=287746533b7779cc server_cookie=67117ff63f8b9113 in_seq=0 out_seq=0 2024-09-15T22:38:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.259+0000 7f5df5600640 10 client.25531 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.260+0000 7f5df5600640 1 -- 172.21.15.22:0/788906356 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c86873830 con 0x555c86928120 2024-09-15T22:38:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.260+0000 7f5df5600640 10 client.25531 handle_command_reply: tid=0 2024-09-15T22:38:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.260+0000 7f5e1941b740 1 client.25531 shutdown 2024-09-15T22:38:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 msgr2=0x555c8691c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c8691c570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc017830 tx=0x7f5dfc004730 comp rx=0 tx=0).stop 2024-09-15T22:38:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 shutdown_connections 2024-09-15T22:38:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c86928120 0x555c8692a5c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86906c30 0x555c86923af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c8691cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 --2- 172.21.15.22:0/788906356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901260 0x555c8691c570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 >> 172.21.15.22:0/788906356 conn(0x555c868fc8d0 msgr2=0x555c868fba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5df5600640 0 client.25531 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 shutdown_connections 2024-09-15T22:38:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.262+0000 7f5e1941b740 1 -- 172.21.15.22:0/788906356 wait complete. 2024-09-15T22:38:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.263+0000 7f5e1941b740 20 client.25531 trim_cache size 0 max 16384 2024-09-15T22:38:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.287+0000 7f5e1941b740 1 Processor -- start 2024-09-15T22:38:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.287+0000 7f5e1941b740 1 -- start start 2024-09-15T22:38:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 0x555c86929f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901ba0 0x555c86923ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c8692a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e1941b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0814e210 con 0x555c86901260 2024-09-15T22:38:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e1941b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0814bae0 con 0x555c86906c30 2024-09-15T22:38:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e1941b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e08145360 con 0x555c86901ba0 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 0x555c86929f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c8692a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 0x555c86929f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60036/0 (socket says 172.21.15.22:60036) 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e0ea00640 1 -- 172.21.15.22:0/1612838309 learned_addr learned my addr 172.21.15.22:0/1612838309 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.288+0000 7f5e0e000640 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901ba0 0x555c86923ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0ea00640 1 -- 172.21.15.22:0/1612838309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901ba0 msgr2=0x555c86923ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901ba0 0x555c86923ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0ea00640 1 -- 172.21.15.22:0/1612838309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 msgr2=0x555c8692a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c8692a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0ea00640 1 -- 172.21.15.22:0/1612838309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c86926820 con 0x555c86901260 2024-09-15T22:38:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0e000640 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901ba0 0x555c86923ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:38:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.289+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 0x555c86929f00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00abc0 tx=0x7f5dfc017430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95716f973ee72d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.290+0000 7f5df7e00640 1 -- 172.21.15.22:0/1612838309 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc016dd0 con 0x555c86901260 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.290+0000 7f5df7e00640 1 -- 172.21.15.22:0/1612838309 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dfc01d030 con 0x555c86901260 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.290+0000 7f5df7e00640 1 -- 172.21.15.22:0/1612838309 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004290 con 0x555c86901260 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 -- 172.21.15.22:0/1612838309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 msgr2=0x555c86929f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 0x555c86929f00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00abc0 tx=0x7f5dfc017430 comp rx=0 tx=0).stop 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 -- 172.21.15.22:0/1612838309 shutdown_connections 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86901ba0 0x555c86923ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86906c30 0x555c8692a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1612838309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86901260 0x555c86929f00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 -- 172.21.15.22:0/1612838309 >> 172.21.15.22:0/1612838309 conn(0x555c868fc8d0 msgr2=0x555c8691c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 -- 172.21.15.22:0/1612838309 shutdown_connections 2024-09-15T22:38:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.291+0000 7f5e1941b740 1 -- 172.21.15.22:0/1612838309 wait complete. 2024-09-15T22:38:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.292+0000 7f5e1941b740 1 -- start start 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.292+0000 7f5e1941b740 1 Processor -- start 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c86920d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 0x555c86921240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86922250 0x555c869226b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e081459f0 con 0x555c86922250 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0814b4e0 con 0x555c86901ba0 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e081460c0 con 0x555c86906c30 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.293+0000 7f5e1941b740 10 client.0 _ll_register_callbacks cb 0x7f5dfc00a3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.294+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c86920d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.294+0000 7f5e0e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 0x555c86921240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.294+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c86920d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:35224/0 (socket says 172.21.15.22:35224) 2024-09-15T22:38:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.294+0000 7f5e0ea00640 1 -- 172.21.15.22:0/1308304850 learned_addr learned my addr 172.21.15.22:0/1308304850 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:38:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.294+0000 7f5e0e000640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 0x555c86921240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:47102/0 (socket says 172.21.15.22:47102) 2024-09-15T22:38:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.294+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86922250 0x555c869226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.297+0000 7f5e0e000640 1 -- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 msgr2=0x555c86920d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.297+0000 7f5e0e000640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c86920d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.297+0000 7f5e0e000640 1 -- 172.21.15.22:0/1308304850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86922250 msgr2=0x555c869226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.297+0000 7f5e0e000640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86922250 0x555c869226b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.297+0000 7f5e0e000640 1 -- 172.21.15.22:0/1308304850 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c86922c40 con 0x555c86906c30 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.298+0000 7f5e0f400640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86922250 0x555c869226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.298+0000 7f5e0e000640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 0x555c86921240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x555c8691da50 tx=0x7f5e1008e0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cde6bbbd96c7a0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.299+0000 7f5df5600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:38:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.299+0000 7f5df5600640 1 -- 172.21.15.22:0/1308304850 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10139070 con 0x555c86906c30 2024-09-15T22:38:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.299+0000 7f5df5600640 1 -- 172.21.15.22:0/1308304850 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5e10150560 con 0x555c86906c30 2024-09-15T22:38:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.300+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dfc01d030 con 0x555c86906c30 2024-09-15T22:38:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.300+0000 7f5df5600640 1 -- 172.21.15.22:0/1308304850 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e10123320 con 0x555c86906c30 2024-09-15T22:38:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.300+0000 7f5e1941b740 10 client.25534 fetch_fsmap learned FSMap version 25 2024-09-15T22:38:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.300+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c86992ea0 con 0x555c86906c30 2024-09-15T22:38:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.301+0000 7f5df5600640 1 -- 172.21.15.22:0/1308304850 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dfc01d030 con 0x555c86906c30 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.301+0000 7f5df5600640 1 -- 172.21.15.22:0/1308304850 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5e1013c020 con 0x555c86906c30 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.302+0000 7f5e1941b740 10 client.25534 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.302+0000 7f5e1941b740 10 client.25534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.302+0000 7f5e1941b740 20 client.25534 populate_metadata read hostname 'smithi022' 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.302+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c869936c0 0x555c86995ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.302+0000 7f5e1941b740 4 client.25534 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:38:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.302+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c8686db80 con 0x555c869936c0 2024-09-15T22:38:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.303+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c869936c0 0x555c86995ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.305+0000 7f5e0ea00640 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c869936c0 0x555c86995ae0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c04003f8549e56d server_cookie=5854f5d00259df54 in_seq=0 out_seq=0 2024-09-15T22:38:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.305+0000 7f5df5600640 10 client.25534 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.330+0000 7f5df5600640 1 -- 172.21.15.22:0/1308304850 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c8686db80 con 0x555c869936c0 2024-09-15T22:38:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.330+0000 7f5df5600640 10 client.25534 handle_command_reply: tid=0 2024-09-15T22:38:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.330+0000 7f5e1941b740 1 client.25534 shutdown 2024-09-15T22:38:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.330+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 msgr2=0x555c86921240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.331+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 0x555c86921240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x555c8691da50 tx=0x7f5e1008e0f0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.333+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 shutdown_connections 2024-09-15T22:38:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.333+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x555c869936c0 0x555c86995ae0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.336+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555c86906c30 0x555c86921240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.336+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c86922250 0x555c869226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.336+0000 7f5e1941b740 1 --2- 172.21.15.22:0/1308304850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555c86901ba0 0x555c86920d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.336+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 >> 172.21.15.22:0/1308304850 conn(0x555c868fc8d0 msgr2=0x555c8691c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.337+0000 7f5df5600640 0 client.25534 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:38:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.337+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 shutdown_connections 2024-09-15T22:38:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.337+0000 7f5e1941b740 1 -- 172.21.15.22:0/1308304850 wait complete. 2024-09-15T22:38:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.338+0000 7f5e1941b740 20 client.25534 trim_cache size 0 max 16384 2024-09-15T22:38:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:38:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:38:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:38:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:38:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.344+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5df80a32b0 msgr2=0x7f5df80a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.344+0000 7f5e16600640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5df80a32b0 0x7f5df80a5770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x555c868fd750 tx=0x7f5dfc00c040 comp rx=0 tx=0).stop 2024-09-15T22:38:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 msgr2=0x7f5e080b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 0x7f5e080b3a10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5e10050d60 tx=0x7f5e1006a3d0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 shutdown_connections 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e080a6460 0x7f5e080b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f5df80a32b0 0x7f5df80a5770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e080a5aa0 0x7f5e080b3a10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 --2- 172.21.15.22:0/487226665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e080a48b0 0x7f5e080b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 >> 172.21.15.22:0/487226665 conn(0x7f5e0809fd80 msgr2=0x7f5e080a8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 shutdown_connections 2024-09-15T22:38:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:38:58.345+0000 7f5e16600640 1 -- 172.21.15.22:0/487226665 wait complete. 2024-09-15T22:38:59.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:38:59 smithi110 ceph-mon[35282]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 269 MiB/s wr, 955 op/s 2024-09-15T22:38:59.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:38:59 smithi022 ceph-mon[30634]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 269 MiB/s wr, 955 op/s 2024-09-15T22:38:59.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:38:59 smithi112 ceph-mon[35032]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 269 MiB/s wr, 955 op/s 2024-09-15T22:39:01.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:01 smithi110 ceph-mon[35282]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 907 op/s 2024-09-15T22:39:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:01 smithi022 ceph-mon[30634]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 907 op/s 2024-09-15T22:39:01.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:01 smithi112 ceph-mon[35032]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 907 op/s 2024-09-15T22:39:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:03 smithi110 ceph-mon[35282]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 945 op/s 2024-09-15T22:39:03.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:03 smithi022 ceph-mon[30634]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 945 op/s 2024-09-15T22:39:03.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:03 smithi112 ceph-mon[35032]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 945 op/s 2024-09-15T22:39:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:05 smithi110 ceph-mon[35282]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 256 MiB/s wr, 907 op/s 2024-09-15T22:39:05.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:05 smithi022 ceph-mon[30634]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 256 MiB/s wr, 907 op/s 2024-09-15T22:39:05.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:05 smithi112 ceph-mon[35032]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 256 MiB/s wr, 907 op/s 2024-09-15T22:39:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:07 smithi110 ceph-mon[35282]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 890 op/s 2024-09-15T22:39:07.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:07 smithi022 ceph-mon[30634]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 890 op/s 2024-09-15T22:39:07.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:07 smithi112 ceph-mon[35032]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 890 op/s 2024-09-15T22:39:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:09 smithi110 ceph-mon[35282]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 953 op/s 2024-09-15T22:39:09.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:09 smithi022 ceph-mon[30634]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 953 op/s 2024-09-15T22:39:09.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:09 smithi112 ceph-mon[35032]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 953 op/s 2024-09-15T22:39:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.579+0000 7f48ac400640 1 -- 172.21.15.22:0/2578441809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 msgr2=0x7f48a4119130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.579+0000 7f48ac400640 1 --2- 172.21.15.22:0/2578441809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a4119130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f489c009ca0 tx=0x7f489c02a8d0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 -- 172.21.15.22:0/2578441809 shutdown_connections 2024-09-15T22:39:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 --2- 172.21.15.22:0/2578441809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a4119130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 --2- 172.21.15.22:0/2578441809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48a4072d20 0x7f48a4073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 --2- 172.21.15.22:0/2578441809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48a4109700 0x7f48a4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 -- 172.21.15.22:0/2578441809 >> 172.21.15.22:0/2578441809 conn(0x7f48a406ece0 msgr2=0x7f48a4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 -- 172.21.15.22:0/2578441809 shutdown_connections 2024-09-15T22:39:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.582+0000 7f48ac400640 1 -- 172.21.15.22:0/2578441809 wait complete. 2024-09-15T22:39:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 Processor -- start 2024-09-15T22:39:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 -- start start 2024-09-15T22:39:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48a4072d20 0x7f48a41a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a41a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48a4109700 0x7f48a41ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48a411c680 con 0x7f48a4072d20 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f48a411c500 con 0x7f48a4109700 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.584+0000 7f48ac400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48a411c800 con 0x7f48a40736c0 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a41a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a41a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43912/0 (socket says 172.21.15.22:43912) 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 -- 172.21.15.22:0/1109195690 learned_addr learned my addr 172.21.15.22:0/1109195690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48aa400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48a4109700 0x7f48a41ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 -- 172.21.15.22:0/1109195690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48a4109700 msgr2=0x7f48a41ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48a4109700 0x7f48a41ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 -- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48a4072d20 msgr2=0x7f48a41a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48a4072d20 0x7f48a41a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.585+0000 7f48a9000640 1 -- 172.21.15.22:0/1109195690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a41ae810 con 0x7f48a40736c0 2024-09-15T22:39:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.586+0000 7f48a9000640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a41a7130 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f489000c890 tx=0x7f489000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.586+0000 7f48a2000640 1 -- 172.21.15.22:0/1109195690 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890004220 con 0x7f48a40736c0 2024-09-15T22:39:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.586+0000 7f48a2000640 1 -- 172.21.15.22:0/1109195690 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48900043c0 con 0x7f48a40736c0 2024-09-15T22:39:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.586+0000 7f48a2000640 1 -- 172.21.15.22:0/1109195690 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48900049e0 con 0x7f48a40736c0 2024-09-15T22:39:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.587+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a41aeb00 con 0x7f48a40736c0 2024-09-15T22:39:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.587+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a41af000 con 0x7f48a40736c0 2024-09-15T22:39:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.592+0000 7f48af235740 1 Processor -- start 2024-09-15T22:39:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.593+0000 7f48af235740 1 -- start start 2024-09-15T22:39:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48af235740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffbd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48af235740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48af235740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffc4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48af235740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fdeff22100 con 0x55fdeffc2a60 2024-09-15T22:39:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48af235740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55fdefeca1b0 con 0x55fdeffbd090 2024-09-15T22:39:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48af235740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fdeff1e0c0 con 0x55fdeffbd9d0 2024-09-15T22:39:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48a2000640 1 -- 172.21.15.22:0/1109195690 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f48900079b0 con 0x7f48a40736c0 2024-09-15T22:39:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.594+0000 7f48a9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48a9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43914/0 (socket says 172.21.15.22:43914) 2024-09-15T22:39:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48aa400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffbd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48aa400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffbd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:57324/0 (socket says 172.21.15.22:57324) 2024-09-15T22:39:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48aa400640 1 -- 172.21.15.22:0/1197891522 learned_addr learned my addr 172.21.15.22:0/1197891522 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48a9000640 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffc4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48aa400640 1 -- 172.21.15.22:0/1197891522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 msgr2=0x55fdeffc2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48aa400640 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.595+0000 7f48aa400640 1 -- 172.21.15.22:0/1197891522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 msgr2=0x55fdeffc4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f48aa400640 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffc4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f48aa400640 1 -- 172.21.15.22:0/1197891522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdefc35210 con 0x55fdeffbd090 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f48a9000640 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f48a2000640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f488c0a3460 0x7f488c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f48aa400640 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffbd490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f489c02aec0 tx=0x7f489c02f320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f867bf94e7c6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f48a2000640 1 -- 172.21.15.22:0/1109195690 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f48900cf8a0 con 0x7f48a40736c0 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.596+0000 7f4896a00640 1 -- 172.21.15.22:0/1197891522 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c031720 con 0x55fdeffbd090 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f4896a00640 1 -- 172.21.15.22:0/1197891522 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489c036030 con 0x55fdeffbd090 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f4896a00640 1 -- 172.21.15.22:0/1197891522 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c02f620 con 0x55fdeffbd090 2024-09-15T22:39:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f488c0a3460 0x7f488c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 -- 172.21.15.22:0/1197891522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 msgr2=0x55fdeffbd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffbd490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f489c02aec0 tx=0x7f489c02f320 comp rx=0 tx=0).stop 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 -- 172.21.15.22:0/1197891522 shutdown_connections 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 --2- 172.21.15.22:0/1197891522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffbd490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.597+0000 7f48af235740 1 -- 172.21.15.22:0/1197891522 >> 172.21.15.22:0/1197891522 conn(0x55fdeffb8700 msgr2=0x55fdeffb8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.598+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f488c0a3460 0x7f488c0a5920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55fdeffbe400 tx=0x7f48980090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.598+0000 7f48af235740 1 -- 172.21.15.22:0/1197891522 shutdown_connections 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.598+0000 7f48af235740 1 -- 172.21.15.22:0/1197891522 wait complete. 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.598+0000 7f48af235740 1 -- start start 2024-09-15T22:39:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.599+0000 7f48af235740 1 Processor -- start 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.599+0000 7f48af235740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffc72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.599+0000 7f48af235740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48af235740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48af235740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fdeffc59d0 con 0x55fdeffc2a60 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48af235740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55fdefeab090 con 0x55fdeffbd090 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48af235740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fdeffc5b50 con 0x55fdeffbd9d0 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43926/0 (socket says 172.21.15.22:43926) 2024-09-15T22:39:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 -- 172.21.15.22:0/1888616331 learned_addr learned my addr 172.21.15.22:0/1888616331 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48af235740 10 client.0 _ll_register_callbacks cb 0x55fdefefff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffc72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48aa400640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 -- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 msgr2=0x55fdeffc72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffc72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 -- 172.21.15.22:0/1888616331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 msgr2=0x55fdeffce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.600+0000 7f48a9000640 1 -- 172.21.15.22:0/1888616331 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdefd01620 con 0x55fdeffbd9d0 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.601+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffc72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.601+0000 7f48aa400640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:39:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.601+0000 7f48a9000640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc7820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f489009be10 tx=0x7f489009b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b83c323a0f39b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.601+0000 7f488b400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.601+0000 7f488b400640 1 -- 172.21.15.22:0/1888616331 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489001d040 con 0x55fdeffbd9d0 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.601+0000 7f488b400640 1 -- 172.21.15.22:0/1888616331 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f48900a4660 con 0x55fdeffbd9d0 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.602+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489c036030 con 0x55fdeffbd9d0 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.602+0000 7f488b400640 1 -- 172.21.15.22:0/1888616331 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48900a0230 con 0x55fdeffbd9d0 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.603+0000 7f48af235740 10 client.25546 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.603+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fdeffd1680 con 0x55fdeffbd9d0 2024-09-15T22:39:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.603+0000 7f488b400640 1 -- 172.21.15.22:0/1888616331 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489c036030 con 0x55fdeffbd9d0 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.603+0000 7f488b400640 1 -- 172.21.15.22:0/1888616331 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f48900baac0 con 0x55fdeffbd9d0 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48af235740 10 client.25546 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48af235740 10 client.25546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48af235740 20 client.25546 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48af235740 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdeffd2ce0 0x55fdeffd50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48af235740 4 client.25546 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdeff2f830 con 0x55fdeffd2ce0 2024-09-15T22:39:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.604+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdeffd2ce0 0x55fdeffd50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.605+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdeffd2ce0 0x55fdeffd50d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d41f90ef7867410 server_cookie=7109f01bc2bf784a in_seq=0 out_seq=0 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.605+0000 7f488b400640 10 client.25546 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f488b400640 1 -- 172.21.15.22:0/1888616331 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdeff2f830 con 0x55fdeffd2ce0 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f488b400640 10 client.25546 handle_command_reply: tid=0 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f48af235740 1 client.25546 shutdown 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 msgr2=0x55fdeffc7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f48af235740 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc7820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f489009be10 tx=0x7f489009b7e0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 shutdown_connections 2024-09-15T22:39:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.606+0000 7f48af235740 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdeffd2ce0 0x55fdeffd50d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd9d0 0x55fdeffc7820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 1 --2- 172.21.15.22:0/1888616331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd090 0x55fdeffc72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 >> 172.21.15.22:0/1888616331 conn(0x55fdeffb8700 msgr2=0x55fdeffb9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f488b400640 0 client.25546 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 shutdown_connections 2024-09-15T22:39:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 1 -- 172.21.15.22:0/1888616331 wait complete. 2024-09-15T22:39:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.607+0000 7f48af235740 20 client.25546 trim_cache size 0 max 16384 2024-09-15T22:39:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 Processor -- start 2024-09-15T22:39:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 -- start start 2024-09-15T22:39:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd090 0x55fdeffb7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffd9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41ba6f0 con 0x55fdeffc2a60 2024-09-15T22:39:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41b7fc0 con 0x55fdeffbd9d0 2024-09-15T22:39:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.624+0000 7f48af235740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41b5df0 con 0x55fdeffbd090 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.626+0000 7f48aa400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffd9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.626+0000 7f48a9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.626+0000 7f48a9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:57342/0 (socket says 172.21.15.22:57342) 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.626+0000 7f48a9000640 1 -- 172.21.15.22:0/1668263820 learned_addr learned my addr 172.21.15.22:0/1668263820 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.626+0000 7f48a9a00640 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd090 0x55fdeffb7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.627+0000 7f48aa400640 1 -- 172.21.15.22:0/1668263820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd090 msgr2=0x55fdeffb7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.627+0000 7f48aa400640 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd090 0x55fdeffb7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.627+0000 7f48aa400640 1 -- 172.21.15.22:0/1668263820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 msgr2=0x55fdeffce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.627+0000 7f48aa400640 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.627+0000 7f48aa400640 1 -- 172.21.15.22:0/1668263820 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdeffb8520 con 0x55fdeffc2a60 2024-09-15T22:39:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.630+0000 7f48aa400640 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffd9990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f489c031ab0 tx=0x7f489c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf838bc30cbfb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.631+0000 7f4896000640 1 -- 172.21.15.22:0/1668263820 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c054070 con 0x55fdeffc2a60 2024-09-15T22:39:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.632+0000 7f4896000640 1 -- 172.21.15.22:0/1668263820 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489c036040 con 0x55fdeffc2a60 2024-09-15T22:39:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.632+0000 7f4896000640 1 -- 172.21.15.22:0/1668263820 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c004580 con 0x55fdeffc2a60 2024-09-15T22:39:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.633+0000 7f48af235740 1 -- 172.21.15.22:0/1668263820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 msgr2=0x55fdeffd9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.633+0000 7f48af235740 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffd9990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f489c031ab0 tx=0x7f489c000f40 comp rx=0 tx=0).stop 2024-09-15T22:39:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 -- 172.21.15.22:0/1668263820 shutdown_connections 2024-09-15T22:39:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffc2a60 0x55fdeffd9990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 --2- 172.21.15.22:0/1668263820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffbd090 0x55fdeffb7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 -- 172.21.15.22:0/1668263820 >> 172.21.15.22:0/1668263820 conn(0x55fdeffb8700 msgr2=0x55fdeffb7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 -- 172.21.15.22:0/1668263820 shutdown_connections 2024-09-15T22:39:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 -- 172.21.15.22:0/1668263820 wait complete. 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.634+0000 7f48af235740 1 -- start start 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.635+0000 7f48af235740 1 Processor -- start 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.635+0000 7f48af235740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffbd090 0x55fdeffcc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.635+0000 7f48af235740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffcc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.635+0000 7f48af235740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffc2a60 0x55fdeffcd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48a9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffcc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48a9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffcc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:57354/0 (socket says 172.21.15.22:57354) 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48a9000640 1 -- 172.21.15.22:0/3615900732 learned_addr learned my addr 172.21.15.22:0/3615900732 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48a9a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffbd090 0x55fdeffcc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41b6480 con 0x55fdeffbd090 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48aa400640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffc2a60 0x55fdeffcd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41b78f0 con 0x55fdeffbd9d0 2024-09-15T22:39:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.636+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41b6b50 con 0x55fdeffc2a60 2024-09-15T22:39:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.637+0000 7f48af235740 10 client.0 _ll_register_callbacks cb 0x7f4890004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.637+0000 7f48aa400640 1 -- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 msgr2=0x55fdeffcc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.637+0000 7f48aa400640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffcc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.637+0000 7f48aa400640 1 -- 172.21.15.22:0/3615900732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffbd090 msgr2=0x55fdeffcc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.638+0000 7f48aa400640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffbd090 0x55fdeffcc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.638+0000 7f48aa400640 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdeffcdc10 con 0x55fdeffc2a60 2024-09-15T22:39:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.638+0000 7f48a9a00640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffbd090 0x55fdeffcc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.639+0000 7f48aa400640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffc2a60 0x55fdeffcd600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f489c02adf0 tx=0x7f489c009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f37dbbe7b99586c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.639+0000 7f488b400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:39:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.639+0000 7f488b400640 1 -- 172.21.15.22:0/3615900732 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c054070 con 0x55fdeffc2a60 2024-09-15T22:39:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.640+0000 7f488b400640 1 -- 172.21.15.22:0/3615900732 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f489c04a070 con 0x55fdeffc2a60 2024-09-15T22:39:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.640+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489c036040 con 0x55fdeffc2a60 2024-09-15T22:39:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.641+0000 7f488b400640 1 -- 172.21.15.22:0/3615900732 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f489c054070 con 0x55fdeffc2a60 2024-09-15T22:39:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.641+0000 7f48af235740 10 client.25552 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.641+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fdf003db40 con 0x55fdeffc2a60 2024-09-15T22:39:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f488b400640 1 -- 172.21.15.22:0/3615900732 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489c036040 con 0x55fdeffc2a60 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f488b400640 1 -- 172.21.15.22:0/3615900732 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f489c043070 con 0x55fdeffc2a60 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48af235740 10 client.25552 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48af235740 10 client.25552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48af235740 20 client.25552 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48af235740 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdf003df90 0x55fdf0040380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48af235740 4 client.25552 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdeff29b80 con 0x55fdf003df90 2024-09-15T22:39:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.642+0000 7f48a9a00640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdf003df90 0x55fdf0040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.643+0000 7f48a9a00640 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdf003df90 0x55fdf0040380 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be6b2011dc79dcd server_cookie=a9f830c722b6aa0f in_seq=0 out_seq=0 2024-09-15T22:39:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.643+0000 7f488b400640 10 client.25552 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.658+0000 7f488b400640 1 -- 172.21.15.22:0/3615900732 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdeff29b80 con 0x55fdf003df90 2024-09-15T22:39:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.658+0000 7f488b400640 10 client.25552 handle_command_reply: tid=0 2024-09-15T22:39:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.659+0000 7f48af235740 1 client.25552 shutdown 2024-09-15T22:39:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.660+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffc2a60 msgr2=0x55fdeffcd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.660+0000 7f48af235740 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffc2a60 0x55fdeffcd600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f489c02adf0 tx=0x7f489c009890 comp rx=0 tx=0).stop 2024-09-15T22:39:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 shutdown_connections 2024-09-15T22:39:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f48af235740 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55fdf003df90 0x55fdf0040380 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f48af235740 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fdeffc2a60 0x55fdeffcd600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f48af235740 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fdeffbd9d0 0x55fdeffcc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f48af235740 1 --2- 172.21.15.22:0/3615900732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdeffbd090 0x55fdeffcc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 >> 172.21.15.22:0/3615900732 conn(0x55fdeffb8700 msgr2=0x55fdeffb9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.661+0000 7f488b400640 0 client.25552 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.662+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 shutdown_connections 2024-09-15T22:39:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.662+0000 7f48af235740 1 -- 172.21.15.22:0/3615900732 wait complete. 2024-09-15T22:39:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.663+0000 7f48af235740 20 client.25552 trim_cache size 0 max 16384 2024-09-15T22:39:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:39:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:39:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:39:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:39:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f488c0a3460 msgr2=0x7f488c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f488c0a3460 0x7f488c0a5920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55fdeffbe400 tx=0x7f48980090e0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 msgr2=0x7f48a41a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a41a7130 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f489000c890 tx=0x7f489000cd50 comp rx=0 tx=0).stop 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 shutdown_connections 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48a40736c0 0x7f48a41a7130 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f488c0a3460 0x7f488c0a5920 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48a4109700 0x7f48a41ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 --2- 172.21.15.22:0/1109195690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48a4072d20 0x7f48a41a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.664+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 >> 172.21.15.22:0/1109195690 conn(0x7f48a406ece0 msgr2=0x7f48a4071660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.665+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 shutdown_connections 2024-09-15T22:39:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:11.665+0000 7f48ac400640 1 -- 172.21.15.22:0/1109195690 wait complete. 2024-09-15T22:39:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:11 smithi022 ceph-mon[30634]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 877 op/s 2024-09-15T22:39:11.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:11 smithi112 ceph-mon[35032]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 877 op/s 2024-09-15T22:39:11.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:11 smithi110 ceph-mon[35282]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 877 op/s 2024-09-15T22:39:13.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:13 smithi022 ceph-mon[30634]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 267 MiB/s wr, 921 op/s 2024-09-15T22:39:13.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:13 smithi112 ceph-mon[35032]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 267 MiB/s wr, 921 op/s 2024-09-15T22:39:13.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:13 smithi110 ceph-mon[35282]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 267 MiB/s wr, 921 op/s 2024-09-15T22:39:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:15 smithi022 ceph-mon[30634]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 268 MiB/s wr, 925 op/s 2024-09-15T22:39:15.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:15 smithi112 ceph-mon[35032]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 268 MiB/s wr, 925 op/s 2024-09-15T22:39:15.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:15 smithi110 ceph-mon[35282]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 268 MiB/s wr, 925 op/s 2024-09-15T22:39:17.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:17 smithi022 ceph-mon[30634]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 910 op/s 2024-09-15T22:39:17.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:17 smithi112 ceph-mon[35032]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 910 op/s 2024-09-15T22:39:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:17 smithi110 ceph-mon[35282]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 910 op/s 2024-09-15T22:39:19.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:19 smithi022 ceph-mon[30634]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 278 MiB/s wr, 974 op/s 2024-09-15T22:39:19.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:19 smithi112 ceph-mon[35032]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 278 MiB/s wr, 974 op/s 2024-09-15T22:39:19.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:19 smithi110 ceph-mon[35282]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 278 MiB/s wr, 974 op/s 2024-09-15T22:39:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:21 smithi022 ceph-mon[30634]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 903 op/s 2024-09-15T22:39:21.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:21 smithi112 ceph-mon[35032]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 903 op/s 2024-09-15T22:39:21.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:21 smithi110 ceph-mon[35282]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 903 op/s 2024-09-15T22:39:23.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:23 smithi112 ceph-mon[35032]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 937 op/s 2024-09-15T22:39:23.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:23 smithi110 ceph-mon[35282]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 937 op/s 2024-09-15T22:39:24.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:23 smithi022 ceph-mon[30634]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 937 op/s 2024-09-15T22:39:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 -- 172.21.15.22:0/4031623602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c01023c0 msgr2=0x7f81c01047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 --2- 172.21.15.22:0/4031623602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c01023c0 0x7f81c01047b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009900 tx=0x7f81b402a400 comp rx=0 tx=0).stop 2024-09-15T22:39:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 -- 172.21.15.22:0/4031623602 shutdown_connections 2024-09-15T22:39:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 --2- 172.21.15.22:0/4031623602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0104cf0 0x7f81c01070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 --2- 172.21.15.22:0/4031623602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81c0107620 0x7f81c0109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 --2- 172.21.15.22:0/4031623602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c01023c0 0x7f81c01047b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.912+0000 7f81c6e00640 1 -- 172.21.15.22:0/4031623602 >> 172.21.15.22:0/4031623602 conn(0x7f81c00fbfa0 msgr2=0x7f81c00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.913+0000 7f81c6e00640 1 -- 172.21.15.22:0/4031623602 shutdown_connections 2024-09-15T22:39:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.913+0000 7f81c6e00640 1 -- 172.21.15.22:0/4031623602 wait complete. 2024-09-15T22:39:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 Processor -- start 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 -- start start 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81c01023c0 0x7f81c0199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 0x7f81c019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0107620 0x7f81c01a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81c010d650 con 0x7f81c01023c0 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f81c010d4d0 con 0x7f81c0104cf0 2024-09-15T22:39:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.914+0000 7f81c6e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81c010d7d0 con 0x7f81c0107620 2024-09-15T22:39:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 0x7f81c019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c6400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0107620 0x7f81c01a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81c01023c0 0x7f81c0199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 0x7f81c019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:33876/0 (socket says 172.21.15.22:33876) 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 -- 172.21.15.22:0/1484011156 learned_addr learned my addr 172.21.15.22:0/1484011156 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 -- 172.21.15.22:0/1484011156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0107620 msgr2=0x7f81c01a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0107620 0x7f81c01a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 -- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81c01023c0 msgr2=0x7f81c0199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81c01023c0 0x7f81c0199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 -- 172.21.15.22:0/1484011156 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c01a1ab0 con 0x7f81c0104cf0 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c6400640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0107620 0x7f81c01a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.915+0000 7f81c5000640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 0x7f81c019a3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00c970 tx=0x7f81ac00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.916+0000 7f81be000640 1 -- 172.21.15.22:0/1484011156 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac014070 con 0x7f81c0104cf0 2024-09-15T22:39:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.916+0000 7f81be000640 1 -- 172.21.15.22:0/1484011156 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81ac004440 con 0x7f81c0104cf0 2024-09-15T22:39:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.916+0000 7f81be000640 1 -- 172.21.15.22:0/1484011156 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00f450 con 0x7f81c0104cf0 2024-09-15T22:39:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.916+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c01a1da0 con 0x7f81c0104cf0 2024-09-15T22:39:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.916+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c01a2210 con 0x7f81c0104cf0 2024-09-15T22:39:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.921+0000 7f81cb289740 1 Processor -- start 2024-09-15T22:39:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.921+0000 7f81be000640 1 -- 172.21.15.22:0/1484011156 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f81ac017070 con 0x7f81c0104cf0 2024-09-15T22:39:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.921+0000 7f81cb289740 1 -- start start 2024-09-15T22:39:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.922+0000 7f81cb289740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc99e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.922+0000 7f81cb289740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.922+0000 7f81cb289740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.922+0000 7f81cb289740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9dc903100 con 0x55e9dc99eba0 2024-09-15T22:39:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.922+0000 7f81cb289740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e9dc8ab1b0 con 0x55e9dc9a3c30 2024-09-15T22:39:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81cb289740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e9dc8ff0c0 con 0x55e9dc99e260 2024-09-15T22:39:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81be000640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f81a80a32c0 0x7f81a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54558/0 (socket says 172.21.15.22:54558) 2024-09-15T22:39:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81c5a00640 1 -- 172.21.15.22:0/2160814556 learned_addr learned my addr 172.21.15.22:0/2160814556 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81be000640 1 -- 172.21.15.22:0/1484011156 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f81ac0cf660 con 0x7f81c0104cf0 2024-09-15T22:39:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81c6400640 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc99e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.923+0000 7f81c6400640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f81a80a32c0 0x7f81a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.924+0000 7f81c5a00640 1 -- 172.21.15.22:0/2160814556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 msgr2=0x55e9dc99e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.924+0000 7f81c5a00640 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc99e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.924+0000 7f81c5a00640 1 -- 172.21.15.22:0/2160814556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 msgr2=0x55e9dc9a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.924+0000 7f81c5a00640 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.924+0000 7f81c5a00640 1 -- 172.21.15.22:0/2160814556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9dc616210 con 0x55e9dc99eba0 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.924+0000 7f81c5a00640 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a3660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81b40314e0 tx=0x7f81b4004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5cfd74329557f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.925+0000 7f81c6400640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f81a80a32c0 0x7f81a80a5780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f81b80099e0 tx=0x7f81b8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.925+0000 7f81b2a00640 1 -- 172.21.15.22:0/2160814556 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4035040 con 0x55e9dc99eba0 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.925+0000 7f81b2a00640 1 -- 172.21.15.22:0/2160814556 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4005520 con 0x55e9dc99eba0 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.925+0000 7f81b2a00640 1 -- 172.21.15.22:0/2160814556 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4031910 con 0x55e9dc99eba0 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 -- 172.21.15.22:0/2160814556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 msgr2=0x55e9dc9a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a3660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81b40314e0 tx=0x7f81b4004170 comp rx=0 tx=0).stop 2024-09-15T22:39:24.929 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 -- 172.21.15.22:0/2160814556 shutdown_connections 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a3660 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 --2- 172.21.15.22:0/2160814556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc99e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 -- 172.21.15.22:0/2160814556 >> 172.21.15.22:0/2160814556 conn(0x55e9dc9998d0 msgr2=0x55e9dc999cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 -- 172.21.15.22:0/2160814556 shutdown_connections 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.926+0000 7f81cb289740 1 -- 172.21.15.22:0/2160814556 wait complete. 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.927+0000 7f81cb289740 1 -- start start 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.927+0000 7f81cb289740 1 Processor -- start 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9a8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9dc9a6ba0 con 0x55e9dc9a3c30 2024-09-15T22:39:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e9dc88c090 con 0x55e9dc99e260 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e9dc9a6d20 con 0x55e9dc99eba0 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81cb289740 10 client.0 _ll_register_callbacks cb 0x55e9dc8e0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9a8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:33890/0 (socket says 172.21.15.22:33890) 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 -- 172.21.15.22:0/2601940920 learned_addr learned my addr 172.21.15.22:0/2601940920 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5000640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c6400640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 -- 172.21.15.22:0/2601940920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 msgr2=0x55e9dc9a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 -- 172.21.15.22:0/2601940920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 msgr2=0x55e9dc9af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.928+0000 7f81c5a00640 1 -- 172.21.15.22:0/2601940920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9dc6e2620 con 0x55e9dc99e260 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81c5a00640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9a8470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b40058c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6b5141579c6c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81a7400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81a7400640 1 -- 172.21.15.22:0/2601940920 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4052060 con 0x55e9dc99e260 2024-09-15T22:39:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81a7400640 1 -- 172.21.15.22:0/2601940920 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f81b4004980 con 0x55e9dc99e260 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b4005520 con 0x55e9dc99e260 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81a7400640 1 -- 172.21.15.22:0/2601940920 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81b4035070 con 0x55e9dc99e260 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81cb289740 10 client.25550 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e9dc9b27e0 con 0x55e9dc99e260 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.929+0000 7f81a7400640 1 -- 172.21.15.22:0/2601940920 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4005520 con 0x55e9dc99e260 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81a7400640 1 -- 172.21.15.22:0/2601940920 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81b4003cc0 con 0x55e9dc99e260 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81cb289740 10 client.25550 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81cb289740 10 client.25550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81cb289740 20 client.25550 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81cb289740 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dc9b3b30 0x55e9dc9b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81cb289740 4 client.25550 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:39:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9dc910830 con 0x55e9dc9b3b30 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.930+0000 7f81c5000640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dc9b3b30 0x55e9dc9b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.931+0000 7f81c5000640 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dc9b3b30 0x55e9dc9b5f20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17fd66cd9af4e0 server_cookie=55b4cb04ca279cf5 in_seq=0 out_seq=0 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.931+0000 7f81a7400640 10 client.25550 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.931+0000 7f81a7400640 1 -- 172.21.15.22:0/2601940920 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9dc910830 con 0x55e9dc9b3b30 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.931+0000 7f81a7400640 10 client.25550 handle_command_reply: tid=0 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.931+0000 7f81cb289740 1 client.25550 shutdown 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 msgr2=0x55e9dc9a8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9a8470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b40058c0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 shutdown_connections 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dc9b3b30 0x55e9dc9b5f20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81a7400640 0 client.25550 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 --2- 172.21.15.22:0/2601940920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9a8470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 >> 172.21.15.22:0/2601940920 conn(0x55e9dc9998d0 msgr2=0x55e9dc99b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 shutdown_connections 2024-09-15T22:39:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 1 -- 172.21.15.22:0/2601940920 wait complete. 2024-09-15T22:39:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.932+0000 7f81cb289740 20 client.25550 trim_cache size 0 max 16384 2024-09-15T22:39:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.963+0000 7f81cb289740 1 Processor -- start 2024-09-15T22:39:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.963+0000 7f81cb289740 1 -- start start 2024-09-15T22:39:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81cb289740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc998900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81cb289740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc998e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81cb289740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81cb289740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01ad9a0 con 0x55e9dc99eba0 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81cb289740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01ab270 con 0x55e9dc9a3c30 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81cb289740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01a90a0 con 0x55e9dc99e260 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81c5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc998e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc998900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81c5000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc998e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54576/0 (socket says 172.21.15.22:54576) 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81c5000640 1 -- 172.21.15.22:0/1980463555 learned_addr learned my addr 172.21.15.22:0/1980463555 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.964+0000 7f81c6400640 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5a00640 1 -- 172.21.15.22:0/1980463555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 msgr2=0x55e9dc9af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5a00640 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5a00640 1 -- 172.21.15.22:0/1980463555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 msgr2=0x55e9dc998e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5a00640 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc998e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5a00640 1 -- 172.21.15.22:0/1980463555 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9dc9996f0 con 0x55e9dc99e260 2024-09-15T22:39:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5000640 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc998e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81c5a00640 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc998900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81b4004650 tx=0x7f81b4004bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8491442e27e392d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81b2000640 1 -- 172.21.15.22:0/1980463555 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b405c070 con 0x55e9dc99e260 2024-09-15T22:39:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81b2000640 1 -- 172.21.15.22:0/1980463555 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b403c580 con 0x55e9dc99e260 2024-09-15T22:39:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.965+0000 7f81b2000640 1 -- 172.21.15.22:0/1980463555 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4052040 con 0x55e9dc99e260 2024-09-15T22:39:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 -- 172.21.15.22:0/1980463555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 msgr2=0x55e9dc998900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc998900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81b4004650 tx=0x7f81b4004bd0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 -- 172.21.15.22:0/1980463555 shutdown_connections 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc99eba0 0x55e9dc998e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 --2- 172.21.15.22:0/1980463555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99e260 0x55e9dc998900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 -- 172.21.15.22:0/1980463555 >> 172.21.15.22:0/1980463555 conn(0x55e9dc9998d0 msgr2=0x55e9dc9981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 -- 172.21.15.22:0/1980463555 shutdown_connections 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.966+0000 7f81cb289740 1 -- 172.21.15.22:0/1980463555 wait complete. 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 -- start start 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 Processor -- start 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01a9730 con 0x55e9dc9a3c30 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01aaba0 con 0x55e9dc99e260 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01a9e00 con 0x55e9dc99eba0 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81cb289740 10 client.0 _ll_register_callbacks cb 0x7f81b8011760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81c5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81c5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:45684/0 (socket says 172.21.15.22:45684) 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81c6400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81c5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.967+0000 7f81c5000640 1 -- 172.21.15.22:0/129032131 learned_addr learned my addr 172.21.15.22:0/129032131 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81c5000640 1 -- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 msgr2=0x55e9dc9acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81c5000640 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81c5000640 1 -- 172.21.15.22:0/129032131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 msgr2=0x55e9dc9ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81c5000640 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81c5000640 1 -- 172.21.15.22:0/129032131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9dc9aea90 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81c5000640 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9ad470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0cd0f0 tx=0x7f81ac086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a96d0613c3c38bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81a7400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81a7400640 1 -- 172.21.15.22:0/129032131 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0a48b0 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81a7400640 1 -- 172.21.15.22:0/129032131 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f81ac0cd230 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b403c580 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81a7400640 1 -- 172.21.15.22:0/129032131 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81ac0035f0 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81cb289740 10 client.25567 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.968+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e9dca1e720 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81a7400640 1 -- 172.21.15.22:0/129032131 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b403c580 con 0x55e9dc99eba0 2024-09-15T22:39:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81a7400640 1 -- 172.21.15.22:0/129032131 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81ac09b210 con 0x55e9dc99eba0 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81cb289740 10 client.25567 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81cb289740 10 client.25567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81cb289740 20 client.25567 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81cb289740 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dca1f000 0x55e9dca21420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81cb289740 4 client.25567 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e9dc90ab80 con 0x55e9dca1f000 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.969+0000 7f81c5a00640 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dca1f000 0x55e9dca21420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.970+0000 7f81c5a00640 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dca1f000 0x55e9dca21420 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5bf4df7ce34e73f server_cookie=616c61681f2e0c3d in_seq=0 out_seq=0 2024-09-15T22:39:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:24.970+0000 7f81a7400640 10 client.25567 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.057+0000 7f81a7400640 1 -- 172.21.15.22:0/129032131 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e9dc90ab80 con 0x55e9dca1f000 2024-09-15T22:39:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.057+0000 7f81a7400640 10 client.25567 handle_command_reply: tid=0 2024-09-15T22:39:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.057+0000 7f81cb289740 1 client.25567 shutdown 2024-09-15T22:39:25.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.071+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 msgr2=0x55e9dc9ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:25.073 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.071+0000 7f81cb289740 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9ad470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0cd0f0 tx=0x7f81ac086040 comp rx=0 tx=0).stop 2024-09-15T22:39:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.072+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 shutdown_connections 2024-09-15T22:39:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.072+0000 7f81cb289740 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e9dca1f000 0x55e9dca21420 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.072+0000 7f81a7400640 0 client.25567 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.072+0000 7f81cb289740 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e9dc99eba0 0x55e9dc9ad470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.072+0000 7f81cb289740 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9dc9a3c30 0x55e9dc9ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.073+0000 7f81cb289740 1 --2- 172.21.15.22:0/129032131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e9dc99e260 0x55e9dc9acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.073+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 >> 172.21.15.22:0/129032131 conn(0x55e9dc9998d0 msgr2=0x55e9dc998a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.073+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 shutdown_connections 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.074+0000 7f81cb289740 1 -- 172.21.15.22:0/129032131 wait complete. 2024-09-15T22:39:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.074+0000 7f81cb289740 20 client.25567 trim_cache size 0 max 16384 2024-09-15T22:39:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:39:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:39:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:39:25.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.096+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f81a80a32c0 msgr2=0x7f81a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.096+0000 7f81c6e00640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f81a80a32c0 0x7f81a80a5780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f81b80099e0 tx=0x7f81b8009500 comp rx=0 tx=0).stop 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.096+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 msgr2=0x7f81c019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.096+0000 7f81c6e00640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 0x7f81c019a3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00c970 tx=0x7f81ac00ce30 comp rx=0 tx=0).stop 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.103+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 shutdown_connections 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.103+0000 7f81c6e00640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0107620 0x7f81c01a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.103+0000 7f81c6e00640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f81a80a32c0 0x7f81a80a5780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.103+0000 7f81c6e00640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81c0104cf0 0x7f81c019a3d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.103+0000 7f81c6e00640 1 --2- 172.21.15.22:0/1484011156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81c01023c0 0x7f81c0199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.103+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 >> 172.21.15.22:0/1484011156 conn(0x7f81c00fbfa0 msgr2=0x7f81c0101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.104+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 shutdown_connections 2024-09-15T22:39:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:25.104+0000 7f81c6e00640 1 -- 172.21.15.22:0/1484011156 wait complete. 2024-09-15T22:39:25.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:25 smithi112 ceph-mon[35032]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 916 op/s 2024-09-15T22:39:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:25 smithi110 ceph-mon[35282]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 916 op/s 2024-09-15T22:39:26.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:25 smithi022 ceph-mon[30634]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 916 op/s 2024-09-15T22:39:27.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:27 smithi112 ceph-mon[35032]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 864 op/s 2024-09-15T22:39:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:27 smithi110 ceph-mon[35282]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 864 op/s 2024-09-15T22:39:28.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:27 smithi022 ceph-mon[30634]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 MiB/s wr, 864 op/s 2024-09-15T22:39:29.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:29 smithi112 ceph-mon[35032]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 262 MiB/s wr, 920 op/s 2024-09-15T22:39:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:29 smithi110 ceph-mon[35282]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 262 MiB/s wr, 920 op/s 2024-09-15T22:39:30.036 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:29 smithi022 ceph-mon[30634]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 262 MiB/s wr, 920 op/s 2024-09-15T22:39:31.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:31 smithi112 ceph-mon[35032]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 246 MiB/s wr, 849 op/s 2024-09-15T22:39:31.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:31 smithi110 ceph-mon[35282]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 246 MiB/s wr, 849 op/s 2024-09-15T22:39:32.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:31 smithi022 ceph-mon[30634]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 246 MiB/s wr, 849 op/s 2024-09-15T22:39:33.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:33 smithi112 ceph-mon[35032]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 926 op/s 2024-09-15T22:39:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:33 smithi110 ceph-mon[35282]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 926 op/s 2024-09-15T22:39:34.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:33 smithi022 ceph-mon[30634]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 926 op/s 2024-09-15T22:39:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:35 smithi110 ceph-mon[35282]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 909 op/s 2024-09-15T22:39:36.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:35 smithi022 ceph-mon[30634]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 909 op/s 2024-09-15T22:39:36.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:35 smithi112 ceph-mon[35032]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 MiB/s wr, 909 op/s 2024-09-15T22:39:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:37 smithi110 ceph-mon[35282]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 253 MiB/s wr, 876 op/s 2024-09-15T22:39:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:37 smithi022 ceph-mon[30634]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 253 MiB/s wr, 876 op/s 2024-09-15T22:39:38.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:37 smithi112 ceph-mon[35032]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 253 MiB/s wr, 876 op/s 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 -- 172.21.15.22:0/1807458461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288077df0 msgr2=0x7f5288078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 --2- 172.21.15.22:0/1807458461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288077df0 0x7f5288078250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5270009900 tx=0x7f527002a410 comp rx=0 tx=0).stop 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 -- 172.21.15.22:0/1807458461 shutdown_connections 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 --2- 172.21.15.22:0/1807458461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f5288079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 --2- 172.21.15.22:0/1807458461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288077df0 0x7f5288078250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 --2- 172.21.15.22:0/1807458461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288076bb0 0x7f5288076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 -- 172.21.15.22:0/1807458461 >> 172.21.15.22:0/1807458461 conn(0x7f52880ff2f0 msgr2=0x7f5288101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 -- 172.21.15.22:0/1807458461 shutdown_connections 2024-09-15T22:39:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.369+0000 7f528f200640 1 -- 172.21.15.22:0/1807458461 wait complete. 2024-09-15T22:39:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.370+0000 7f528f200640 1 Processor -- start 2024-09-15T22:39:38.372 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.371+0000 7f528f200640 1 -- start start 2024-09-15T22:39:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.372+0000 7f528f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 0x7f528810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.372+0000 7f528f200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 0x7f528810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.374 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.372+0000 7f528f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f52881ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f5287e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 0x7f528810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f5287e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 0x7f528810e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38794/0 (socket says 172.21.15.22:38794) 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f527fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 0x7f528810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f528f200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5288113c70 con 0x7f5288077df0 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f528f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5288113af0 con 0x7f5288076bb0 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f528f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5288113df0 con 0x7f5288078790 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f528d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f52881ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f528d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f52881ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35016/0 (socket says 172.21.15.22:35016) 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f527fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 0x7f528810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42598/0 (socket says 172.21.15.22:42598) 2024-09-15T22:39:38.375 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.373+0000 7f528d200640 1 -- 172.21.15.22:0/1171408703 learned_addr learned my addr 172.21.15.22:0/1171408703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:38.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f528d200640 1 -- 172.21.15.22:0/1171408703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 msgr2=0x7f528810e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f528d200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 0x7f528810e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f528d200640 1 -- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 msgr2=0x7f528810eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f528d200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 0x7f528810eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.376 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f528d200640 1 -- 172.21.15.22:0/1171408703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52881ae880 con 0x7f5288078790 2024-09-15T22:39:38.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f527fe00640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 0x7f528810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:38.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.374+0000 7f5287e00640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 0x7f528810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:38.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.378+0000 7f528d200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f52881ae340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f528000eaa0 tx=0x7f528000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.378+0000 7f5285600640 1 -- 172.21.15.22:0/1171408703 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528000cdb0 con 0x7f5288078790 2024-09-15T22:39:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.379+0000 7f5285600640 1 -- 172.21.15.22:0/1171408703 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5280005020 con 0x7f5288078790 2024-09-15T22:39:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.379+0000 7f5285600640 1 -- 172.21.15.22:0/1171408703 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800116b0 con 0x7f5288078790 2024-09-15T22:39:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.380+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52881aea50 con 0x7f5288078790 2024-09-15T22:39:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.380+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52881aeec0 con 0x7f5288078790 2024-09-15T22:39:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.387+0000 7f52921c0740 1 Processor -- start 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.389+0000 7f5285600640 1 -- 172.21.15.22:0/1171408703 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5280005560 con 0x7f5288078790 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.389+0000 7f52921c0740 1 -- start start 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.390+0000 7f52921c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853bb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.390+0000 7f52921c0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853c0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.390+0000 7f52921c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.390+0000 7f52921c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c085320100 con 0x55c0853bb260 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.390+0000 7f52921c0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c0852c81b0 con 0x55c0853bbba0 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.390+0000 7f52921c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c08531c0c0 con 0x55c0853c0c30 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.391+0000 7f5285600640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f526c0a3450 0x7f526c0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.392+0000 7f5285600640 1 -- 172.21.15.22:0/1171408703 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f52800cfcb0 con 0x7f5288078790 2024-09-15T22:39:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.393+0000 7f527fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.393+0000 7f527fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35026/0 (socket says 172.21.15.22:35026) 2024-09-15T22:39:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.393+0000 7f527fe00640 1 -- 172.21.15.22:0/942826432 learned_addr learned my addr 172.21.15.22:0/942826432 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.393+0000 7f5287e00640 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.393+0000 7f527fe00640 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.394+0000 7f528d200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f526c0a3450 0x7f526c0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.394+0000 7f527fe00640 1 -- 172.21.15.22:0/942826432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 msgr2=0x55c0853c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.394+0000 7f527fe00640 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.394+0000 7f527fe00640 1 -- 172.21.15.22:0/942826432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 msgr2=0x55c0853bb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.394+0000 7f527fe00640 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853bb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.395+0000 7f527fe00640 1 -- 172.21.15.22:0/942826432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c085033210 con 0x55c0853c0c30 2024-09-15T22:39:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.395+0000 7f528d200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f526c0a3450 0x7f526c0a5910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5280009270 tx=0x7f528001c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.395+0000 7f527fe00640 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853c30f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f527002aa00 tx=0x7f5270000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87d44e2ce799195 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.396+0000 7f527d600640 1 -- 172.21.15.22:0/942826432 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270005520 con 0x55c0853c0c30 2024-09-15T22:39:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.396+0000 7f527d600640 1 -- 172.21.15.22:0/942826432 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527003f920 con 0x55c0853c0c30 2024-09-15T22:39:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.396+0000 7f527d600640 1 -- 172.21.15.22:0/942826432 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52700316a0 con 0x55c0853c0c30 2024-09-15T22:39:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 -- 172.21.15.22:0/942826432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 msgr2=0x55c0853c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853c30f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f527002aa00 tx=0x7f5270000bc0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 -- 172.21.15.22:0/942826432 shutdown_connections 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853c30f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 --2- 172.21.15.22:0/942826432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853bb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 -- 172.21.15.22:0/942826432 >> 172.21.15.22:0/942826432 conn(0x55c0853b68d0 msgr2=0x55c0853b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 -- 172.21.15.22:0/942826432 shutdown_connections 2024-09-15T22:39:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.397+0000 7f52921c0740 1 -- 172.21.15.22:0/942826432 wait complete. 2024-09-15T22:39:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.398+0000 7f52921c0740 1 -- start start 2024-09-15T22:39:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.398+0000 7f52921c0740 1 Processor -- start 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 0x55c0853d6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853d6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853c0c30 0x55c0853dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c0853d4bb0 con 0x55c0853c0c30 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c0852a9090 con 0x55c0853bb260 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c0853d4d30 con 0x55c0853bbba0 2024-09-15T22:39:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f52921c0740 10 client.0 _ll_register_callbacks cb 0x55c0852fdf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.399+0000 7f527fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 0x55c0853d6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f527fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 0x55c0853d6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38812/0 (socket says 172.21.15.22:38812) 2024-09-15T22:39:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f527fe00640 1 -- 172.21.15.22:0/3036848848 learned_addr learned my addr 172.21.15.22:0/3036848848 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f527fe00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853c0c30 0x55c0853dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f5287e00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f5287e00640 1 -- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 msgr2=0x55c0853d6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f5287e00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 0x55c0853d6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f5287e00640 1 -- 172.21.15.22:0/3036848848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853c0c30 msgr2=0x55c0853dd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f5287e00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853c0c30 0x55c0853dd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f5287e00640 1 -- 172.21.15.22:0/3036848848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0850ff620 con 0x55c0853bbba0 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.400+0000 7f527fe00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 0x55c0853d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f5287e00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853d6960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55c0853bc5d0 tx=0x7f5278011ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9fc87b7dc87d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f5276000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:39:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f5276000640 1 -- 172.21.15.22:0/3036848848 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278004020 con 0x55c0853bbba0 2024-09-15T22:39:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f527003f920 con 0x55c0853bbba0 2024-09-15T22:39:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f5276000640 1 -- 172.21.15.22:0/3036848848 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f52780041c0 con 0x55c0853bbba0 2024-09-15T22:39:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f5276000640 1 -- 172.21.15.22:0/3036848848 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f52780043c0 con 0x55c0853bbba0 2024-09-15T22:39:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f52921c0740 10 client.25579 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.401+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c0853e0850 con 0x55c0853bbba0 2024-09-15T22:39:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.402+0000 7f5276000640 1 -- 172.21.15.22:0/3036848848 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527003f920 con 0x55c0853bbba0 2024-09-15T22:39:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.402+0000 7f5276000640 1 -- 172.21.15.22:0/3036848848 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5278023020 con 0x55c0853bbba0 2024-09-15T22:39:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.403+0000 7f52921c0740 10 client.25579 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.403+0000 7f52921c0740 10 client.25579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.403+0000 7f52921c0740 20 client.25579 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.403+0000 7f52921c0740 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c0853e4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.403+0000 7f52921c0740 4 client.25579 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:39:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.403+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c08532d830 con 0x55c0853e1f40 2024-09-15T22:39:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.405+0000 7f527fe00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c0853e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.407+0000 7f527fe00640 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c0853e4380 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ed322beb3fbe29 server_cookie=c310b6d2f065e8ec in_seq=0 out_seq=0 2024-09-15T22:39:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.407+0000 7f5276000640 10 client.25579 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.408+0000 7f5276000640 1 -- 172.21.15.22:0/3036848848 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c08532d830 con 0x55c0853e1f40 2024-09-15T22:39:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.408+0000 7f5276000640 10 client.25579 handle_command_reply: tid=0 2024-09-15T22:39:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.409+0000 7f52921c0740 1 client.25579 shutdown 2024-09-15T22:39:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.409+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 msgr2=0x55c0853d6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.409+0000 7f52921c0740 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853d6960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55c0853bc5d0 tx=0x7f5278011ba0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.409+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 shutdown_connections 2024-09-15T22:39:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.410+0000 7f52921c0740 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c0853e4380 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.410+0000 7f5276000640 0 client.25579 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.410+0000 7f52921c0740 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853d6960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.410+0000 7f52921c0740 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853c0c30 0x55c0853dd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.410+0000 7f52921c0740 1 --2- 172.21.15.22:0/3036848848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bb260 0x55c0853d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.410+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 >> 172.21.15.22:0/3036848848 conn(0x55c0853b68d0 msgr2=0x55c0853b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.411+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 shutdown_connections 2024-09-15T22:39:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.411+0000 7f52921c0740 1 -- 172.21.15.22:0/3036848848 wait complete. 2024-09-15T22:39:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.411+0000 7f52921c0740 20 client.25579 trim_cache size 0 max 16384 2024-09-15T22:39:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.431+0000 7f52921c0740 1 Processor -- start 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 -- start start 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853e4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853dd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52881b1ce0 con 0x55c0853bb260 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52881af5b0 con 0x55c0853bbba0 2024-09-15T22:39:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f52921c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52880726b0 con 0x55c0853c0c30 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.432+0000 7f527fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853e4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42638/0 (socket says 172.21.15.22:42638) 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 -- 172.21.15.22:0/3130854934 learned_addr learned my addr 172.21.15.22:0/3130854934 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 -- 172.21.15.22:0/3130854934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 msgr2=0x55c0853b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 -- 172.21.15.22:0/3130854934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 msgr2=0x55c0853dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 -- 172.21.15.22:0/3130854934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0853b66f0 con 0x55c0853bb260 2024-09-15T22:39:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.433+0000 7f527fe00640 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853e4360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52700036f0 tx=0x7f5270005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ed5a8fc1f7aaff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.434+0000 7f527cc00640 1 -- 172.21.15.22:0/3130854934 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270005630 con 0x55c0853bb260 2024-09-15T22:39:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.434+0000 7f527cc00640 1 -- 172.21.15.22:0/3130854934 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5270061070 con 0x55c0853bb260 2024-09-15T22:39:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.434+0000 7f527cc00640 1 -- 172.21.15.22:0/3130854934 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527005d8d0 con 0x55c0853bb260 2024-09-15T22:39:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.435+0000 7f52921c0740 1 -- 172.21.15.22:0/3130854934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 msgr2=0x55c0853e4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.435+0000 7f52921c0740 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853e4360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52700036f0 tx=0x7f5270005a40 comp rx=0 tx=0).stop 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 -- 172.21.15.22:0/3130854934 shutdown_connections 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853c0c30 0x55c0853b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853bbba0 0x55c0853dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 --2- 172.21.15.22:0/3130854934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853e4360 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 -- 172.21.15.22:0/3130854934 >> 172.21.15.22:0/3130854934 conn(0x55c0853b68d0 msgr2=0x55c0853bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 -- 172.21.15.22:0/3130854934 shutdown_connections 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 -- 172.21.15.22:0/3130854934 wait complete. 2024-09-15T22:39:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.436+0000 7f52921c0740 1 -- start start 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 Processor -- start 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853dab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853db070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853c0c30 0x55c0853dc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5288072d40 con 0x55c0853bb260 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52880741b0 con 0x55c0853c0c30 2024-09-15T22:39:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5288073410 con 0x55c0853bbba0 2024-09-15T22:39:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.437+0000 7f52921c0740 10 client.0 _ll_register_callbacks cb 0x7f527800bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f5287e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853db070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f527fe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853dab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f5287e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853db070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:35048/0 (socket says 172.21.15.22:35048) 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f5287e00640 1 -- 172.21.15.22:0/3473227440 learned_addr learned my addr 172.21.15.22:0/3473227440 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f527fe00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853c0c30 0x55c0853dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f5287e00640 1 -- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853c0c30 msgr2=0x55c0853dc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.438+0000 7f5287e00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853c0c30 0x55c0853dc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5287e00640 1 -- 172.21.15.22:0/3473227440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 msgr2=0x55c0853dab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5287e00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853dab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5287e00640 1 -- 172.21.15.22:0/3473227440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0853dc690 con 0x55c0853bbba0 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f527fe00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853c0c30 0x55c0853dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5287e00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853db070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5278004a90 tx=0x7f5278010870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bb7aac63f7bb16f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5276000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5276000640 1 -- 172.21.15.22:0/3473227440 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278004660 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5270061070 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.439+0000 7f5276000640 1 -- 172.21.15.22:0/3473227440 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5278010ba0 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.440+0000 7f5276000640 1 -- 172.21.15.22:0/3473227440 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5278010de0 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.440+0000 7f52921c0740 10 client.25585 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.440+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c0853dd9d0 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.440+0000 7f5276000640 1 -- 172.21.15.22:0/3473227440 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5270061070 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f5276000640 1 -- 172.21.15.22:0/3473227440 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5278023040 con 0x55c0853bbba0 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f52921c0740 10 client.25585 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f52921c0740 10 client.25585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f52921c0740 20 client.25585 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:38.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f52921c0740 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c08544f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f52921c0740 4 client.25585 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:39:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c085327b80 con 0x55c0853e1f40 2024-09-15T22:39:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.441+0000 7f527fe00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c08544f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.442+0000 7f527fe00640 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c08544f1d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b41d5b2518c684 server_cookie=6b74b919ca774456 in_seq=0 out_seq=0 2024-09-15T22:39:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.442+0000 7f5276000640 10 client.25585 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.465+0000 7f5276000640 1 -- 172.21.15.22:0/3473227440 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c085327b80 con 0x55c0853e1f40 2024-09-15T22:39:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.465+0000 7f5276000640 10 client.25585 handle_command_reply: tid=0 2024-09-15T22:39:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.465+0000 7f52921c0740 1 client.25585 shutdown 2024-09-15T22:39:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.465+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 msgr2=0x55c0853db070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.465+0000 7f52921c0740 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853db070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5278004a90 tx=0x7f5278010870 comp rx=0 tx=0).stop 2024-09-15T22:39:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 shutdown_connections 2024-09-15T22:39:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f52921c0740 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c0853e1f40 0x55c08544f1d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f52921c0740 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c0853bbba0 0x55c0853db070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f52921c0740 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0853c0c30 0x55c0853dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f52921c0740 1 --2- 172.21.15.22:0/3473227440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c0853bb260 0x55c0853dab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 >> 172.21.15.22:0/3473227440 conn(0x55c0853b68d0 msgr2=0x55c0853b77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.486+0000 7f5276000640 0 client.25585 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.487+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 shutdown_connections 2024-09-15T22:39:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.487+0000 7f52921c0740 1 -- 172.21.15.22:0/3473227440 wait complete. 2024-09-15T22:39:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.487+0000 7f52921c0740 20 client.25585 trim_cache size 0 max 16384 2024-09-15T22:39:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:39:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:39:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:39:38.491 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:39:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f526c0a3450 msgr2=0x7f526c0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f526c0a3450 0x7f526c0a5910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5280009270 tx=0x7f528001c040 comp rx=0 tx=0).stop 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 msgr2=0x7f52881ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f52881ae340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f528000eaa0 tx=0x7f528000ef60 comp rx=0 tx=0).stop 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 shutdown_connections 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5288078790 0x7f52881ae340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f526c0a3450 0x7f526c0a5910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5288077df0 0x7f528810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 --2- 172.21.15.22:0/1171408703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5288076bb0 0x7f528810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.493+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 >> 172.21.15.22:0/1171408703 conn(0x7f52880ff2f0 msgr2=0x7f5288100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.497+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 shutdown_connections 2024-09-15T22:39:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:38.497+0000 7f528f200640 1 -- 172.21.15.22:0/1171408703 wait complete. 2024-09-15T22:39:39.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:39 smithi110 ceph-mon[35282]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 930 op/s 2024-09-15T22:39:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:39 smithi022 ceph-mon[30634]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 930 op/s 2024-09-15T22:39:40.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:39 smithi112 ceph-mon[35032]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 930 op/s 2024-09-15T22:39:41.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:41 smithi110 ceph-mon[35282]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 862 op/s 2024-09-15T22:39:42.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:41 smithi022 ceph-mon[30634]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 862 op/s 2024-09-15T22:39:42.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:41 smithi112 ceph-mon[35032]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 862 op/s 2024-09-15T22:39:43.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:43 smithi110 ceph-mon[35282]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 918 op/s 2024-09-15T22:39:44.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:43 smithi022 ceph-mon[30634]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 918 op/s 2024-09-15T22:39:44.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:43 smithi112 ceph-mon[35032]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 918 op/s 2024-09-15T22:39:45.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:45 smithi110 ceph-mon[35282]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 256 MiB/s wr, 897 op/s 2024-09-15T22:39:46.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:45 smithi022 ceph-mon[30634]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 256 MiB/s wr, 897 op/s 2024-09-15T22:39:46.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:45 smithi112 ceph-mon[35032]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 256 MiB/s wr, 897 op/s 2024-09-15T22:39:47.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:47 smithi110 ceph-mon[35282]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 248 MiB/s wr, 875 op/s 2024-09-15T22:39:48.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:47 smithi022 ceph-mon[30634]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 248 MiB/s wr, 875 op/s 2024-09-15T22:39:48.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:47 smithi112 ceph-mon[35032]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 248 MiB/s wr, 875 op/s 2024-09-15T22:39:49.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:49 smithi110 ceph-mon[35282]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 937 op/s 2024-09-15T22:39:50.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:49 smithi022 ceph-mon[30634]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 937 op/s 2024-09-15T22:39:50.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:49 smithi112 ceph-mon[35032]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 937 op/s 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.698+0000 7f3840400640 1 -- 172.21.15.22:0/1823515868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838101b60 msgr2=0x7f3838101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.698+0000 7f3840400640 1 --2- 172.21.15.22:0/1823515868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838101b60 0x7f3838101f60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f382c009900 tx=0x7f382c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.698+0000 7f3840400640 1 -- 172.21.15.22:0/1823515868 shutdown_connections 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.698+0000 7f3840400640 1 --2- 172.21.15.22:0/1823515868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3838103710 0x7f3838109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.699+0000 7f3840400640 1 --2- 172.21.15.22:0/1823515868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3838102d50 0x7f38381031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.699+0000 7f3840400640 1 --2- 172.21.15.22:0/1823515868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838101b60 0x7f3838101f60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.699+0000 7f3840400640 1 -- 172.21.15.22:0/1823515868 >> 172.21.15.22:0/1823515868 conn(0x7f38380fd2e0 msgr2=0x7f38380ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.699+0000 7f3840400640 1 -- 172.21.15.22:0/1823515868 shutdown_connections 2024-09-15T22:39:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.699+0000 7f3840400640 1 -- 172.21.15.22:0/1823515868 wait complete. 2024-09-15T22:39:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.700+0000 7f3840400640 1 Processor -- start 2024-09-15T22:39:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.700+0000 7f3840400640 1 -- start start 2024-09-15T22:39:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f3840400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3838101b60 0x7f3838075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f3840400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3838102d50 0x7f38380745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f3840400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 0x7f3838074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f3840400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f383810d830 con 0x7f3838101b60 2024-09-15T22:39:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f3840400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f383810d6b0 con 0x7f3838102d50 2024-09-15T22:39:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f3840400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f383810d9b0 con 0x7f3838103710 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f383e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 0x7f3838074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f383e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 0x7f3838074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:52218/0 (socket says 172.21.15.22:52218) 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.701+0000 7f383e400640 1 -- 172.21.15.22:0/980723657 learned_addr learned my addr 172.21.15.22:0/980723657 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.702+0000 7f383e400640 1 -- 172.21.15.22:0/980723657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3838102d50 msgr2=0x7f38380745e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.702+0000 7f383e400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3838102d50 0x7f38380745e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.702+0000 7f383e400640 1 -- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3838101b60 msgr2=0x7f3838075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.702+0000 7f383e400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3838101b60 0x7f3838075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.702+0000 7f383e400640 1 -- 172.21.15.22:0/980723657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38380753b0 con 0x7f3838103710 2024-09-15T22:39:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.702+0000 7f383e400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 0x7f3838074b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f383000cce0 tx=0x7f383000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.703+0000 7f3836000640 1 -- 172.21.15.22:0/980723657 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383000f450 con 0x7f3838103710 2024-09-15T22:39:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.703+0000 7f3836000640 1 -- 172.21.15.22:0/980723657 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f383000fad0 con 0x7f3838103710 2024-09-15T22:39:51.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.703+0000 7f3836000640 1 -- 172.21.15.22:0/980723657 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830018c10 con 0x7f3838103710 2024-09-15T22:39:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.704+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38381a1ec0 con 0x7f3838103710 2024-09-15T22:39:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.704+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38381a22d0 con 0x7f3838103710 2024-09-15T22:39:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.709+0000 7f38433e9740 1 Processor -- start 2024-09-15T22:39:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.714+0000 7f3836000640 1 -- 172.21.15.22:0/980723657 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f383000fc80 con 0x7f3838103710 2024-09-15T22:39:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.715+0000 7f38433e9740 1 -- start start 2024-09-15T22:39:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.715+0000 7f38433e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee81ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f38433e9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 0x56084ee86ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f38433e9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee89730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f38433e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56084edde100 con 0x56084ee818a0 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f38433e9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56084ed861b0 con 0x56084ee821e0 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f38433e9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56084edda0c0 con 0x56084ee87270 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f383da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 0x56084ee86ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f383da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 0x56084ee86ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53444/0 (socket says 172.21.15.22:53444) 2024-09-15T22:39:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f383da00640 1 -- 172.21.15.22:0/2294865141 learned_addr learned my addr 172.21.15.22:0/2294865141 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.716+0000 7f383d000640 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee89730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.717+0000 7f3836000640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f38200a3460 0x7f38200a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.717+0000 7f383d000640 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee81ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383da00640 1 -- 172.21.15.22:0/2294865141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 msgr2=0x56084ee89730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383da00640 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee89730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383da00640 1 -- 172.21.15.22:0/2294865141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 msgr2=0x56084ee81ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383da00640 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee81ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383da00640 1 -- 172.21.15.22:0/2294865141 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084eaf1210 con 0x56084ee821e0 2024-09-15T22:39:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383d000640 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee81ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:39:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f3836000640 1 -- 172.21.15.22:0/980723657 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f38300cfd00 con 0x7f3838103710 2024-09-15T22:39:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.718+0000 7f383e400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f38200a3460 0x7f38200a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.719+0000 7f383da00640 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 0x56084ee86ca0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f382c0314e0 tx=0x7f382c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ff5971f4963893 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.719+0000 7f382aa00640 1 -- 172.21.15.22:0/2294865141 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c03e070 con 0x56084ee821e0 2024-09-15T22:39:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.719+0000 7f382aa00640 1 -- 172.21.15.22:0/2294865141 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f382c005530 con 0x56084ee821e0 2024-09-15T22:39:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.719+0000 7f382aa00640 1 -- 172.21.15.22:0/2294865141 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c035040 con 0x56084ee821e0 2024-09-15T22:39:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.720+0000 7f383e400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f38200a3460 0x7f38200a5920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f383001a040 tx=0x7f383000af30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 -- 172.21.15.22:0/2294865141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 msgr2=0x56084ee86ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 0x56084ee86ca0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f382c0314e0 tx=0x7f382c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 -- 172.21.15.22:0/2294865141 shutdown_connections 2024-09-15T22:39:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee89730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee821e0 0x56084ee86ca0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f382c0314e0 tx=0x7f382c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 --2- 172.21.15.22:0/2294865141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee81ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.721+0000 7f38433e9740 1 -- 172.21.15.22:0/2294865141 >> 172.21.15.22:0/2294865141 conn(0x56084ee7cf10 msgr2=0x56084ee7d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.724+0000 7f38433e9740 1 -- 172.21.15.22:0/2294865141 shutdown_connections 2024-09-15T22:39:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.724+0000 7f38433e9740 1 -- 172.21.15.22:0/2294865141 wait complete. 2024-09-15T22:39:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.725+0000 7f38433e9740 1 -- start start 2024-09-15T22:39:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.725+0000 7f38433e9740 1 Processor -- start 2024-09-15T22:39:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.727+0000 7f38433e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f38433e9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f38433e9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084ee93560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f383d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f383da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f383da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:52236/0 (socket says 172.21.15.22:52236) 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f383d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee8bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33658/0 (socket says 172.21.15.22:33658) 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f383da00640 1 -- 172.21.15.22:0/250564846 learned_addr learned my addr 172.21.15.22:0/250564846 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.728+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56084ee8a1e0 con 0x56084ee818a0 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.729+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56084ed67090 con 0x56084ee91170 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.729+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56084ee8a360 con 0x56084ee87270 2024-09-15T22:39:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.729+0000 7f383da00640 1 -- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 msgr2=0x56084ee93560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.729+0000 7f383da00640 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084ee93560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.729+0000 7f383da00640 1 -- 172.21.15.22:0/250564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 msgr2=0x56084ee8bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.729+0000 7f383da00640 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee8bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.730+0000 7f383da00640 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084ebbd620 con 0x56084ee87270 2024-09-15T22:39:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.730+0000 7f383da00640 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8c140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f382c005c40 tx=0x7f382c004bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f12e14384f9cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.731+0000 7f381f400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:39:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.731+0000 7f381f400640 1 -- 172.21.15.22:0/250564846 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c04b020 con 0x56084ee87270 2024-09-15T22:39:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.731+0000 7f381f400640 1 -- 172.21.15.22:0/250564846 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f382c005250 con 0x56084ee87270 2024-09-15T22:39:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.731+0000 7f381f400640 10 client.0 inactive, discarding osd_map(81..81 src has 1..81) 2024-09-15T22:39:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.732+0000 7f38433e9740 10 client.0 _ll_register_callbacks cb 0x56084edbbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.732+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f382c005530 con 0x56084ee87270 2024-09-15T22:39:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.733+0000 7f381f400640 1 -- 172.21.15.22:0/250564846 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f382c03e070 con 0x56084ee87270 2024-09-15T22:39:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.734+0000 7f38433e9740 10 client.25597 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.734+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({fsmap=25}) -- 0x56084ee95ed0 con 0x56084ee87270 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.734+0000 7f381f400640 1 -- 172.21.15.22:0/250564846 <== mon.1 v2:172.21.15.112:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f382c0042d0 con 0x56084ee87270 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f38433e9740 10 client.25597 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f38433e9740 10 client.25597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f38433e9740 20 client.25597 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f38433e9740 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ee973e0 0x56084ee99870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f38433e9740 4 client.25597 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:39:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f382c005530 con 0x56084ee973e0 2024-09-15T22:39:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.735+0000 7f383d000640 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ee973e0 0x56084ee99870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.736+0000 7f383d000640 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ee973e0 0x56084ee99870 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82d63771704ef70 server_cookie=a6857587edbb4950 in_seq=0 out_seq=0 2024-09-15T22:39:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.736+0000 7f381f400640 10 client.25597 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.737+0000 7f381f400640 1 -- 172.21.15.22:0/250564846 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f382c005530 con 0x56084ee973e0 2024-09-15T22:39:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.737+0000 7f381f400640 10 client.25597 handle_command_reply: tid=0 2024-09-15T22:39:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.737+0000 7f38433e9740 1 client.25597 shutdown 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 msgr2=0x56084ee8c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8c140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f382c005c40 tx=0x7f382c004bf0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 shutdown_connections 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ee973e0 0x56084ee99870 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8c140 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084ee93560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 --2- 172.21.15.22:0/250564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee818a0 0x56084ee8bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 >> 172.21.15.22:0/250564846 conn(0x56084ee7cf10 msgr2=0x56084ee7e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f381f400640 0 client.25597 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.738+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 shutdown_connections 2024-09-15T22:39:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.739+0000 7f38433e9740 1 -- 172.21.15.22:0/250564846 wait complete. 2024-09-15T22:39:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.739+0000 7f38433e9740 20 client.25597 trim_cache size 0 max 16384 2024-09-15T22:39:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.761+0000 7f38433e9740 1 Processor -- start 2024-09-15T22:39:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.761+0000 7f38433e9740 1 -- start start 2024-09-15T22:39:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f38433e9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee818a0 0x56084ee6f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f38433e9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f38433e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee91170 0x56084ee8c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f38433e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a9540 con 0x56084ee91170 2024-09-15T22:39:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f38433e9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a6e10 con 0x56084ee818a0 2024-09-15T22:39:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f38433e9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a4c60 con 0x56084ee87270 2024-09-15T22:39:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f383da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f383da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:52242/0 (socket says 172.21.15.22:52242) 2024-09-15T22:39:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f383da00640 1 -- 172.21.15.22:0/2431358294 learned_addr learned my addr 172.21.15.22:0/2431358294 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f383d000640 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee818a0 0x56084ee6f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f383d000640 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee91170 0x56084ee8c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.762+0000 7f383da00640 1 -- 172.21.15.22:0/2431358294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee818a0 msgr2=0x56084ee6f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f383da00640 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee818a0 0x56084ee6f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f383da00640 1 -- 172.21.15.22:0/2431358294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee91170 msgr2=0x56084ee8c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f383da00640 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee91170 0x56084ee8c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f383da00640 1 -- 172.21.15.22:0/2431358294 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084ee8b740 con 0x56084ee87270 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f383da00640 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8bc00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f382c0425b0 tx=0x7f382c047000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fec085c82826448 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f382a000640 1 -- 172.21.15.22:0/2431358294 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c04b030 con 0x56084ee87270 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f382a000640 1 -- 172.21.15.22:0/2431358294 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f382c0049d0 con 0x56084ee87270 2024-09-15T22:39:51.766 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.763+0000 7f382a000640 1 -- 172.21.15.22:0/2431358294 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c035040 con 0x56084ee87270 2024-09-15T22:39:51.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 -- 172.21.15.22:0/2431358294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 msgr2=0x56084ee8bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8bc00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f382c0425b0 tx=0x7f382c047000 comp rx=0 tx=0).stop 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 -- 172.21.15.22:0/2431358294 shutdown_connections 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee87270 0x56084ee8bc00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee91170 0x56084ee8c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 --2- 172.21.15.22:0/2431358294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee818a0 0x56084ee6f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 -- 172.21.15.22:0/2431358294 >> 172.21.15.22:0/2431358294 conn(0x56084ee7cf10 msgr2=0x56084ee83560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 -- 172.21.15.22:0/2431358294 shutdown_connections 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.764+0000 7f38433e9740 1 -- 172.21.15.22:0/2431358294 wait complete. 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.765+0000 7f38433e9740 1 -- start start 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.765+0000 7f38433e9740 1 Processor -- start 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee818a0 0x56084eea8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee87270 0x56084eea9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084eeaa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a52d0 con 0x56084ee87270 2024-09-15T22:39:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a6740 con 0x56084ee91170 2024-09-15T22:39:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a59a0 con 0x56084ee818a0 2024-09-15T22:39:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f38433e9740 10 client.0 _ll_register_callbacks cb 0x7f3824009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:39:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f383d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084eeaa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f383d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084eeaa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53460/0 (socket says 172.21.15.22:53460) 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.766+0000 7f383d000640 1 -- 172.21.15.22:0/1836620411 learned_addr learned my addr 172.21.15.22:0/1836620411 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383d000640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee818a0 0x56084eea8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383da00640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee87270 0x56084eea9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383d000640 1 -- 172.21.15.22:0/1836620411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee818a0 msgr2=0x56084eea8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383d000640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee818a0 0x56084eea8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383d000640 1 -- 172.21.15.22:0/1836620411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee87270 msgr2=0x56084eea9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383d000640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee87270 0x56084eea9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.767+0000 7f383d000640 1 -- 172.21.15.22:0/1836620411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084eeaa920 con 0x56084ee91170 2024-09-15T22:39:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.768+0000 7f383d000640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084eeaa310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3824005820 tx=0x7f3824009370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2080c6374ce890 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.768+0000 7f381f400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:39:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.769+0000 7f381f400640 1 -- 172.21.15.22:0/1836620411 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824004030 con 0x56084ee91170 2024-09-15T22:39:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.769+0000 7f381f400640 1 -- 172.21.15.22:0/1836620411 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f38240041d0 con 0x56084ee91170 2024-09-15T22:39:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.769+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f382c0049d0 con 0x56084ee91170 2024-09-15T22:39:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.769+0000 7f381f400640 1 -- 172.21.15.22:0/1836620411 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f382402f050 con 0x56084ee91170 2024-09-15T22:39:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.770+0000 7f38433e9740 10 client.25580 fetch_fsmap learned FSMap version 25 2024-09-15T22:39:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.770+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56084ef02040 con 0x56084ee91170 2024-09-15T22:39:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.770+0000 7f381f400640 1 -- 172.21.15.22:0/1836620411 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f382c0049d0 con 0x56084ee91170 2024-09-15T22:39:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.771+0000 7f381f400640 1 -- 172.21.15.22:0/1836620411 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38240039c0 con 0x56084ee91170 2024-09-15T22:39:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.771+0000 7f38433e9740 10 client.25580 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:39:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.771+0000 7f38433e9740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:39:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.771+0000 7f38433e9740 20 client.25580 populate_metadata read hostname 'smithi022' 2024-09-15T22:39:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.771+0000 7f38433e9740 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ef02940 0x56084ef04d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.772+0000 7f38433e9740 4 client.25580 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:39:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.772+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56084edeb830 con 0x56084ef02940 2024-09-15T22:39:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.772+0000 7f383da00640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ef02940 0x56084ef04d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.773+0000 7f383da00640 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ef02940 0x56084ef04d30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87a73e12cb1dbf89 server_cookie=5701bf7f0b80b78e in_seq=0 out_seq=0 2024-09-15T22:39:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.774+0000 7f381f400640 10 client.25580 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.792+0000 7f381f400640 1 -- 172.21.15.22:0/1836620411 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56084edeb830 con 0x56084ef02940 2024-09-15T22:39:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.792+0000 7f381f400640 10 client.25580 handle_command_reply: tid=0 2024-09-15T22:39:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.792+0000 7f38433e9740 1 client.25580 shutdown 2024-09-15T22:39:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.792+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 msgr2=0x56084eeaa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084eeaa310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3824005820 tx=0x7f3824009370 comp rx=0 tx=0).stop 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 shutdown_connections 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x56084ef02940 0x56084ef04d30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56084ee91170 0x56084eeaa310 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f381f400640 0 client.25580 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56084ee87270 0x56084eea9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 --2- 172.21.15.22:0/1836620411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084ee818a0 0x56084eea8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.793+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 >> 172.21.15.22:0/1836620411 conn(0x56084ee7cf10 msgr2=0x56084ee73060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.794+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 shutdown_connections 2024-09-15T22:39:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.794+0000 7f38433e9740 1 -- 172.21.15.22:0/1836620411 wait complete. 2024-09-15T22:39:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.795+0000 7f38433e9740 20 client.25580 trim_cache size 0 max 16384 2024-09-15T22:39:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:39:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:39:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:39:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:39:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.798+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f38200a3460 msgr2=0x7f38200a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.798+0000 7f3840400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f38200a3460 0x7f38200a5920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f383001a040 tx=0x7f383000af30 comp rx=0 tx=0).stop 2024-09-15T22:39:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.798+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 msgr2=0x7f3838074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.798+0000 7f3840400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 0x7f3838074b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f383000cce0 tx=0x7f383000a620 comp rx=0 tx=0).stop 2024-09-15T22:39:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.800+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 shutdown_connections 2024-09-15T22:39:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.800+0000 7f3840400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3838103710 0x7f3838074b20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.800+0000 7f3840400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f38200a3460 0x7f38200a5920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.800+0000 7f3840400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3838102d50 0x7f38380745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.800+0000 7f3840400640 1 --2- 172.21.15.22:0/980723657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3838101b60 0x7f3838075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.800+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 >> 172.21.15.22:0/980723657 conn(0x7f38380fd2e0 msgr2=0x7f3838106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.801+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 shutdown_connections 2024-09-15T22:39:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:39:51.801+0000 7f3840400640 1 -- 172.21.15.22:0/980723657 wait complete. 2024-09-15T22:39:51.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:51 smithi110 ceph-mon[35282]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 887 op/s 2024-09-15T22:39:52.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:51 smithi022 ceph-mon[30634]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 887 op/s 2024-09-15T22:39:52.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:51 smithi112 ceph-mon[35032]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 255 MiB/s wr, 887 op/s 2024-09-15T22:39:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:53 smithi110 ceph-mon[35282]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 270 MiB/s wr, 945 op/s 2024-09-15T22:39:53.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:53 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:54.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:53 smithi022 ceph-mon[30634]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 270 MiB/s wr, 945 op/s 2024-09-15T22:39:54.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:53 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:54.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:53 smithi112 ceph-mon[35032]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 270 MiB/s wr, 945 op/s 2024-09-15T22:39:54.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:53 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:54 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:54 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:54 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:56.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 268 MiB/s wr, 928 op/s 2024-09-15T22:39:56.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi110 to 176.0M 2024-09-15T22:39:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T22:39:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: Unable to set osd_memory_target on smithi110 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-15T22:39:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: Unable to set osd_memory_target on smithi112 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:39:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:55 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 268 MiB/s wr, 928 op/s 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi110 to 176.0M 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: Unable to set osd_memory_target on smithi110 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: Unable to set osd_memory_target on smithi112 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:56.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:55 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:39:56.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 268 MiB/s wr, 928 op/s 2024-09-15T22:39:56.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi110 to 176.0M 2024-09-15T22:39:56.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T22:39:56.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: Unable to set osd_memory_target on smithi110 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-15T22:39:56.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: Unable to set osd_memory_target on smithi112 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:39:56.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:56.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:56.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:55 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:39:57.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:56 smithi112 ceph-mon[35032]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 252 MiB/s wr, 883 op/s 2024-09-15T22:39:57.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:56 smithi110 ceph-mon[35282]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 252 MiB/s wr, 883 op/s 2024-09-15T22:39:57.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:56 smithi022 ceph-mon[30634]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 252 MiB/s wr, 883 op/s 2024-09-15T22:39:59.208 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:39:58 smithi110 ceph-mon[35282]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 933 op/s 2024-09-15T22:39:59.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:39:58 smithi022 ceph-mon[30634]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 933 op/s 2024-09-15T22:39:59.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:39:58 smithi112 ceph-mon[35032]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 933 op/s 2024-09-15T22:40:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:00 smithi110 ceph-mon[35282]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 247 MiB/s wr, 866 op/s 2024-09-15T22:40:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:00 smithi110 ceph-mon[35282]: overall HEALTH_OK 2024-09-15T22:40:01.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:00 smithi022 ceph-mon[30634]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 247 MiB/s wr, 866 op/s 2024-09-15T22:40:01.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:00 smithi022 ceph-mon[30634]: overall HEALTH_OK 2024-09-15T22:40:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:00 smithi112 ceph-mon[35032]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 247 MiB/s wr, 866 op/s 2024-09-15T22:40:01.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:00 smithi112 ceph-mon[35032]: overall HEALTH_OK 2024-09-15T22:40:03.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:02 smithi110 ceph-mon[35282]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 266 MiB/s wr, 939 op/s 2024-09-15T22:40:03.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:02 smithi022 ceph-mon[30634]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 266 MiB/s wr, 939 op/s 2024-09-15T22:40:03.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:02 smithi112 ceph-mon[35032]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 266 MiB/s wr, 939 op/s 2024-09-15T22:40:05.013 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.011+0000 7ff567200640 1 -- 172.21.15.22:0/1938436420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 msgr2=0x7ff56810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.011+0000 7ff567200640 1 --2- 172.21.15.22:0/1938436420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff56810bfb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff560009ca0 tx=0x7ff56002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.012+0000 7ff567200640 1 -- 172.21.15.22:0/1938436420 shutdown_connections 2024-09-15T22:40:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.012+0000 7ff567200640 1 --2- 172.21.15.22:0/1938436420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff56810bfb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.012+0000 7ff567200640 1 --2- 172.21.15.22:0/1938436420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff568104d60 0x7ff5681051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.012+0000 7ff567200640 1 --2- 172.21.15.22:0/1938436420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.012+0000 7ff567200640 1 -- 172.21.15.22:0/1938436420 >> 172.21.15.22:0/1938436420 conn(0x7ff5680ff2f0 msgr2=0x7ff568101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:05.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.014+0000 7ff567200640 1 -- 172.21.15.22:0/1938436420 shutdown_connections 2024-09-15T22:40:05.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.014+0000 7ff567200640 1 -- 172.21.15.22:0/1938436420 wait complete. 2024-09-15T22:40:05.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.016+0000 7ff567200640 1 Processor -- start 2024-09-15T22:40:05.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.016+0000 7ff567200640 1 -- start start 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff567200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff567200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff568104d60 0x7ff568071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff567200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff5681a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff565e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff566800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff5681a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff565e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38716/0 (socket says 172.21.15.22:38716) 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff566800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff5681a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:43602/0 (socket says 172.21.15.22:43602) 2024-09-15T22:40:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff565e00640 1 -- 172.21.15.22:0/905960620 learned_addr learned my addr 172.21.15.22:0/905960620 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff56810f870 con 0x7ff568104d60 2024-09-15T22:40:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff56810f6f0 con 0x7ff568103b70 2024-09-15T22:40:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.017+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff56810f9f0 con 0x7ff568105720 2024-09-15T22:40:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.018+0000 7ff565400640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff568104d60 0x7ff568071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.019+0000 7ff565e00640 1 -- 172.21.15.22:0/905960620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 msgr2=0x7ff5681a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.019+0000 7ff565e00640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff5681a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.019+0000 7ff565e00640 1 -- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff568104d60 msgr2=0x7ff568071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.019+0000 7ff565e00640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff568104d60 0x7ff568071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.019+0000 7ff565e00640 1 -- 172.21.15.22:0/905960620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff568071730 con 0x7ff568103b70 2024-09-15T22:40:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.020+0000 7ff565e00640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568070b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff55800b450 tx=0x7ff55800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.020+0000 7ff55ea00640 1 -- 172.21.15.22:0/905960620 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558015020 con 0x7ff568103b70 2024-09-15T22:40:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.020+0000 7ff55ea00640 1 -- 172.21.15.22:0/905960620 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff558011d70 con 0x7ff568103b70 2024-09-15T22:40:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.020+0000 7ff55ea00640 1 -- 172.21.15.22:0/905960620 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55800f340 con 0x7ff568103b70 2024-09-15T22:40:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.021+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5681aa5e0 con 0x7ff568103b70 2024-09-15T22:40:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.021+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5681aab30 con 0x7ff568103b70 2024-09-15T22:40:05.027 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.027+0000 7ff56fc95740 1 Processor -- start 2024-09-15T22:40:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.027+0000 7ff56fc95740 1 -- start start 2024-09-15T22:40:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.027+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c34660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34ba0 0x561105c39660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c39c30 0x561105c3c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff56fc95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561105b99100 con 0x561105c34260 2024-09-15T22:40:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff56fc95740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561105b411b0 con 0x561105c39c30 2024-09-15T22:40:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff56fc95740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561105b950c0 con 0x561105c34ba0 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff566800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c34660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff566800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c34660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53986/0 (socket says 172.21.15.22:53986) 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff566800640 1 -- 172.21.15.22:0/2707610311 learned_addr learned my addr 172.21.15.22:0/2707610311 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff565400640 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c39c30 0x561105c3c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.029+0000 7ff565e00640 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34ba0 0x561105c39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff566800640 1 -- 172.21.15.22:0/2707610311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34ba0 msgr2=0x561105c39660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.031 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff566800640 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34ba0 0x561105c39660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff566800640 1 -- 172.21.15.22:0/2707610311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c39c30 msgr2=0x561105c3c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff566800640 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c39c30 0x561105c3c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff566800640 1 -- 172.21.15.22:0/2707610311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611058ac210 con 0x561105c34260 2024-09-15T22:40:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff55ea00640 1 -- 172.21.15.22:0/905960620 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff558018020 con 0x7ff568103b70 2024-09-15T22:40:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.030+0000 7ff566800640 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c34660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff560035000 tx=0x7ff560009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5660b13672a37c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.031+0000 7ff553400640 1 -- 172.21.15.22:0/2707610311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560031710 con 0x561105c34260 2024-09-15T22:40:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.031+0000 7ff553400640 1 -- 172.21.15.22:0/2707610311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff560036040 con 0x561105c34260 2024-09-15T22:40:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.031+0000 7ff553400640 1 -- 172.21.15.22:0/2707610311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56002f610 con 0x561105c34260 2024-09-15T22:40:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.032+0000 7ff55ea00640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff54c0a3380 0x7ff54c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.032+0000 7ff56fc95740 1 -- 172.21.15.22:0/2707610311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 msgr2=0x561105c34660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.032+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c34660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff560035000 tx=0x7ff560009890 comp rx=0 tx=0).stop 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff55ea00640 1 -- 172.21.15.22:0/905960620 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff5580cf1d0 con 0x7ff568103b70 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff565e00640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff54c0a3380 0x7ff54c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff56fc95740 1 -- 172.21.15.22:0/2707610311 shutdown_connections 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34ba0 0x561105c39660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c39c30 0x561105c3c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2707610311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c34660 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.033+0000 7ff56fc95740 1 -- 172.21.15.22:0/2707610311 >> 172.21.15.22:0/2707610311 conn(0x561105c2f8d0 msgr2=0x561105c2fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.034+0000 7ff56fc95740 1 -- 172.21.15.22:0/2707610311 shutdown_connections 2024-09-15T22:40:05.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.035+0000 7ff56fc95740 1 -- 172.21.15.22:0/2707610311 wait complete. 2024-09-15T22:40:05.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.035+0000 7ff565e00640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff54c0a3380 0x7ff54c0a5840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff558000c00 tx=0x7ff5580047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:05.036 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.036+0000 7ff56fc95740 1 -- start start 2024-09-15T22:40:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.036+0000 7ff56fc95740 1 Processor -- start 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.036+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c3e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.037+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c3e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.037+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c45930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.037+0000 7ff56fc95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561105c3cba0 con 0x561105c34260 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.037+0000 7ff56fc95740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561105b22090 con 0x561105c34ba0 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.037+0000 7ff56fc95740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561105c3cd20 con 0x561105c39c30 2024-09-15T22:40:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.037+0000 7ff56fc95740 10 client.0 _ll_register_callbacks cb 0x561105b76f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:05.040 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.038+0000 7ff566800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c45930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.041 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.038+0000 7ff566800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c3e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.041 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.038+0000 7ff566800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c3e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54002/0 (socket says 172.21.15.22:54002) 2024-09-15T22:40:05.041 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.038+0000 7ff566800640 1 -- 172.21.15.22:0/2480200072 learned_addr learned my addr 172.21.15.22:0/2480200072 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.041+0000 7ff566800640 1 -- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 msgr2=0x561105c3e8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:40:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.041+0000 7ff566800640 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c3e8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.041+0000 7ff566800640 1 -- 172.21.15.22:0/2480200072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 msgr2=0x561105c3e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.041+0000 7ff566800640 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c3e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.042+0000 7ff566800640 1 -- 172.21.15.22:0/2480200072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561105978620 con 0x561105c39c30 2024-09-15T22:40:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.061+0000 7ff566800640 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c45930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff560009ca0 tx=0x7ff56003e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2653ce8bf837d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.061+0000 7ff547e00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:40:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.063+0000 7ff547e00640 1 -- 172.21.15.22:0/2480200072 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56004a040 con 0x561105c39c30 2024-09-15T22:40:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.063+0000 7ff547e00640 1 -- 172.21.15.22:0/2480200072 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff560003970 con 0x561105c39c30 2024-09-15T22:40:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.070+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff560036040 con 0x561105c39c30 2024-09-15T22:40:05.074 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.073+0000 7ff547e00640 1 -- 172.21.15.22:0/2480200072 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff560004b40 con 0x561105c39c30 2024-09-15T22:40:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.085+0000 7ff56fc95740 10 client.25615 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.085+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561105c3cba0 con 0x561105c39c30 2024-09-15T22:40:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.089+0000 7ff547e00640 1 -- 172.21.15.22:0/2480200072 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff560036040 con 0x561105c39c30 2024-09-15T22:40:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.090+0000 7ff547e00640 1 -- 172.21.15.22:0/2480200072 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff56002f990 con 0x561105c39c30 2024-09-15T22:40:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.091+0000 7ff56fc95740 10 client.25615 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.092+0000 7ff56fc95740 10 client.25615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.092+0000 7ff56fc95740 20 client.25615 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.092+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105c499d0 0x561105c4bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.092+0000 7ff56fc95740 4 client.25615 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:40:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.092+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561105ba6830 con 0x561105c499d0 2024-09-15T22:40:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.093+0000 7ff565400640 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105c499d0 0x561105c4bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.094+0000 7ff565400640 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105c499d0 0x561105c4bdc0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9691cbb92166f477 server_cookie=88d42fa2a1b8445e in_seq=0 out_seq=0 2024-09-15T22:40:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.094+0000 7ff547e00640 10 client.25615 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.095+0000 7ff547e00640 1 -- 172.21.15.22:0/2480200072 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561105ba6830 con 0x561105c499d0 2024-09-15T22:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.095+0000 7ff547e00640 10 client.25615 handle_command_reply: tid=0 2024-09-15T22:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.095+0000 7ff56fc95740 1 client.25615 shutdown 2024-09-15T22:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.096+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 msgr2=0x561105c45930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.096+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c45930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff560009ca0 tx=0x7ff56003e040 comp rx=0 tx=0).stop 2024-09-15T22:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 shutdown_connections 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105c499d0 0x561105c4bdc0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c45930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c3e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 --2- 172.21.15.22:0/2480200072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c3e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 >> 172.21.15.22:0/2480200072 conn(0x561105c2f8d0 msgr2=0x561105c310e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff547e00640 0 client.25615 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 shutdown_connections 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 1 -- 172.21.15.22:0/2480200072 wait complete. 2024-09-15T22:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.097+0000 7ff56fc95740 20 client.25615 trim_cache size 0 max 16384 2024-09-15T22:40:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 Processor -- start 2024-09-15T22:40:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 -- start start 2024-09-15T22:40:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34260 0x561105c2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c2ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c39c30 0x561105c45850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681b6270 con 0x561105c39c30 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681b3b40 con 0x561105c34ba0 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.117+0000 7ff56fc95740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681b19d0 con 0x561105c34260 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c2ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c2ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38744/0 (socket says 172.21.15.22:38744) 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 -- 172.21.15.22:0/279520502 learned_addr learned my addr 172.21.15.22:0/279520502 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff566800640 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34260 0x561105c2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff566800640 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c39c30 0x561105c45850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 -- 172.21.15.22:0/279520502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34260 msgr2=0x561105c2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34260 0x561105c2e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 -- 172.21.15.22:0/279520502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c39c30 msgr2=0x561105c45850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c39c30 0x561105c45850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 -- 172.21.15.22:0/279520502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561105c2f6f0 con 0x561105c34ba0 2024-09-15T22:40:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff566800640 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c39c30 0x561105c45850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:40:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.118+0000 7ff565400640 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c2ee40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff554010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec8a503f2721691 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.119+0000 7ff552a00640 1 -- 172.21.15.22:0/279520502 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554004050 con 0x561105c34ba0 2024-09-15T22:40:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.119+0000 7ff552a00640 1 -- 172.21.15.22:0/279520502 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5540041f0 con 0x561105c34ba0 2024-09-15T22:40:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.119+0000 7ff552a00640 1 -- 172.21.15.22:0/279520502 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55401c710 con 0x561105c34ba0 2024-09-15T22:40:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.119+0000 7ff56fc95740 1 -- 172.21.15.22:0/279520502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 msgr2=0x561105c2ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.119+0000 7ff56fc95740 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c2ee40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff554010800 comp rx=0 tx=0).stop 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 -- 172.21.15.22:0/279520502 shutdown_connections 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c39c30 0x561105c45850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c2ee40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 --2- 172.21.15.22:0/279520502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c34260 0x561105c2e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 -- 172.21.15.22:0/279520502 >> 172.21.15.22:0/279520502 conn(0x561105c2f8d0 msgr2=0x561105c2e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 -- 172.21.15.22:0/279520502 shutdown_connections 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 -- 172.21.15.22:0/279520502 wait complete. 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 -- start start 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.120+0000 7ff56fc95740 1 Processor -- start 2024-09-15T22:40:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c42d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c43240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c44250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681b2030 con 0x561105c34260 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681b3470 con 0x561105c34ba0 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681b26d0 con 0x561105c39c30 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff56fc95740 10 client.0 _ll_register_callbacks cb 0x7ff5540097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff566800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c42d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff566800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c42d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54018/0 (socket says 172.21.15.22:54018) 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff566800640 1 -- 172.21.15.22:0/1556128154 learned_addr learned my addr 172.21.15.22:0/1556128154 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff565400640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c43240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.121+0000 7ff566800640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c44250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff565400640 1 -- 172.21.15.22:0/1556128154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 msgr2=0x561105c44250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff565400640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c44250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff565400640 1 -- 172.21.15.22:0/1556128154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 msgr2=0x561105c42d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff565400640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c42d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff565400640 1 -- 172.21.15.22:0/1556128154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561105c44860 con 0x561105c34ba0 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff566800640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c42d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff565400640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c43240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x561105b99190 tx=0x7ff554005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bab9ed6320a727 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.122+0000 7ff547e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:40:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.123+0000 7ff547e00640 1 -- 172.21.15.22:0/1556128154 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55402d070 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.123+0000 7ff547e00640 1 -- 172.21.15.22:0/1556128154 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff5540037f0 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.123+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5540041f0 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.123+0000 7ff547e00640 1 -- 172.21.15.22:0/1556128154 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff554039050 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.124+0000 7ff56fc95740 10 client.25592 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.124+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561105c45ae0 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.124+0000 7ff547e00640 1 -- 172.21.15.22:0/1556128154 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5540041f0 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.124+0000 7ff547e00640 1 -- 172.21.15.22:0/1556128154 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff55401cc10 con 0x561105c34ba0 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.124+0000 7ff56fc95740 10 client.25592 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.125+0000 7ff56fc95740 10 client.25592 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.125+0000 7ff56fc95740 20 client.25592 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.125+0000 7ff56fc95740 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105cb4c10 0x561105cb7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.125+0000 7ff56fc95740 4 client.25592 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:40:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.125+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561105ba0b80 con 0x561105cb4c10 2024-09-15T22:40:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.125+0000 7ff566800640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105cb4c10 0x561105cb7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.126+0000 7ff566800640 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105cb4c10 0x561105cb7030 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae06d859ceb97f5 server_cookie=c2ed678e54a0f17b in_seq=0 out_seq=0 2024-09-15T22:40:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.126+0000 7ff547e00640 10 client.25592 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.190+0000 7ff547e00640 1 -- 172.21.15.22:0/1556128154 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561105ba0b80 con 0x561105cb4c10 2024-09-15T22:40:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.190+0000 7ff547e00640 10 client.25592 handle_command_reply: tid=0 2024-09-15T22:40:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.190+0000 7ff56fc95740 1 client.25592 shutdown 2024-09-15T22:40:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.190+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 msgr2=0x561105c43240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.190+0000 7ff56fc95740 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c43240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x561105b99190 tx=0x7ff554005830 comp rx=0 tx=0).stop 2024-09-15T22:40:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.191+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 shutdown_connections 2024-09-15T22:40:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.191+0000 7ff56fc95740 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x561105cb4c10 0x561105cb7030 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.191+0000 7ff56fc95740 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561105c39c30 0x561105c44250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.191+0000 7ff56fc95740 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561105c34ba0 0x561105c43240 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.191+0000 7ff56fc95740 1 --2- 172.21.15.22:0/1556128154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561105c34260 0x561105c42d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.191+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 >> 172.21.15.22:0/1556128154 conn(0x561105c2f8d0 msgr2=0x561105c2ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.194+0000 7ff547e00640 0 client.25592 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.194+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 shutdown_connections 2024-09-15T22:40:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.195+0000 7ff56fc95740 1 -- 172.21.15.22:0/1556128154 wait complete. 2024-09-15T22:40:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.195+0000 7ff56fc95740 20 client.25592 trim_cache size 0 max 16384 2024-09-15T22:40:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:40:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:40:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:40:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:40:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff54c0a3380 msgr2=0x7ff54c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff54c0a3380 0x7ff54c0a5840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff558000c00 tx=0x7ff5580047d0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 msgr2=0x7ff568070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568070b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff55800b450 tx=0x7ff55800b910 comp rx=0 tx=0).stop 2024-09-15T22:40:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 shutdown_connections 2024-09-15T22:40:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff568105720 0x7ff5681a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff54c0a3380 0x7ff54c0a5840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff568104d60 0x7ff568071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 --2- 172.21.15.22:0/905960620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff568103b70 0x7ff568070b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 >> 172.21.15.22:0/905960620 conn(0x7ff5680ff2f0 msgr2=0x7ff5681080d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.196+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 shutdown_connections 2024-09-15T22:40:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:05.197+0000 7ff567200640 1 -- 172.21.15.22:0/905960620 wait complete. 2024-09-15T22:40:05.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:04 smithi110 ceph-mon[35282]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 260 MiB/s wr, 910 op/s 2024-09-15T22:40:05.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:04 smithi022 ceph-mon[30634]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 260 MiB/s wr, 910 op/s 2024-09-15T22:40:05.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:04 smithi112 ceph-mon[35032]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 260 MiB/s wr, 910 op/s 2024-09-15T22:40:07.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:06 smithi110 ceph-mon[35282]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 248 MiB/s wr, 871 op/s 2024-09-15T22:40:07.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:06 smithi022 ceph-mon[30634]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 248 MiB/s wr, 871 op/s 2024-09-15T22:40:07.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:06 smithi112 ceph-mon[35032]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 248 MiB/s wr, 871 op/s 2024-09-15T22:40:09.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:08 smithi110 ceph-mon[35282]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 266 MiB/s wr, 932 op/s 2024-09-15T22:40:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:08 smithi022 ceph-mon[30634]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 266 MiB/s wr, 932 op/s 2024-09-15T22:40:09.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:08 smithi112 ceph-mon[35032]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 266 MiB/s wr, 932 op/s 2024-09-15T22:40:11.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:10 smithi110 ceph-mon[35282]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 253 MiB/s wr, 889 op/s 2024-09-15T22:40:11.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:10 smithi022 ceph-mon[30634]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 253 MiB/s wr, 889 op/s 2024-09-15T22:40:11.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:10 smithi112 ceph-mon[35032]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 253 MiB/s wr, 889 op/s 2024-09-15T22:40:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:12 smithi022 ceph-mon[30634]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 268 MiB/s wr, 940 op/s 2024-09-15T22:40:13.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:12 smithi112 ceph-mon[35032]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 268 MiB/s wr, 940 op/s 2024-09-15T22:40:13.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:12 smithi110 ceph-mon[35282]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 268 MiB/s wr, 940 op/s 2024-09-15T22:40:15.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:14 smithi022 ceph-mon[30634]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 908 op/s 2024-09-15T22:40:15.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:14 smithi112 ceph-mon[35032]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 908 op/s 2024-09-15T22:40:15.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:14 smithi110 ceph-mon[35282]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 259 MiB/s wr, 908 op/s 2024-09-15T22:40:17.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:16 smithi022 ceph-mon[30634]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 253 MiB/s wr, 900 op/s 2024-09-15T22:40:17.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:16 smithi112 ceph-mon[35032]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 253 MiB/s wr, 900 op/s 2024-09-15T22:40:17.389 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:16 smithi110 ceph-mon[35282]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 253 MiB/s wr, 900 op/s 2024-09-15T22:40:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.396+0000 7f470b400640 1 -- 172.21.15.22:0/2155881573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704104f00 msgr2=0x7f47041072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.397+0000 7f470b400640 1 --2- 172.21.15.22:0/2155881573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704104f00 0x7f47041072f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009900 tx=0x7f46f002a400 comp rx=0 tx=0).stop 2024-09-15T22:40:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.397+0000 7f470b400640 1 -- 172.21.15.22:0/2155881573 shutdown_connections 2024-09-15T22:40:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.397+0000 7f470b400640 1 --2- 172.21.15.22:0/2155881573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4704107830 0x7f4704109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.397+0000 7f470b400640 1 --2- 172.21.15.22:0/2155881573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704104f00 0x7f47041072f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.397+0000 7f470b400640 1 --2- 172.21.15.22:0/2155881573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47041025d0 0x7f47041049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.398+0000 7f470b400640 1 -- 172.21.15.22:0/2155881573 >> 172.21.15.22:0/2155881573 conn(0x7f47040fc1b0 msgr2=0x7f47040fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.402+0000 7f470b400640 1 -- 172.21.15.22:0/2155881573 shutdown_connections 2024-09-15T22:40:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.404+0000 7f470b400640 1 -- 172.21.15.22:0/2155881573 wait complete. 2024-09-15T22:40:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.413+0000 7f470b400640 1 Processor -- start 2024-09-15T22:40:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.414+0000 7f470b400640 1 -- start start 2024-09-15T22:40:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.415+0000 7f470b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47041025d0 0x7f4704070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.415+0000 7f470b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 0x7f4704071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f470b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704107830 0x7f47041a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f470b400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f470410d830 con 0x7f47041025d0 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f470b400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f470410d6b0 con 0x7f4704107830 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f470b400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f470410d9b0 con 0x7f4704104f00 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f4703e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 0x7f4704071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f4703e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 0x7f4704071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33498/0 (socket says 172.21.15.22:33498) 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.416+0000 7f4703e00640 1 -- 172.21.15.22:0/2725890134 learned_addr learned my addr 172.21.15.22:0/2725890134 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.417+0000 7f4703e00640 1 -- 172.21.15.22:0/2725890134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704107830 msgr2=0x7f47041a7f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.417+0000 7f4703e00640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704107830 0x7f47041a7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.417+0000 7f4703e00640 1 -- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47041025d0 msgr2=0x7f4704070b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:40:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.417+0000 7f4703e00640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47041025d0 0x7f4704070b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.417+0000 7f4703e00640 1 -- 172.21.15.22:0/2725890134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47040741d0 con 0x7f4704104f00 2024-09-15T22:40:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.418+0000 7f4703e00640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 0x7f4704071050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46f0031440 tx=0x7f46f003cd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.419+0000 7f4701600640 1 -- 172.21.15.22:0/2725890134 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0035030 con 0x7f4704104f00 2024-09-15T22:40:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.420+0000 7f4701600640 1 -- 172.21.15.22:0/2725890134 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f00035f0 con 0x7f4704104f00 2024-09-15T22:40:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.420+0000 7f4701600640 1 -- 172.21.15.22:0/2725890134 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00446d0 con 0x7f4704104f00 2024-09-15T22:40:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.420+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47041003c0 con 0x7f4704104f00 2024-09-15T22:40:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.420+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4704100860 con 0x7f4704104f00 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.426+0000 7f470e232740 1 Processor -- start 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.426+0000 7f470e232740 1 -- start start 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f470e232740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8aa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f470e232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f470e232740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f470e232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b59d80f100 con 0x55b59d8aa9d0 2024-09-15T22:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f470e232740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b59d7b71b0 con 0x55b59d8aa090 2024-09-15T22:40:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f470e232740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b59d80b0c0 con 0x55b59d8afa60 2024-09-15T22:40:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f4709400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f4709400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:34006/0 (socket says 172.21.15.22:34006) 2024-09-15T22:40:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.427+0000 7f4708a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.428+0000 7f4709400640 1 -- 172.21.15.22:0/267549427 learned_addr learned my addr 172.21.15.22:0/267549427 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.428+0000 7f4701600640 1 -- 172.21.15.22:0/2725890134 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f46f00037a0 con 0x7f4704104f00 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.428+0000 7f4703e00640 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.429+0000 7f4708a00640 1 -- 172.21.15.22:0/267549427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 msgr2=0x55b59d8b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.429+0000 7f4708a00640 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.429+0000 7f4708a00640 1 -- 172.21.15.22:0/267549427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 msgr2=0x55b59d8aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.429+0000 7f4708a00640 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.429+0000 7f4708a00640 1 -- 172.21.15.22:0/267549427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59d522210 con 0x55b59d8aa9d0 2024-09-15T22:40:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.429+0000 7f4708a00640 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8af490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009ad0 tx=0x7f46f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10113bb7768a7bad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.430+0000 7f46f5c00640 1 -- 172.21.15.22:0/267549427 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f800ed10 con 0x55b59d8aa9d0 2024-09-15T22:40:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.430+0000 7f46f5c00640 1 -- 172.21.15.22:0/267549427 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f8005020 con 0x55b59d8aa9d0 2024-09-15T22:40:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.430+0000 7f46f5c00640 1 -- 172.21.15.22:0/267549427 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8004b40 con 0x55b59d8aa9d0 2024-09-15T22:40:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.431+0000 7f470e232740 1 -- 172.21.15.22:0/267549427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 msgr2=0x55b59d8af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.431+0000 7f470e232740 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8af490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009ad0 tx=0x7f46f8009f90 comp rx=0 tx=0).stop 2024-09-15T22:40:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.431+0000 7f4701600640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f46ec0a3460 0x7f46ec0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f4701600640 1 -- 172.21.15.22:0/2725890134 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f46f00f4210 con 0x7f4704104f00 2024-09-15T22:40:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 -- 172.21.15.22:0/267549427 shutdown_connections 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8af490 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 --2- 172.21.15.22:0/267549427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 -- 172.21.15.22:0/267549427 >> 172.21.15.22:0/267549427 conn(0x55b59d8a5700 msgr2=0x55b59d8a5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f4709400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f46ec0a3460 0x7f46ec0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 -- 172.21.15.22:0/267549427 shutdown_connections 2024-09-15T22:40:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.432+0000 7f470e232740 1 -- 172.21.15.22:0/267549427 wait complete. 2024-09-15T22:40:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.433+0000 7f470e232740 1 -- start start 2024-09-15T22:40:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.433+0000 7f470e232740 1 Processor -- start 2024-09-15T22:40:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f4709400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f46ec0a3460 0x7f46ec0a5920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005fd0 tx=0x7f46fc0094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b59d8b2a30 con 0x55b59d8aa9d0 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b59d798090 con 0x55b59d8aa090 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b59d8b2bb0 con 0x55b59d8afa60 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f470e232740 10 client.0 _ll_register_callbacks cb 0x55b59d7ecf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f4708a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f4708a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:34020/0 (socket says 172.21.15.22:34020) 2024-09-15T22:40:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.434+0000 7f4708a00640 1 -- 172.21.15.22:0/2508314068 learned_addr learned my addr 172.21.15.22:0/2508314068 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4709400640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4703e00640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4708a00640 1 -- 172.21.15.22:0/2508314068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 msgr2=0x55b59d8bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4708a00640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4708a00640 1 -- 172.21.15.22:0/2508314068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 msgr2=0x55b59d8b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4708a00640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.435+0000 7f4708a00640 1 -- 172.21.15.22:0/2508314068 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59d5ee620 con 0x55b59d8aa090 2024-09-15T22:40:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.436+0000 7f4708a00640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8b4270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46f8005790 tx=0x7f46f8005540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b30cc3074ad4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.436+0000 7f46ea000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:40:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.436+0000 7f46ea000640 1 -- 172.21.15.22:0/2508314068 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8004d50 con 0x55b59d8aa090 2024-09-15T22:40:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.436+0000 7f46ea000640 1 -- 172.21.15.22:0/2508314068 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f46f8018470 con 0x55b59d8aa090 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.437+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f8005020 con 0x55b59d8aa090 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.437+0000 7f46ea000640 1 -- 172.21.15.22:0/2508314068 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46f8018670 con 0x55b59d8aa090 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.437+0000 7f470e232740 10 client.25601 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.437+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b59d8be5e0 con 0x55b59d8aa090 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.437+0000 7f46ea000640 1 -- 172.21.15.22:0/2508314068 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f8005020 con 0x55b59d8aa090 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.437+0000 7f46ea000640 1 -- 172.21.15.22:0/2508314068 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46f8024840 con 0x55b59d8aa090 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f470e232740 10 client.25601 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f470e232740 10 client.25601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f470e232740 20 client.25601 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f470e232740 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d8bfae0 0x55b59d8c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f470e232740 4 client.25601 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:40:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b59d81c830 con 0x55b59d8bfae0 2024-09-15T22:40:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.438+0000 7f4703e00640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d8bfae0 0x55b59d8c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.439+0000 7f46ea000640 10 client.25601 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.439+0000 7f4703e00640 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d8bfae0 0x55b59d8c1ed0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=142fb9ae41d04e4d server_cookie=fa3253e6937f06e7 in_seq=0 out_seq=0 2024-09-15T22:40:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f46ea000640 1 -- 172.21.15.22:0/2508314068 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b59d81c830 con 0x55b59d8bfae0 2024-09-15T22:40:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f46ea000640 10 client.25601 handle_command_reply: tid=0 2024-09-15T22:40:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f470e232740 1 client.25601 shutdown 2024-09-15T22:40:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 msgr2=0x55b59d8b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f470e232740 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8b4270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46f8005790 tx=0x7f46f8005540 comp rx=0 tx=0).stop 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 shutdown_connections 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.440+0000 7f470e232740 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d8bfae0 0x55b59d8c1ed0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8afa60 0x55b59d8bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 1 --2- 172.21.15.22:0/2508314068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8aa090 0x55b59d8b4270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 >> 172.21.15.22:0/2508314068 conn(0x55b59d8a5700 msgr2=0x55b59d8a6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f46ea000640 0 client.25601 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 shutdown_connections 2024-09-15T22:40:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 1 -- 172.21.15.22:0/2508314068 wait complete. 2024-09-15T22:40:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.441+0000 7f470e232740 20 client.25601 trim_cache size 0 max 16384 2024-09-15T22:40:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.474+0000 7f470e232740 1 Processor -- start 2024-09-15T22:40:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.474+0000 7f470e232740 1 -- start start 2024-09-15T22:40:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.475+0000 7f470e232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8abc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.475+0000 7f470e232740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 0x55b59d8ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.475+0000 7f470e232740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.475+0000 7f470e232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47041b1ee0 con 0x55b59d8aa9d0 2024-09-15T22:40:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.475+0000 7f470e232740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47041af7b0 con 0x55b59d8afa60 2024-09-15T22:40:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.475+0000 7f470e232740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47041ad5e0 con 0x55b59d8bb710 2024-09-15T22:40:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33524/0 (socket says 172.21.15.22:33524) 2024-09-15T22:40:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 -- 172.21.15.22:0/2541320663 learned_addr learned my addr 172.21.15.22:0/2541320663 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4708a00640 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 -- 172.21.15.22:0/2541320663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 msgr2=0x55b59d8ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 0x55b59d8ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 -- 172.21.15.22:0/2541320663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 msgr2=0x55b59d8abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8abc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.476+0000 7f4709400640 1 -- 172.21.15.22:0/2541320663 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59d8a5520 con 0x55b59d8bb710 2024-09-15T22:40:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.485+0000 7f4709400640 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b4020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46fc011520 tx=0x7f46fc012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d695ecfabfba103 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.486+0000 7f46f5200640 1 -- 172.21.15.22:0/2541320663 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc01f6f0 con 0x55b59d8bb710 2024-09-15T22:40:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.486+0000 7f46f5200640 1 -- 172.21.15.22:0/2541320663 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46fc023030 con 0x55b59d8bb710 2024-09-15T22:40:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.486+0000 7f46f5200640 1 -- 172.21.15.22:0/2541320663 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc01ecd0 con 0x55b59d8bb710 2024-09-15T22:40:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 -- 172.21.15.22:0/2541320663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 msgr2=0x55b59d8b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b4020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46fc011520 tx=0x7f46fc012000 comp rx=0 tx=0).stop 2024-09-15T22:40:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 -- 172.21.15.22:0/2541320663 shutdown_connections 2024-09-15T22:40:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b4020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 0x55b59d8ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 --2- 172.21.15.22:0/2541320663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.488+0000 7f470e232740 1 -- 172.21.15.22:0/2541320663 >> 172.21.15.22:0/2541320663 conn(0x55b59d8a5700 msgr2=0x55b59d8af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.489+0000 7f470e232740 1 -- 172.21.15.22:0/2541320663 shutdown_connections 2024-09-15T22:40:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.489+0000 7f470e232740 1 -- 172.21.15.22:0/2541320663 wait complete. 2024-09-15T22:40:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.489+0000 7f470e232740 1 -- start start 2024-09-15T22:40:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.490+0000 7f470e232740 1 Processor -- start 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 0x55b59d8b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47041adc70 con 0x55b59d8aa9d0 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47041af0e0 con 0x55b59d8afa60 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47041ae340 con 0x55b59d8bb710 2024-09-15T22:40:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.491+0000 7f470e232740 10 client.0 _ll_register_callbacks cb 0x7f46f80099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:18.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.492+0000 7f4709400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.493+0000 7f4709400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:33534/0 (socket says 172.21.15.22:33534) 2024-09-15T22:40:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.493+0000 7f4709400640 1 -- 172.21.15.22:0/2362649686 learned_addr learned my addr 172.21.15.22:0/2362649686 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.494+0000 7f4708a00640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.495+0000 7f4708a00640 1 -- 172.21.15.22:0/2362649686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 msgr2=0x55b59d8b99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.495+0000 7f4708a00640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.495+0000 7f4708a00640 1 -- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 msgr2=0x55b59d8b8990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:40:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.496+0000 7f4708a00640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 0x55b59d8b8990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.496+0000 7f4708a00640 1 -- 172.21.15.22:0/2362649686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59d8b9fb0 con 0x55b59d8aa9d0 2024-09-15T22:40:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.496+0000 7f4709400640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:40:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.497+0000 7f4708a00640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b8450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46f8011000 tx=0x7f46f800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7b546a75dcbe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.497+0000 7f46ea000640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:40:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.499+0000 7f46ea000640 1 -- 172.21.15.22:0/2362649686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f80055b0 con 0x55b59d8aa9d0 2024-09-15T22:40:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.499+0000 7f46ea000640 1 -- 172.21.15.22:0/2362649686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f46f8024640 con 0x55b59d8aa9d0 2024-09-15T22:40:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.500+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46fc023030 con 0x55b59d8aa9d0 2024-09-15T22:40:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.501+0000 7f46ea000640 1 -- 172.21.15.22:0/2362649686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46f8024840 con 0x55b59d8aa9d0 2024-09-15T22:40:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.502+0000 7f470e232740 10 client.15540 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.502+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b59d8bb2c0 con 0x55b59d8aa9d0 2024-09-15T22:40:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.503+0000 7f46ea000640 1 -- 172.21.15.22:0/2362649686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46fc023030 con 0x55b59d8aa9d0 2024-09-15T22:40:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.503+0000 7f46ea000640 1 -- 172.21.15.22:0/2362649686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46f8036070 con 0x55b59d8aa9d0 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f470e232740 10 client.15540 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f470e232740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f470e232740 20 client.15540 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f470e232740 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d933470 0x55b59d935890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f470e232740 4 client.15540 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b59d816b80 con 0x55b59d933470 2024-09-15T22:40:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.504+0000 7f4703e00640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d933470 0x55b59d935890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.505+0000 7f46ea000640 10 client.15540 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.505+0000 7f4703e00640 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d933470 0x55b59d935890 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3895b79af8e147 server_cookie=cd043c5dee20eff5 in_seq=0 out_seq=0 2024-09-15T22:40:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.554+0000 7f46ea000640 1 -- 172.21.15.22:0/2362649686 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b59d816b80 con 0x55b59d933470 2024-09-15T22:40:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.554+0000 7f46ea000640 10 client.15540 handle_command_reply: tid=0 2024-09-15T22:40:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.554+0000 7f470e232740 1 client.15540 shutdown 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.556+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 msgr2=0x55b59d8b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.556+0000 7f470e232740 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b8450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46f8011000 tx=0x7f46f800ee20 comp rx=0 tx=0).stop 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 shutdown_connections 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b59d933470 0x55b59d935890 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b59d8bb710 0x55b59d8b99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59d8afa60 0x55b59d8b8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 --2- 172.21.15.22:0/2362649686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b59d8aa9d0 0x55b59d8b8450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 >> 172.21.15.22:0/2362649686 conn(0x55b59d8a5700 msgr2=0x55b59d8abc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f46ea000640 0 client.15540 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 shutdown_connections 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 1 -- 172.21.15.22:0/2362649686 wait complete. 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.559+0000 7f470e232740 20 client.15540 trim_cache size 0 max 16384 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:40:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.560+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f46ec0a3460 msgr2=0x7f46ec0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.560+0000 7f470b400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f46ec0a3460 0x7f46ec0a5920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005fd0 tx=0x7f46fc0094a0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.560+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 msgr2=0x7f4704071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.560+0000 7f470b400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 0x7f4704071050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46f0031440 tx=0x7f46f003cd10 comp rx=0 tx=0).stop 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.561+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 shutdown_connections 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.561+0000 7f470b400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4704104f00 0x7f4704071050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.561+0000 7f470b400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f46ec0a3460 0x7f46ec0a5920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.561+0000 7f470b400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4704107830 0x7f47041a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.561+0000 7f470b400640 1 --2- 172.21.15.22:0/2725890134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47041025d0 0x7f4704070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.561+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 >> 172.21.15.22:0/2725890134 conn(0x7f47040fc1b0 msgr2=0x7f4704103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.562+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 shutdown_connections 2024-09-15T22:40:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:18.562+0000 7f470b400640 1 -- 172.21.15.22:0/2725890134 wait complete. 2024-09-15T22:40:19.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:18 smithi022 ceph-mon[30634]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 275 MiB/s wr, 975 op/s 2024-09-15T22:40:19.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:18 smithi112 ceph-mon[35032]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 275 MiB/s wr, 975 op/s 2024-09-15T22:40:19.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:18 smithi110 ceph-mon[35282]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 275 MiB/s wr, 975 op/s 2024-09-15T22:40:21.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:21 smithi022 ceph-mon[30634]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 260 MiB/s wr, 920 op/s 2024-09-15T22:40:21.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:21 smithi112 ceph-mon[35032]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 260 MiB/s wr, 920 op/s 2024-09-15T22:40:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:21 smithi110 ceph-mon[35282]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 260 MiB/s wr, 920 op/s 2024-09-15T22:40:23.271 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:23 smithi110 ceph-mon[35282]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 275 MiB/s wr, 985 op/s 2024-09-15T22:40:23.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:23 smithi022 ceph-mon[30634]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 275 MiB/s wr, 985 op/s 2024-09-15T22:40:23.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:23 smithi112 ceph-mon[35032]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 275 MiB/s wr, 985 op/s 2024-09-15T22:40:25.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:25 smithi112 ceph-mon[35032]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 273 MiB/s wr, 976 op/s 2024-09-15T22:40:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:25 smithi110 ceph-mon[35282]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 273 MiB/s wr, 976 op/s 2024-09-15T22:40:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:25 smithi022 ceph-mon[30634]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 273 MiB/s wr, 976 op/s 2024-09-15T22:40:27.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:27 smithi112 ceph-mon[35032]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 925 op/s 2024-09-15T22:40:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:27 smithi110 ceph-mon[35282]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 925 op/s 2024-09-15T22:40:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:27 smithi022 ceph-mon[30634]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 259 MiB/s wr, 925 op/s 2024-09-15T22:40:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:29 smithi110 ceph-mon[35282]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 274 MiB/s wr, 981 op/s 2024-09-15T22:40:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:29 smithi022 ceph-mon[30634]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 274 MiB/s wr, 981 op/s 2024-09-15T22:40:29.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:29 smithi112 ceph-mon[35032]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 274 MiB/s wr, 981 op/s 2024-09-15T22:40:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:31 smithi110 ceph-mon[35282]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 900 op/s 2024-09-15T22:40:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:31 smithi022 ceph-mon[30634]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 900 op/s 2024-09-15T22:40:31.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:31 smithi112 ceph-mon[35032]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 900 op/s 2024-09-15T22:40:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 -- 172.21.15.22:0/4211703725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc10dbb0 msgr2=0x7fb5cc110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/4211703725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc110070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009be0 tx=0x7fb5c402a6c0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 -- 172.21.15.22:0/4211703725 shutdown_connections 2024-09-15T22:40:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/4211703725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc073680 0x7fb5cc10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/4211703725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc110070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/4211703725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc072cb0 0x7fb5cc0730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.758+0000 7fb5d0a00640 1 -- 172.21.15.22:0/4211703725 >> 172.21.15.22:0/4211703725 conn(0x7fb5cc06eb50 msgr2=0x7fb5cc070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.759+0000 7fb5d0a00640 1 -- 172.21.15.22:0/4211703725 shutdown_connections 2024-09-15T22:40:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.759+0000 7fb5d0a00640 1 -- 172.21.15.22:0/4211703725 wait complete. 2024-09-15T22:40:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.760+0000 7fb5d0a00640 1 Processor -- start 2024-09-15T22:40:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.760+0000 7fb5d0a00640 1 -- start start 2024-09-15T22:40:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.761+0000 7fb5d0a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc072cb0 0x7fb5cc118440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.761+0000 7fb5d0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 0x7fb5cc118980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.762+0000 7fb5caa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 0x7fb5cc118980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.762+0000 7fb5caa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 0x7fb5cc118980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:60228/0 (socket says 172.21.15.22:60228) 2024-09-15T22:40:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.762+0000 7fb5caa00640 1 -- 172.21.15.22:0/3628419239 learned_addr learned my addr 172.21.15.22:0/3628419239 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.762+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc116a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.763+0000 7fb5cb400640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc072cb0 0x7fb5cc118440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.763+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc111370 con 0x7fb5cc072cb0 2024-09-15T22:40:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.763+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1111f0 con 0x7fb5cc073680 2024-09-15T22:40:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.763+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1114f0 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.763+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc116a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.764+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3628419239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 msgr2=0x7fb5cc118980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.764+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 0x7fb5cc118980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.764+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc072cb0 msgr2=0x7fb5cc118440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.764+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc072cb0 0x7fb5cc118440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.764+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3628419239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc117200 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.764+0000 7fb5caa00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 0x7fb5cc118980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.765+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc116a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4034040 tx=0x7fb5c40305b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.765+0000 7fb5cb400640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc072cb0 0x7fb5cc118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:40:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.765+0000 7fb5c3e00640 1 -- 172.21.15.22:0/3628419239 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4041020 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.766+0000 7fb5c3e00640 1 -- 172.21.15.22:0/3628419239 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5c4003e50 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.766+0000 7fb5c3e00640 1 -- 172.21.15.22:0/3628419239 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4036040 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.766+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc117490 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.766+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc1b76d0 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.775+0000 7fb5d4eaa740 1 Processor -- start 2024-09-15T22:40:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.778+0000 7fb5c3e00640 1 -- 172.21.15.22:0/3628419239 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb5c4044020 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 -- start start 2024-09-15T22:40:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5c3e00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5b00a3340 0x7fb5b00a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5c3e00640 1 -- 172.21.15.22:0/3628419239 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb5c40f0360 con 0x7fb5cc10dbb0 2024-09-15T22:40:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755da260 0x55c9755da660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755df660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 0x55c9755e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c97553f100 con 0x55c9755daba0 2024-09-15T22:40:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c9754e71b0 con 0x55c9755dfc30 2024-09-15T22:40:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.780+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c97553b0c0 con 0x55c9755da260 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.781+0000 7fb5cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 0x55c9755e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.781+0000 7fb5cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 0x55c9755e20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:60236/0 (socket says 172.21.15.22:60236) 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.781+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3312267810 learned_addr learned my addr 172.21.15.22:0/3312267810 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.782+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3312267810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755da260 msgr2=0x55c9755da660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.782+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755da260 0x55c9755da660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.782+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3312267810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 msgr2=0x55c9755df660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:40:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.782+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755df660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.782+0000 7fb5cbe00640 1 -- 172.21.15.22:0/3312267810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c975252210 con 0x55c9755dfc30 2024-09-15T22:40:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.782+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 0x55c9755e20f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40b8da0 tx=0x7fb5c40bc480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a1891bc3daf096a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.785+0000 7fb5bbe00640 1 -- 172.21.15.22:0/3312267810 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40d0e60 con 0x55c9755dfc30 2024-09-15T22:40:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.785+0000 7fb5bbe00640 1 -- 172.21.15.22:0/3312267810 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5c40d5070 con 0x55c9755dfc30 2024-09-15T22:40:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.785+0000 7fb5bbe00640 1 -- 172.21.15.22:0/3312267810 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40c55b0 con 0x55c9755dfc30 2024-09-15T22:40:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.786+0000 7fb5caa00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5b00a3340 0x7fb5b00a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.786+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/3312267810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 msgr2=0x55c9755e20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.786+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 0x55c9755e20f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40b8da0 tx=0x7fb5c40bc480 comp rx=0 tx=0).stop 2024-09-15T22:40:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.788+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/3312267810 shutdown_connections 2024-09-15T22:40:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.788+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755dfc30 0x55c9755e20f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.788+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755df660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.788+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/3312267810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755da260 0x55c9755da660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.788+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/3312267810 >> 172.21.15.22:0/3312267810 conn(0x55c9755d58d0 msgr2=0x55c9755d5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.791+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/3312267810 shutdown_connections 2024-09-15T22:40:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.794+0000 7fb5caa00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5b00a3340 0x7fb5b00a5800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55c9755db5d0 tx=0x7fb5b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.794+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/3312267810 wait complete. 2024-09-15T22:40:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.795+0000 7fb5d4eaa740 1 -- start start 2024-09-15T22:40:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.796+0000 7fb5d4eaa740 1 Processor -- start 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.797+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.798+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.798+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.798+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c9754e71b0 con 0x55c9755daba0 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.798+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c9754c8090 con 0x55c9755da260 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.798+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c9755e29c0 con 0x55c9755dfc30 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.798+0000 7fb5d4eaa740 10 client.0 _ll_register_callbacks cb 0x55c97551cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.799+0000 7fb5caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.800+0000 7fb5caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45886/0 (socket says 172.21.15.22:45886) 2024-09-15T22:40:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.800+0000 7fb5cb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.800+0000 7fb5cb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:60250/0 (socket says 172.21.15.22:60250) 2024-09-15T22:40:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.800+0000 7fb5cb400640 1 -- 172.21.15.22:0/987044822 learned_addr learned my addr 172.21.15.22:0/987044822 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.801+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.802+0000 7fb5cb400640 1 -- 172.21.15.22:0/987044822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 msgr2=0x55c9755eb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.802+0000 7fb5cb400640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755eb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.802+0000 7fb5cb400640 1 -- 172.21.15.22:0/987044822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 msgr2=0x55c9755e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.802+0000 7fb5cb400640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.802+0000 7fb5cb400640 1 -- 172.21.15.22:0/987044822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97531e620 con 0x55c9755da260 2024-09-15T22:40:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.803+0000 7fb5caa00640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.803+0000 7fb5cb400640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e40e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00d620 tx=0x7fb5bc00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f36e2e99bfdc480 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.803+0000 7fb5b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:40:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.804+0000 7fb5b8c00640 1 -- 172.21.15.22:0/987044822 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc008970 con 0x55c9755da260 2024-09-15T22:40:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.804+0000 7fb5b8c00640 1 -- 172.21.15.22:0/987044822 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb5bc008b10 con 0x55c9755da260 2024-09-15T22:40:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.804+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5c40d5070 con 0x55c9755da260 2024-09-15T22:40:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.805+0000 7fb5b8c00640 1 -- 172.21.15.22:0/987044822 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5bc008d10 con 0x55c9755da260 2024-09-15T22:40:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.805+0000 7fb5d4eaa740 10 client.25610 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.805+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9755ee4b0 con 0x55c9755da260 2024-09-15T22:40:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.806+0000 7fb5b8c00640 1 -- 172.21.15.22:0/987044822 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5c40d5070 con 0x55c9755da260 2024-09-15T22:40:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.806+0000 7fb5b8c00640 1 -- 172.21.15.22:0/987044822 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5bc00f540 con 0x55c9755da260 2024-09-15T22:40:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.810+0000 7fb5d4eaa740 10 client.25610 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.810+0000 7fb5d4eaa740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.810+0000 7fb5d4eaa740 20 client.25610 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.810+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c9755efbd0 0x55c9755f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.810+0000 7fb5d4eaa740 4 client.25610 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:40:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.810+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c97554c830 con 0x55c9755efbd0 2024-09-15T22:40:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.814+0000 7fb5caa00640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c9755efbd0 0x55c9755f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.823+0000 7fb5caa00640 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c9755efbd0 0x55c9755f1fc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7313546327c6cbe6 server_cookie=6b7e50e3b5e982c4 in_seq=0 out_seq=0 2024-09-15T22:40:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.823+0000 7fb5b8c00640 10 client.25610 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.824+0000 7fb5b8c00640 1 -- 172.21.15.22:0/987044822 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c97554c830 con 0x55c9755efbd0 2024-09-15T22:40:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.824+0000 7fb5b8c00640 10 client.25610 handle_command_reply: tid=0 2024-09-15T22:40:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.825+0000 7fb5d4eaa740 1 client.25610 shutdown 2024-09-15T22:40:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 msgr2=0x55c9755e40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e40e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00d620 tx=0x7fb5bc00dae0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 shutdown_connections 2024-09-15T22:40:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c9755efbd0 0x55c9755f1fc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755eb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/987044822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e40e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 >> 172.21.15.22:0/987044822 conn(0x55c9755d58d0 msgr2=0x55c9755d70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.827+0000 7fb5b8c00640 0 client.25610 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.833+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 shutdown_connections 2024-09-15T22:40:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.834+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/987044822 wait complete. 2024-09-15T22:40:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.835+0000 7fb5d4eaa740 20 client.25610 trim_cache size 0 max 16384 2024-09-15T22:40:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.879+0000 7fb5d4eaa740 1 Processor -- start 2024-09-15T22:40:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 -- start start 2024-09-15T22:40:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 0x55c9755d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755daba0 0x55c9755eb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755d6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1c2e10 con 0x55c9755da260 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1c06e0 con 0x55c9755daba0 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.880+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1be510 con 0x55c9755dfc30 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 0x55c9755d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 0x55c9755d6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45894/0 (socket says 172.21.15.22:45894) 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 -- 172.21.15.22:0/1202988105 learned_addr learned my addr 172.21.15.22:0/1202988105 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 -- 172.21.15.22:0/1202988105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 msgr2=0x55c9755d6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755d6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 -- 172.21.15.22:0/1202988105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755daba0 msgr2=0x55c9755eb5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755daba0 0x55c9755eb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.882+0000 7fb5cb400640 1 -- 172.21.15.22:0/1202988105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9755f2620 con 0x55c9755da260 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.883+0000 7fb5cb400640 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 0x55c9755d6440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000c00 tx=0x7fb5bc008360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8d10de646c202d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.883+0000 7fb5bb400640 1 -- 172.21.15.22:0/1202988105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc02d020 con 0x55c9755da260 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.884+0000 7fb5bb400640 1 -- 172.21.15.22:0/1202988105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5bc005c20 con 0x55c9755da260 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.884+0000 7fb5bb400640 1 -- 172.21.15.22:0/1202988105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc017420 con 0x55c9755da260 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.884+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/1202988105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 msgr2=0x55c9755d6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.884+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 0x55c9755d6440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000c00 tx=0x7fb5bc008360 comp rx=0 tx=0).stop 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/1202988105 shutdown_connections 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755d6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755daba0 0x55c9755eb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/1202988105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755da260 0x55c9755d6440 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/1202988105 >> 172.21.15.22:0/1202988105 conn(0x55c9755d58d0 msgr2=0x55c9755d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/1202988105 shutdown_connections 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/1202988105 wait complete. 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.885+0000 7fb5d4eaa740 1 -- start start 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 Processor -- start 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1beba0 con 0x55c9755daba0 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1c0010 con 0x55c9755da260 2024-09-15T22:40:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1bf270 con 0x55c9755dfc30 2024-09-15T22:40:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.886+0000 7fb5d4eaa740 10 client.0 _ll_register_callbacks cb 0x7fb5bc00b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.887+0000 7fb5caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.887+0000 7fb5cbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.887+0000 7fb5caa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45900/0 (socket says 172.21.15.22:45900) 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.887+0000 7fb5caa00640 1 -- 172.21.15.22:0/256118012 learned_addr learned my addr 172.21.15.22:0/256118012 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.887+0000 7fb5cb400640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5cbe00640 1 -- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 msgr2=0x55c9755e87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5cbe00640 1 -- 172.21.15.22:0/256118012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 msgr2=0x55c9755e8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5cbe00640 1 -- 172.21.15.22:0/256118012 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9755ea350 con 0x55c9755dfc30 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5caa00640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5cbe00640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755e9d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4030950 tx=0x7fb5c4009950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0d1712a49ae616 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.888+0000 7fb5b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:40:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5b8c00640 1 -- 172.21.15.22:0/256118012 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40d0e60 con 0x55c9755dfc30 2024-09-15T22:40:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5b8c00640 1 -- 172.21.15.22:0/256118012 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb5c4030db0 con 0x55c9755dfc30 2024-09-15T22:40:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5bc005c20 con 0x55c9755dfc30 2024-09-15T22:40:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5b8c00640 1 -- 172.21.15.22:0/256118012 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5c4004660 con 0x55c9755dfc30 2024-09-15T22:40:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5d4eaa740 10 client.25654 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9755eb6d0 con 0x55c9755dfc30 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5b8c00640 1 -- 172.21.15.22:0/256118012 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5bc005c20 con 0x55c9755dfc30 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.889+0000 7fb5b8c00640 1 -- 172.21.15.22:0/256118012 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5c404e060 con 0x55c9755dfc30 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5d4eaa740 10 client.25654 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5d4eaa740 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5d4eaa740 20 client.25654 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c97565ab20 0x55c97565cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5d4eaa740 4 client.25654 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c975546b80 con 0x55c97565ab20 2024-09-15T22:40:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.890+0000 7fb5cb400640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c97565ab20 0x55c97565cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.892+0000 7fb5cb400640 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c97565ab20 0x55c97565cf40 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b9edc18468e93c1 server_cookie=a210175d949e4cf4 in_seq=0 out_seq=0 2024-09-15T22:40:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.892+0000 7fb5b8c00640 10 client.25654 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.912+0000 7fb5b8c00640 1 -- 172.21.15.22:0/256118012 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c975546b80 con 0x55c97565ab20 2024-09-15T22:40:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.912+0000 7fb5b8c00640 10 client.25654 handle_command_reply: tid=0 2024-09-15T22:40:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.912+0000 7fb5d4eaa740 1 client.25654 shutdown 2024-09-15T22:40:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.913+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 msgr2=0x55c9755e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.913+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755e9d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4030950 tx=0x7fb5c4009950 comp rx=0 tx=0).stop 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 shutdown_connections 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55c97565ab20 0x55c97565cf40 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c9755dfc30 0x55c9755e9d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9755daba0 0x55c9755e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5d4eaa740 1 --2- 172.21.15.22:0/256118012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c9755da260 0x55c9755e87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 >> 172.21.15.22:0/256118012 conn(0x55c9755d58d0 msgr2=0x55c9755d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.915+0000 7fb5b8c00640 0 client.25654 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.917+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 shutdown_connections 2024-09-15T22:40:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.918+0000 7fb5d4eaa740 1 -- 172.21.15.22:0/256118012 wait complete. 2024-09-15T22:40:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.918+0000 7fb5d4eaa740 20 client.25654 trim_cache size 0 max 16384 2024-09-15T22:40:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:40:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:40:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:40:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:40:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.920+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5b00a3340 msgr2=0x7fb5b00a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.920+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5b00a3340 0x7fb5b00a5800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55c9755db5d0 tx=0x7fb5b4009260 comp rx=0 tx=0).stop 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc10dbb0 msgr2=0x7fb5cc116a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc116a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4034040 tx=0x7fb5c40305b0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 shutdown_connections 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5cc10dbb0 0x7fb5cc116a80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb5b00a3340 0x7fb5b00a5800 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5cc073680 0x7fb5cc118980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 --2- 172.21.15.22:0/3628419239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc072cb0 0x7fb5cc118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 >> 172.21.15.22:0/3628419239 conn(0x7fb5cc06eb50 msgr2=0x7fb5cc070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.921+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 shutdown_connections 2024-09-15T22:40:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:31.922+0000 7fb5d0a00640 1 -- 172.21.15.22:0/3628419239 wait complete. 2024-09-15T22:40:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:33 smithi110 ceph-mon[35282]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 966 op/s 2024-09-15T22:40:33.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:33 smithi022 ceph-mon[30634]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 966 op/s 2024-09-15T22:40:33.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:33 smithi112 ceph-mon[35032]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 966 op/s 2024-09-15T22:40:35.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:35 smithi110 ceph-mon[35282]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 254 MiB/s wr, 909 op/s 2024-09-15T22:40:35.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:35 smithi022 ceph-mon[30634]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 254 MiB/s wr, 909 op/s 2024-09-15T22:40:35.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:35 smithi112 ceph-mon[35032]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 254 MiB/s wr, 909 op/s 2024-09-15T22:40:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:37 smithi110 ceph-mon[35282]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 244 MiB/s wr, 881 op/s 2024-09-15T22:40:37.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:37 smithi022 ceph-mon[30634]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 244 MiB/s wr, 881 op/s 2024-09-15T22:40:37.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:37 smithi112 ceph-mon[35032]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 244 MiB/s wr, 881 op/s 2024-09-15T22:40:39.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:39 smithi110 ceph-mon[35282]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 265 MiB/s wr, 953 op/s 2024-09-15T22:40:39.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:39 smithi022 ceph-mon[30634]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 265 MiB/s wr, 953 op/s 2024-09-15T22:40:39.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:39 smithi112 ceph-mon[35032]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 265 MiB/s wr, 953 op/s 2024-09-15T22:40:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:41 smithi110 ceph-mon[35282]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 247 MiB/s wr, 891 op/s 2024-09-15T22:40:41.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:41 smithi022 ceph-mon[30634]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 247 MiB/s wr, 891 op/s 2024-09-15T22:40:41.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:41 smithi112 ceph-mon[35032]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 247 MiB/s wr, 891 op/s 2024-09-15T22:40:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:43 smithi110 ceph-mon[35282]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 939 op/s 2024-09-15T22:40:43.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:43 smithi022 ceph-mon[30634]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 939 op/s 2024-09-15T22:40:43.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:43 smithi112 ceph-mon[35032]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 939 op/s 2024-09-15T22:40:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.143+0000 7fea89c00640 1 -- 172.21.15.22:0/88188789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c094570 msgr2=0x7fea7c094970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.143+0000 7fea89c00640 1 --2- 172.21.15.22:0/88188789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c094570 0x7fea7c094970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea78009900 tx=0x7fea7802a420 comp rx=0 tx=0).stop 2024-09-15T22:40:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.144+0000 7fea89c00640 1 -- 172.21.15.22:0/88188789 shutdown_connections 2024-09-15T22:40:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.144+0000 7fea89c00640 1 --2- 172.21.15.22:0/88188789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c096120 0x7fea7c09c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.144+0000 7fea89c00640 1 --2- 172.21.15.22:0/88188789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c095760 0x7fea7c095be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.144+0000 7fea89c00640 1 --2- 172.21.15.22:0/88188789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c094570 0x7fea7c094970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.144+0000 7fea89c00640 1 -- 172.21.15.22:0/88188789 >> 172.21.15.22:0/88188789 conn(0x7fea7c08fcb0 msgr2=0x7fea7c092110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.145+0000 7fea89c00640 1 -- 172.21.15.22:0/88188789 shutdown_connections 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.145+0000 7fea89c00640 1 -- 172.21.15.22:0/88188789 wait complete. 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.147+0000 7fea89c00640 1 Processor -- start 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.147+0000 7fea89c00640 1 -- start start 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.148+0000 7fea89c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c094570 0x7fea7c129770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.149+0000 7fea89c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c095760 0x7fea7c12ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.149+0000 7fea89c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 0x7fea7c129d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.149+0000 7fea89c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c0a13a0 con 0x7fea7c094570 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.149+0000 7fea89c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c0a1220 con 0x7fea7c096120 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.149+0000 7fea89c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c0a1520 con 0x7fea7c095760 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 0x7fea7c129d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 0x7fea7c129d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:50924/0 (socket says 172.21.15.22:50924) 2024-09-15T22:40:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 -- 172.21.15.22:0/1750465813 learned_addr learned my addr 172.21.15.22:0/1750465813 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 -- 172.21.15.22:0/1750465813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c095760 msgr2=0x7fea7c12ed10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c095760 0x7fea7c12ed10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 -- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c094570 msgr2=0x7fea7c129770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea83e00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c094570 0x7fea7c129770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.150+0000 7fea89200640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c094570 0x7fea7c129770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.151+0000 7fea89200640 1 -- 172.21.15.22:0/1750465813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c1423b0 con 0x7fea7c096120 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.151+0000 7fea89200640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 0x7fea7c129d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea84050280 tx=0x7fea8406b120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.152+0000 7fea80c00640 1 -- 172.21.15.22:0/1750465813 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84085070 con 0x7fea7c096120 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.152+0000 7fea80c00640 1 -- 172.21.15.22:0/1750465813 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea840808e0 con 0x7fea7c096120 2024-09-15T22:40:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.153+0000 7fea80c00640 1 -- 172.21.15.22:0/1750465813 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8407fa10 con 0x7fea7c096120 2024-09-15T22:40:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.153+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1426a0 con 0x7fea7c096120 2024-09-15T22:40:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.154+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c142bf0 con 0x7fea7c096120 2024-09-15T22:40:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.159+0000 7fea8e0c6740 1 Processor -- start 2024-09-15T22:40:45.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.164+0000 7fea80c00640 1 -- 172.21.15.22:0/1750465813 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fea8407fbb0 con 0x7fea7c096120 2024-09-15T22:40:45.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.166+0000 7fea8e0c6740 1 -- start start 2024-09-15T22:40:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.167+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79260 0x55ebcbf79660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.167+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf7e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.167+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 0x55ebcbf810f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.167+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbede100 con 0x55ebcbf79260 2024-09-15T22:40:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.167+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbe861b0 con 0x55ebcbf7ec30 2024-09-15T22:40:45.169 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.167+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbeda0c0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79260 0x55ebcbf79660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea80c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fea6c0a3270 0x7fea6c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 0x55ebcbf810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf7e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 0x55ebcbf810f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:50928/0 (socket says 172.21.15.22:50928) 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf7e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41406/0 (socket says 172.21.15.22:41406) 2024-09-15T22:40:45.170 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 -- 172.21.15.22:0/2428477400 learned_addr learned my addr 172.21.15.22:0/2428477400 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea80c00640 1 -- 172.21.15.22:0/1750465813 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fea8413ae20 con 0x7fea7c096120 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 -- 172.21.15.22:0/2428477400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79ba0 msgr2=0x55ebcbf7e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf7e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 -- 172.21.15.22:0/2428477400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79260 msgr2=0x55ebcbf79660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79260 0x55ebcbf79660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.168+0000 7fea83400640 1 -- 172.21.15.22:0/2428477400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcbbf1210 con 0x55ebcbf7ec30 2024-09-15T22:40:45.171 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.169+0000 7fea89200640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fea6c0a3270 0x7fea6c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.169+0000 7fea83400640 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 0x55ebcbf810f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fea70013760 tx=0x7fea70005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd84f75373029bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.170+0000 7fea75600640 1 -- 172.21.15.22:0/2428477400 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70005020 con 0x55ebcbf7ec30 2024-09-15T22:40:45.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.170+0000 7fea75600640 1 -- 172.21.15.22:0/2428477400 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea700047a0 con 0x55ebcbf7ec30 2024-09-15T22:40:45.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.170+0000 7fea75600640 1 -- 172.21.15.22:0/2428477400 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7000e950 con 0x55ebcbf7ec30 2024-09-15T22:40:45.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.170+0000 7fea89200640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fea6c0a3270 0x7fea6c0a5730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fea8410fb40 tx=0x7fea84127040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.172 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 -- 172.21.15.22:0/2428477400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 msgr2=0x55ebcbf810f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 0x55ebcbf810f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fea70013760 tx=0x7fea70005b00 comp rx=0 tx=0).stop 2024-09-15T22:40:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 -- 172.21.15.22:0/2428477400 shutdown_connections 2024-09-15T22:40:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf7e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf7ec30 0x55ebcbf810f0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fea70013760 tx=0x7fea70005b00 comp rx=0 tx=0).stop 2024-09-15T22:40:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/2428477400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79260 0x55ebcbf79660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.171+0000 7fea8e0c6740 1 -- 172.21.15.22:0/2428477400 >> 172.21.15.22:0/2428477400 conn(0x55ebcbf748d0 msgr2=0x55ebcbf74cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.172+0000 7fea8e0c6740 1 -- 172.21.15.22:0/2428477400 shutdown_connections 2024-09-15T22:40:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.172+0000 7fea8e0c6740 1 -- 172.21.15.22:0/2428477400 wait complete. 2024-09-15T22:40:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.173+0000 7fea8e0c6740 1 -- start start 2024-09-15T22:40:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.174+0000 7fea8e0c6740 1 Processor -- start 2024-09-15T22:40:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.175+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf835f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.177 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.176+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf83b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.176+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbf8af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.176+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbf81c00 con 0x55ebcbf88b60 2024-09-15T22:40:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.176+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbe67090 con 0x55ebcbf79ba0 2024-09-15T22:40:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.177+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ebcbf81d80 con 0x55ebcbf79260 2024-09-15T22:40:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.177+0000 7fea8e0c6740 10 client.0 _ll_register_callbacks cb 0x55ebcbebbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.177+0000 7fea83e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf83b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.177+0000 7fea83e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf83b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:50930/0 (socket says 172.21.15.22:50930) 2024-09-15T22:40:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.177+0000 7fea83e00640 1 -- 172.21.15.22:0/1970500354 learned_addr learned my addr 172.21.15.22:0/1970500354 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.177+0000 7fea83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.178+0000 7fea83e00640 1 -- 172.21.15.22:0/1970500354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 msgr2=0x55ebcbf835f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.178+0000 7fea83e00640 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf835f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.178+0000 7fea83e00640 1 -- 172.21.15.22:0/1970500354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 msgr2=0x55ebcbf8af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.178+0000 7fea83e00640 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbf8af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.178+0000 7fea83e00640 1 -- 172.21.15.22:0/1970500354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcbcbd620 con 0x55ebcbf79ba0 2024-09-15T22:40:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.183+0000 7fea6a000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:40:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.183+0000 7fea83e00640 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf83b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fea78009900 tx=0x7fea78004560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e373414bbd435f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.184+0000 7fea6a000640 1 -- 172.21.15.22:0/1970500354 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78035040 con 0x55ebcbf79ba0 2024-09-15T22:40:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.184+0000 7fea6a000640 1 -- 172.21.15.22:0/1970500354 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fea780054d0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.184+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea700047a0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.185+0000 7fea6a000640 1 -- 172.21.15.22:0/1970500354 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea780046c0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.185+0000 7fea8e0c6740 10 client.25622 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.185+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ebcbf8ddb0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.186+0000 7fea6a000640 1 -- 172.21.15.22:0/1970500354 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea700047a0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.186+0000 7fea6a000640 1 -- 172.21.15.22:0/1970500354 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea78003af0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.187+0000 7fea8e0c6740 10 client.25622 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.187+0000 7fea8e0c6740 10 client.25622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.187+0000 7fea8e0c6740 20 client.25622 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.187+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbf8f3e0 0x55ebcbf917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.187+0000 7fea8e0c6740 4 client.25622 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:40:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.187+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebcbeeb830 con 0x55ebcbf8f3e0 2024-09-15T22:40:45.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.188+0000 7fea83400640 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbf8f3e0 0x55ebcbf917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.189+0000 7fea83400640 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbf8f3e0 0x55ebcbf917d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f195b1bb6f3c1ca4 server_cookie=f0807301bfff0d69 in_seq=0 out_seq=0 2024-09-15T22:40:45.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.189+0000 7fea6a000640 10 client.25622 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:45.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.189+0000 7fea6a000640 1 -- 172.21.15.22:0/1970500354 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebcbeeb830 con 0x55ebcbf8f3e0 2024-09-15T22:40:45.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.189+0000 7fea6a000640 10 client.25622 handle_command_reply: tid=0 2024-09-15T22:40:45.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 client.25622 shutdown 2024-09-15T22:40:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 msgr2=0x55ebcbf83b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf83b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fea78009900 tx=0x7fea78004560 comp rx=0 tx=0).stop 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 shutdown_connections 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbf8f3e0 0x55ebcbf917d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbf8af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf83b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1970500354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf835f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.190+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 >> 172.21.15.22:0/1970500354 conn(0x55ebcbf748d0 msgr2=0x55ebcbf760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.191+0000 7fea6a000640 0 client.25622 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.191+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 shutdown_connections 2024-09-15T22:40:45.194 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.191+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1970500354 wait complete. 2024-09-15T22:40:45.194 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.191+0000 7fea8e0c6740 20 client.25622 trim_cache size 0 max 16384 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 Processor -- start 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 -- start start 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf82a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf74cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf88b60 0x55ebcbf751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c14e2e0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c14bbb0 con 0x55ebcbf88b60 2024-09-15T22:40:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1499e0 con 0x55ebcbf79260 2024-09-15T22:40:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf82a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea83e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf74cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf82a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41428/0 (socket says 172.21.15.22:41428) 2024-09-15T22:40:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.221+0000 7fea83400640 1 -- 172.21.15.22:0/1994524698 learned_addr learned my addr 172.21.15.22:0/1994524698 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf88b60 0x55ebcbf751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 -- 172.21.15.22:0/1994524698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf88b60 msgr2=0x55ebcbf751f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf88b60 0x55ebcbf751f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 -- 172.21.15.22:0/1994524698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79ba0 msgr2=0x55ebcbf74cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf74cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 -- 172.21.15.22:0/1994524698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcbf83100 con 0x55ebcbf79260 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83e00640 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf74cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea83400640 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf82a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea70001eb0 tx=0x7fea7001e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16c02918e8cfc55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea74c00640 1 -- 172.21.15.22:0/1994524698 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70004660 con 0x55ebcbf79260 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea74c00640 1 -- 172.21.15.22:0/1994524698 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea70004020 con 0x55ebcbf79260 2024-09-15T22:40:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.222+0000 7fea74c00640 1 -- 172.21.15.22:0/1994524698 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7000ea00 con 0x55ebcbf79260 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1994524698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 msgr2=0x55ebcbf82a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf82a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea70001eb0 tx=0x7fea7001e040 comp rx=0 tx=0).stop 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1994524698 shutdown_connections 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf88b60 0x55ebcbf751f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf79ba0 0x55ebcbf74cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/1994524698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbf82a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1994524698 >> 172.21.15.22:0/1994524698 conn(0x55ebcbf748d0 msgr2=0x55ebcbf835f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1994524698 shutdown_connections 2024-09-15T22:40:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.223+0000 7fea8e0c6740 1 -- 172.21.15.22:0/1994524698 wait complete. 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 -- start start 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 Processor -- start 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbfa06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbfa0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbff7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c14a070 con 0x55ebcbf88b60 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c14b4e0 con 0x55ebcbf79ba0 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c14a740 con 0x55ebcbf79260 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea8e0c6740 10 client.0 _ll_register_callbacks cb 0x7fea78009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbfa06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea83e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbfa0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbfa06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41436/0 (socket says 172.21.15.22:41436) 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.224+0000 7fea83400640 1 -- 172.21.15.22:0/3702608659 learned_addr learned my addr 172.21.15.22:0/3702608659 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbff7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 -- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 msgr2=0x55ebcbfa0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbfa0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 -- 172.21.15.22:0/3702608659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 msgr2=0x55ebcbff7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbff7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 -- 172.21.15.22:0/3702608659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcbff8510 con 0x55ebcbf79260 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83e00640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbfa0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea83400640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbfa06e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea700134a0 tx=0x7fea7000bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48eae852c8cab0bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea6a000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea6a000640 1 -- 172.21.15.22:0/3702608659 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea700041d0 con 0x55ebcbf79260 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea6a000640 1 -- 172.21.15.22:0/3702608659 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fea70009030 con 0x55ebcbf79260 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.225+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea70004020 con 0x55ebcbf79260 2024-09-15T22:40:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea6a000640 1 -- 172.21.15.22:0/3702608659 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea70004370 con 0x55ebcbf79260 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 10 client.25669 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ebcbff9820 con 0x55ebcbf79260 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea6a000640 1 -- 172.21.15.22:0/3702608659 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea70004020 con 0x55ebcbf79260 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea6a000640 1 -- 172.21.15.22:0/3702608659 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea7000f040 con 0x55ebcbf79260 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 10 client.25669 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 10 client.25669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 20 client.25669 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbffa010 0x55ebcbffc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 4 client.25669 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ebcbee5b80 con 0x55ebcbffa010 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.226+0000 7fea83e00640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbffa010 0x55ebcbffc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.227+0000 7fea83e00640 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbffa010 0x55ebcbffc430 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4d87c6e8e434a22 server_cookie=2a407e0a37243b87 in_seq=0 out_seq=0 2024-09-15T22:40:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.227+0000 7fea6a000640 10 client.25669 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea6a000640 1 -- 172.21.15.22:0/3702608659 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ebcbee5b80 con 0x55ebcbffa010 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea6a000640 10 client.25669 handle_command_reply: tid=0 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 client.25669 shutdown 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 msgr2=0x55ebcbfa06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbfa06e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea700134a0 tx=0x7fea7000bc10 comp rx=0 tx=0).stop 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 shutdown_connections 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55ebcbffa010 0x55ebcbffc430 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ebcbf88b60 0x55ebcbff7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ebcbf79ba0 0x55ebcbfa0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea6a000640 0 client.25669 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 --2- 172.21.15.22:0/3702608659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ebcbf79260 0x55ebcbfa06e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 >> 172.21.15.22:0/3702608659 conn(0x55ebcbf748d0 msgr2=0x55ebcbf731f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 shutdown_connections 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 1 -- 172.21.15.22:0/3702608659 wait complete. 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.249+0000 7fea8e0c6740 20 client.25669 trim_cache size 0 max 16384 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:40:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:40:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:40:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:40:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fea6c0a3270 msgr2=0x7fea6c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fea6c0a3270 0x7fea6c0a5730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fea8410fb40 tx=0x7fea84127040 comp rx=0 tx=0).stop 2024-09-15T22:40:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 msgr2=0x7fea7c129d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 0x7fea7c129d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea84050280 tx=0x7fea8406b120 comp rx=0 tx=0).stop 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 shutdown_connections 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea7c095760 0x7fea7c12ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fea6c0a3270 0x7fea6c0a5730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea7c096120 0x7fea7c129d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 --2- 172.21.15.22:0/1750465813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea7c094570 0x7fea7c129770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.250+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 >> 172.21.15.22:0/1750465813 conn(0x7fea7c08fcb0 msgr2=0x7fea7c096980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.251+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 shutdown_connections 2024-09-15T22:40:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:45.251+0000 7fea89c00640 1 -- 172.21.15.22:0/1750465813 wait complete. 2024-09-15T22:40:45.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:45 smithi022 ceph-mon[30634]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 918 op/s 2024-09-15T22:40:45.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:45 smithi112 ceph-mon[35032]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 918 op/s 2024-09-15T22:40:45.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:45 smithi110 ceph-mon[35282]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 257 MiB/s wr, 918 op/s 2024-09-15T22:40:47.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:47 smithi022 ceph-mon[30634]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 923 op/s 2024-09-15T22:40:47.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:47 smithi112 ceph-mon[35032]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 923 op/s 2024-09-15T22:40:47.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:47 smithi110 ceph-mon[35282]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 923 op/s 2024-09-15T22:40:49.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:49 smithi022 ceph-mon[30634]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 271 MiB/s wr, 975 op/s 2024-09-15T22:40:49.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:49 smithi112 ceph-mon[35032]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 271 MiB/s wr, 975 op/s 2024-09-15T22:40:49.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:49 smithi110 ceph-mon[35282]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 271 MiB/s wr, 975 op/s 2024-09-15T22:40:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:51 smithi022 ceph-mon[30634]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 254 MiB/s wr, 912 op/s 2024-09-15T22:40:51.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:51 smithi112 ceph-mon[35032]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 254 MiB/s wr, 912 op/s 2024-09-15T22:40:51.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:51 smithi110 ceph-mon[35282]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 254 MiB/s wr, 912 op/s 2024-09-15T22:40:53.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:53 smithi112 ceph-mon[35032]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 957 op/s 2024-09-15T22:40:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:53 smithi110 ceph-mon[35282]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 957 op/s 2024-09-15T22:40:53.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:53 smithi022 ceph-mon[30634]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 270 MiB/s wr, 957 op/s 2024-09-15T22:40:55.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:55 smithi112 ceph-mon[35032]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 271 MiB/s wr, 959 op/s 2024-09-15T22:40:55.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:55 smithi110 ceph-mon[35282]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 271 MiB/s wr, 959 op/s 2024-09-15T22:40:55.787 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:55 smithi022 ceph-mon[30634]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 271 MiB/s wr, 959 op/s 2024-09-15T22:40:56.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:56 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:56.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:56 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:56.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:56 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:57 smithi110 ceph-mon[35282]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 258 MiB/s wr, 915 op/s 2024-09-15T22:40:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:57.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:40:57.752 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:57 smithi112 ceph-mon[35032]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 258 MiB/s wr, 915 op/s 2024-09-15T22:40:57.752 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:57.753 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:57.753 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:40:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:57 smithi022 ceph-mon[30634]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 258 MiB/s wr, 915 op/s 2024-09-15T22:40:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:40:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.447+0000 7fabfc200640 1 -- 172.21.15.22:0/2149431951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf410e130 msgr2=0x7fabf4110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.447+0000 7fabfc200640 1 --2- 172.21.15.22:0/2149431951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf410e130 0x7fabf4110520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fabec009be0 tx=0x7fabec02a710 comp rx=0 tx=0).stop 2024-09-15T22:40:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.447+0000 7fabfc200640 1 -- 172.21.15.22:0/2149431951 shutdown_connections 2024-09-15T22:40:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.447+0000 7fabfc200640 1 --2- 172.21.15.22:0/2149431951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4074c50 0x7fabf40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.448+0000 7fabfc200640 1 --2- 172.21.15.22:0/2149431951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf410e130 0x7fabf4110520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.448+0000 7fabfc200640 1 --2- 172.21.15.22:0/2149431951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf4076230 0x7fabf4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.448+0000 7fabfc200640 1 -- 172.21.15.22:0/2149431951 >> 172.21.15.22:0/2149431951 conn(0x7fabf40fd2e0 msgr2=0x7fabf40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.448+0000 7fabfc200640 1 -- 172.21.15.22:0/2149431951 shutdown_connections 2024-09-15T22:40:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.449+0000 7fabfc200640 1 -- 172.21.15.22:0/2149431951 wait complete. 2024-09-15T22:40:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.452+0000 7fabfc200640 1 Processor -- start 2024-09-15T22:40:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.452+0000 7fabfc200640 1 -- start start 2024-09-15T22:40:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.455+0000 7fabfc200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf4074c50 0x7fabf419e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.455+0000 7fabfc200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 0x7fabf419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabfc200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf410e130 0x7fabf41a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabf9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf4074c50 0x7fabf419e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabf8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 0x7fabf419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabf8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 0x7fabf419e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:34144/0 (socket says 172.21.15.22:34144) 2024-09-15T22:40:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabf9800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf4074c50 0x7fabf419e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55364/0 (socket says 172.21.15.22:55364) 2024-09-15T22:40:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabfc200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4113df0 con 0x7fabf4074c50 2024-09-15T22:40:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabfc200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4113c70 con 0x7fabf410e130 2024-09-15T22:40:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabfc200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4113f70 con 0x7fabf4076230 2024-09-15T22:40:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabfa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf410e130 0x7fabf41a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.456+0000 7fabf8e00640 1 -- 172.21.15.22:0/1154431463 learned_addr learned my addr 172.21.15.22:0/1154431463 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.457+0000 7fabf8e00640 1 -- 172.21.15.22:0/1154431463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf410e130 msgr2=0x7fabf41a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.457+0000 7fabf8e00640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf410e130 0x7fabf41a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.457+0000 7fabf8e00640 1 -- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf4074c50 msgr2=0x7fabf419e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.457+0000 7fabf8e00640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf4074c50 0x7fabf419e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.457+0000 7fabf8e00640 1 -- 172.21.15.22:0/1154431463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf41a5f70 con 0x7fabf4076230 2024-09-15T22:40:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.457+0000 7fabfa200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf410e130 0x7fabf41a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.458+0000 7fabf8e00640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 0x7fabf419e890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fabe000e9f0 tx=0x7fabe000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.462+0000 7fabf2000640 1 -- 172.21.15.22:0/1154431463 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe000cd80 con 0x7fabf4076230 2024-09-15T22:40:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.462+0000 7fabf2000640 1 -- 172.21.15.22:0/1154431463 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe0010910 con 0x7fabf4076230 2024-09-15T22:40:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.462+0000 7fabf2000640 1 -- 172.21.15.22:0/1154431463 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0018990 con 0x7fabf4076230 2024-09-15T22:40:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.462+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf41a6260 con 0x7fabf4076230 2024-09-15T22:40:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.462+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf41a6760 con 0x7fabf4076230 2024-09-15T22:40:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.490+0000 7fabf2000640 1 -- 172.21.15.22:0/1154431463 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fabe0010ac0 con 0x7fabf4076230 2024-09-15T22:40:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.494+0000 7fabf2000640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fabdc0a33f0 0x7fabdc0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.496 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.494+0000 7fabf2000640 1 -- 172.21.15.22:0/1154431463 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fabe00cfc00 con 0x7fabf4076230 2024-09-15T22:40:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.500+0000 7fabf9800640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fabdc0a33f0 0x7fabdc0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.501+0000 7fabf9800640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fabdc0a33f0 0x7fabdc0a58b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fabe80045f0 tx=0x7fabe800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.502+0000 7fabff21c740 1 Processor -- start 2024-09-15T22:40:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.511+0000 7fabff21c740 1 -- start start 2024-09-15T22:40:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.511+0000 7fabff21c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc96490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.511+0000 7fabff21c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bc9b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.511+0000 7fabff21c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc9df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.512+0000 7fabff21c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859bbfb100 con 0x55859bc969d0 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.512+0000 7fabff21c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55859bba31b0 con 0x55859bc9ba60 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.512+0000 7fabff21c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55859bbf70c0 con 0x55859bc96090 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.513+0000 7fabf9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc96490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.513+0000 7fabf9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc96490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:34152/0 (socket says 172.21.15.22:34152) 2024-09-15T22:40:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.513+0000 7fabf9800640 1 -- 172.21.15.22:0/104520800 learned_addr learned my addr 172.21.15.22:0/104520800 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.513+0000 7fabf8e00640 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bc9b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.513+0000 7fabfa200640 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc9df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.514+0000 7fabf8e00640 1 -- 172.21.15.22:0/104520800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 msgr2=0x55859bc96490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.514+0000 7fabf8e00640 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc96490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.514+0000 7fabf8e00640 1 -- 172.21.15.22:0/104520800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 msgr2=0x55859bc9df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.514+0000 7fabf8e00640 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc9df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.514+0000 7fabf8e00640 1 -- 172.21.15.22:0/104520800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859b90e210 con 0x55859bc969d0 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.514+0000 7fabf8e00640 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bc9b490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fabe000e9c0 tx=0x7fabe009bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107f7fd80346cf03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.515+0000 7fabe6a00640 1 -- 172.21.15.22:0/104520800 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00cd7d0 con 0x55859bc969d0 2024-09-15T22:40:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.515+0000 7fabe6a00640 1 -- 172.21.15.22:0/104520800 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe0098900 con 0x55859bc969d0 2024-09-15T22:40:58.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.516+0000 7fabff21c740 1 -- 172.21.15.22:0/104520800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 msgr2=0x55859bc9b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.516+0000 7fabff21c740 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bc9b490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fabe000e9c0 tx=0x7fabe009bce0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 -- 172.21.15.22:0/104520800 shutdown_connections 2024-09-15T22:40:58.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc9df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.520 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bc9b490 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 --2- 172.21.15.22:0/104520800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc96490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 -- 172.21.15.22:0/104520800 >> 172.21.15.22:0/104520800 conn(0x55859bc91700 msgr2=0x55859bc91b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 -- 172.21.15.22:0/104520800 shutdown_connections 2024-09-15T22:40:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.517+0000 7fabff21c740 1 -- 172.21.15.22:0/104520800 wait complete. 2024-09-15T22:40:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.518+0000 7fabff21c740 1 -- start start 2024-09-15T22:40:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.518+0000 7fabff21c740 1 Processor -- start 2024-09-15T22:40:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 0x55859bcb1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc9ba60 0x55859bcb8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859bcafa80 con 0x55859bc9ba60 2024-09-15T22:40:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55859bb84090 con 0x55859bc969d0 2024-09-15T22:40:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55859bcafc00 con 0x55859bc96090 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabf8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 0x55859bcb1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabf8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 0x55859bcb1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:36088/0 (socket says 172.21.15.22:36088) 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.521+0000 7fabff21c740 10 client.0 _ll_register_callbacks cb 0x55859bbd8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf8e00640 1 -- 172.21.15.22:0/534448522 learned_addr learned my addr 172.21.15.22:0/534448522 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf9800640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf8e00640 1 -- 172.21.15.22:0/534448522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 msgr2=0x55859bcb11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf8e00640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf8e00640 1 -- 172.21.15.22:0/534448522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc9ba60 msgr2=0x55859bcb8750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:40:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf8e00640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc9ba60 0x55859bcb8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf8e00640 1 -- 172.21.15.22:0/534448522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859b9da620 con 0x55859bc969d0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.522+0000 7fabf9800640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabf8e00640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 0x55859bcb1710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fabe00097b0 tx=0x7fabe0098660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=272a044752563cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabdb400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabdb400640 1 -- 172.21.15.22:0/534448522 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00a0340 con 0x55859bc969d0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabdb400640 1 -- 172.21.15.22:0/534448522 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fabe00cd7d0 con 0x55859bc969d0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabe0098900 con 0x55859bc969d0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabdb400640 1 -- 172.21.15.22:0/534448522 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fabe009b6e0 con 0x55859bc969d0 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabff21c740 10 client.25640 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.523+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55859bcbb540 con 0x55859bc969d0 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabdb400640 1 -- 172.21.15.22:0/534448522 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe0098900 con 0x55859bc969d0 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabdb400640 1 -- 172.21.15.22:0/534448522 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fabe009b1e0 con 0x55859bc969d0 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabff21c740 10 client.25640 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabff21c740 10 client.25640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabff21c740 20 client.25640 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabff21c740 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bcbc890 0x55859bcbec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabff21c740 4 client.25640 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:40:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.524+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55859bc08830 con 0x55859bcbc890 2024-09-15T22:40:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.525+0000 7fabf9800640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bcbc890 0x55859bcbec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.525+0000 7fabf9800640 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bcbc890 0x55859bcbec80 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27b09e34da0344af server_cookie=b1778ac9f8963f9e in_seq=0 out_seq=0 2024-09-15T22:40:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.525+0000 7fabdb400640 10 client.25640 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.526+0000 7fabdb400640 1 -- 172.21.15.22:0/534448522 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55859bc08830 con 0x55859bcbc890 2024-09-15T22:40:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.526+0000 7fabdb400640 10 client.25640 handle_command_reply: tid=0 2024-09-15T22:40:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.526+0000 7fabff21c740 1 client.25640 shutdown 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 msgr2=0x55859bcb1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 0x55859bcb1710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fabe00097b0 tx=0x7fabe0098660 comp rx=0 tx=0).stop 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 shutdown_connections 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bcbc890 0x55859bcbec80 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc9ba60 0x55859bcb8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc969d0 0x55859bcb1710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 --2- 172.21.15.22:0/534448522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 >> 172.21.15.22:0/534448522 conn(0x55859bc91700 msgr2=0x55859bc92f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.528+0000 7fabdb400640 0 client.25640 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.529+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 shutdown_connections 2024-09-15T22:40:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.529+0000 7fabff21c740 1 -- 172.21.15.22:0/534448522 wait complete. 2024-09-15T22:40:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.530+0000 7fabff21c740 20 client.25640 trim_cache size 0 max 16384 2024-09-15T22:40:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.548+0000 7fabff21c740 1 Processor -- start 2024-09-15T22:40:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.548+0000 7fabff21c740 1 -- start start 2024-09-15T22:40:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabff21c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc90770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabff21c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabff21c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc90cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabff21c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fabf41a9830 con 0x55859bc969d0 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabff21c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fabf41a7100 con 0x55859bc9ba60 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabff21c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabf40728d0 con 0x55859bc96090 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabfa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc90cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabfa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc90cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:36102/0 (socket says 172.21.15.22:36102) 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabfa200640 1 -- 172.21.15.22:0/4046809874 learned_addr learned my addr 172.21.15.22:0/4046809874 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.549+0000 7fabf9800640 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc90770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabfa200640 1 -- 172.21.15.22:0/4046809874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 msgr2=0x55859bc90770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabfa200640 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc90770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabfa200640 1 -- 172.21.15.22:0/4046809874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 msgr2=0x55859bcb8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabfa200640 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabfa200640 1 -- 172.21.15.22:0/4046809874 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859bc971a0 con 0x55859bc9ba60 2024-09-15T22:40:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabf9800640 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc90770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:40:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.550+0000 7fabfa200640 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc90cb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fabec009be0 tx=0x7fabec005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9273d8179d4cd3a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.551+0000 7fabe6000640 1 -- 172.21.15.22:0/4046809874 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec036040 con 0x55859bc9ba60 2024-09-15T22:40:58.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.552+0000 7fabe6000640 1 -- 172.21.15.22:0/4046809874 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabec030d80 con 0x55859bc9ba60 2024-09-15T22:40:58.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.552+0000 7fabe6000640 1 -- 172.21.15.22:0/4046809874 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec048bd0 con 0x55859bc9ba60 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 -- 172.21.15.22:0/4046809874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 msgr2=0x55859bc90cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc90cb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fabec009be0 tx=0x7fabec005e80 comp rx=0 tx=0).stop 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 -- 172.21.15.22:0/4046809874 shutdown_connections 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bc90cb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 --2- 172.21.15.22:0/4046809874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bc90770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 -- 172.21.15.22:0/4046809874 >> 172.21.15.22:0/4046809874 conn(0x55859bc91700 msgr2=0x55859bc90060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 -- 172.21.15.22:0/4046809874 shutdown_connections 2024-09-15T22:40:58.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.554+0000 7fabff21c740 1 -- 172.21.15.22:0/4046809874 wait complete. 2024-09-15T22:40:58.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.555+0000 7fabff21c740 1 -- start start 2024-09-15T22:40:58.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.555+0000 7fabff21c740 1 Processor -- start 2024-09-15T22:40:58.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bcb6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4072f60 con 0x55859bc969d0 2024-09-15T22:40:58.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fabf41a6a80 con 0x55859bc9ba60 2024-09-15T22:40:58.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4073630 con 0x55859bc96090 2024-09-15T22:40:58.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabff21c740 10 client.0 _ll_register_callbacks cb 0x7fabe009c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:40:58.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabfa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bcb6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabfa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bcb6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:36114/0 (socket says 172.21.15.22:36114) 2024-09-15T22:40:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.556+0000 7fabfa200640 1 -- 172.21.15.22:0/894587066 learned_addr learned my addr 172.21.15.22:0/894587066 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:40:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf8e00640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf9800640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf8e00640 1 -- 172.21.15.22:0/894587066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 msgr2=0x55859bcb5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf8e00640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf8e00640 1 -- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 msgr2=0x55859bcb6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:40:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf8e00640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bcb6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.557+0000 7fabf8e00640 1 -- 172.21.15.22:0/894587066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859bcb7480 con 0x55859bc969d0 2024-09-15T22:40:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.562+0000 7fabf8e00640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb5e60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fabe0098c60 tx=0x7fabe0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d51685502199c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.562+0000 7fabdb400640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:40:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.574+0000 7fabdb400640 1 -- 172.21.15.22:0/894587066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00bc220 con 0x55859bc969d0 2024-09-15T22:40:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.576+0000 7fabdb400640 1 -- 172.21.15.22:0/894587066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fabe009b360 con 0x55859bc969d0 2024-09-15T22:40:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.576+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabec030d80 con 0x55859bc969d0 2024-09-15T22:40:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.585+0000 7fabdb400640 1 -- 172.21.15.22:0/894587066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fabe00a0340 con 0x55859bc969d0 2024-09-15T22:40:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.585+0000 7fabff21c740 10 client.15573 fetch_fsmap learned FSMap version 25 2024-09-15T22:40:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.585+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55859bcb7480 con 0x55859bc969d0 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabdb400640 1 -- 172.21.15.22:0/894587066 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabec030d80 con 0x55859bc969d0 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabdb400640 1 -- 172.21.15.22:0/894587066 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fabe0005040 con 0x55859bc969d0 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabff21c740 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabff21c740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabff21c740 20 client.15573 populate_metadata read hostname 'smithi022' 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabff21c740 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bd27520 0x55859bd29910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabff21c740 4 client.15573 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:40:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.587+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55859bc02b80 con 0x55859bd27520 2024-09-15T22:40:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.588+0000 7fabf9800640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bd27520 0x55859bd29910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.589+0000 7fabf9800640 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bd27520 0x55859bd29910 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=709a09f1df9f71b3 server_cookie=fef1613fb68db425 in_seq=0 out_seq=0 2024-09-15T22:40:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.589+0000 7fabdb400640 10 client.15573 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.620+0000 7fabdb400640 1 -- 172.21.15.22:0/894587066 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55859bc02b80 con 0x55859bd27520 2024-09-15T22:40:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.620+0000 7fabdb400640 10 client.15573 handle_command_reply: tid=0 2024-09-15T22:40:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.620+0000 7fabff21c740 1 client.15573 shutdown 2024-09-15T22:40:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.621+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 msgr2=0x55859bcb5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.621+0000 7fabff21c740 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb5e60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fabe0098c60 tx=0x7fabe0000bc0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 shutdown_connections 2024-09-15T22:40:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabff21c740 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55859bd27520 0x55859bd29910 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabff21c740 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55859bc9ba60 0x55859bcb6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabff21c740 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859bc969d0 0x55859bcb5e60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabff21c740 1 --2- 172.21.15.22:0/894587066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55859bc96090 0x55859bcb5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 >> 172.21.15.22:0/894587066 conn(0x55859bc91700 msgr2=0x55859bc90880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.622+0000 7fabdb400640 0 client.15573 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.623+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 shutdown_connections 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.623+0000 7fabff21c740 1 -- 172.21.15.22:0/894587066 wait complete. 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.623+0000 7fabff21c740 20 client.15573 trim_cache size 0 max 16384 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:40:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:40:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fabdc0a33f0 msgr2=0x7fabdc0a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fabdc0a33f0 0x7fabdc0a58b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fabe80045f0 tx=0x7fabe800b390 comp rx=0 tx=0).stop 2024-09-15T22:40:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 msgr2=0x7fabf419e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 0x7fabf419e890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fabe000e9f0 tx=0x7fabe000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 shutdown_connections 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabf4076230 0x7fabf419e890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fabdc0a33f0 0x7fabdc0a58b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabf410e130 0x7fabf41a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 --2- 172.21.15.22:0/1154431463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabf4074c50 0x7fabf419e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.627+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 >> 172.21.15.22:0/1154431463 conn(0x7fabf40fd2e0 msgr2=0x7fabf41014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.628+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 shutdown_connections 2024-09-15T22:40:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:40:58.628+0000 7fabfc200640 1 -- 172.21.15.22:0/1154431463 wait complete. 2024-09-15T22:40:59.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:40:59 smithi110 ceph-mon[35282]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 275 MiB/s wr, 967 op/s 2024-09-15T22:40:59.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:40:59 smithi022 ceph-mon[30634]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 275 MiB/s wr, 967 op/s 2024-09-15T22:40:59.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:40:59 smithi112 ceph-mon[35032]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 275 MiB/s wr, 967 op/s 2024-09-15T22:41:01.708 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:01 smithi110 ceph-mon[35282]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 911 op/s 2024-09-15T22:41:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:01 smithi022 ceph-mon[30634]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 911 op/s 2024-09-15T22:41:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:01 smithi112 ceph-mon[35032]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 260 MiB/s wr, 911 op/s 2024-09-15T22:41:03.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:03 smithi110 ceph-mon[35282]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 276 MiB/s wr, 971 op/s 2024-09-15T22:41:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:03 smithi022 ceph-mon[30634]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 276 MiB/s wr, 971 op/s 2024-09-15T22:41:03.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:03 smithi112 ceph-mon[35032]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 276 MiB/s wr, 971 op/s 2024-09-15T22:41:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:05 smithi110 ceph-mon[35282]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 265 MiB/s wr, 943 op/s 2024-09-15T22:41:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:05 smithi022 ceph-mon[30634]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 265 MiB/s wr, 943 op/s 2024-09-15T22:41:05.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:05 smithi112 ceph-mon[35032]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 265 MiB/s wr, 943 op/s 2024-09-15T22:41:07.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:07 smithi110 ceph-mon[35282]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 252 MiB/s wr, 905 op/s 2024-09-15T22:41:07.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:07 smithi022 ceph-mon[30634]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 252 MiB/s wr, 905 op/s 2024-09-15T22:41:07.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:07 smithi112 ceph-mon[35032]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 252 MiB/s wr, 905 op/s 2024-09-15T22:41:09.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:09 smithi022 ceph-mon[30634]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 972 op/s 2024-09-15T22:41:09.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:09 smithi112 ceph-mon[35032]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 972 op/s 2024-09-15T22:41:09.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:09 smithi110 ceph-mon[35282]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 972 op/s 2024-09-15T22:41:11.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:11 smithi022 ceph-mon[30634]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 907 op/s 2024-09-15T22:41:11.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:11 smithi112 ceph-mon[35032]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 907 op/s 2024-09-15T22:41:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.881+0000 7fbf0c000640 1 -- 172.21.15.22:0/3719323526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf040761d0 msgr2=0x7fbf04074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.881+0000 7fbf0c000640 1 --2- 172.21.15.22:0/3719323526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf040761d0 0x7fbf04074620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009900 tx=0x7fbef802a490 comp rx=0 tx=0).stop 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 -- 172.21.15.22:0/3719323526 shutdown_connections 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 --2- 172.21.15.22:0/3719323526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 0x7fbf0410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 --2- 172.21.15.22:0/3719323526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf04074bf0 0x7fbf04075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 --2- 172.21.15.22:0/3719323526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf040761d0 0x7fbf04074620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 -- 172.21.15.22:0/3719323526 >> 172.21.15.22:0/3719323526 conn(0x7fbf040fd2e0 msgr2=0x7fbf040ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 -- 172.21.15.22:0/3719323526 shutdown_connections 2024-09-15T22:41:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.882+0000 7fbf0c000640 1 -- 172.21.15.22:0/3719323526 wait complete. 2024-09-15T22:41:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.883+0000 7fbf0c000640 1 Processor -- start 2024-09-15T22:41:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.884+0000 7fbf0c000640 1 -- start start 2024-09-15T22:41:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.884+0000 7fbf0c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 0x7fbf04070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.884+0000 7fbf0c000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf040761d0 0x7fbf04071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.884+0000 7fbf0c000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 0x7fbf041aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.884+0000 7fbf09600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 0x7fbf04070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.884+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf040761d0 0x7fbf04071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf0a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 0x7fbf041aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf0a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 0x7fbf041aa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58700/0 (socket says 172.21.15.22:58700) 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf040761d0 0x7fbf04071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49046/0 (socket says 172.21.15.22:49046) 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf09600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 0x7fbf04070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:56224/0 (socket says 172.21.15.22:56224) 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf0a000640 1 -- 172.21.15.22:0/1882735884 learned_addr learned my addr 172.21.15.22:0/1882735884 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0410fa00 con 0x7fbf040761d0 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0410f880 con 0x7fbf04074bf0 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0410fb80 con 0x7fbf041099d0 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf09600640 1 -- 172.21.15.22:0/1882735884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 msgr2=0x7fbf041aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf09600640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 0x7fbf041aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf09600640 1 -- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf040761d0 msgr2=0x7fbf04071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf09600640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf040761d0 0x7fbf04071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.885+0000 7fbf09600640 1 -- 172.21.15.22:0/1882735884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf040716d0 con 0x7fbf04074bf0 2024-09-15T22:41:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.886+0000 7fbf09600640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 0x7fbf04070b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbef802a9b0 tx=0x7fbef8032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.886+0000 7fbf02000640 1 -- 172.21.15.22:0/1882735884 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef803f030 con 0x7fbf04074bf0 2024-09-15T22:41:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.886+0000 7fbf02000640 1 -- 172.21.15.22:0/1882735884 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef8003ce0 con 0x7fbf04074bf0 2024-09-15T22:41:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.886+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf041aa6b0 con 0x7fbf04074bf0 2024-09-15T22:41:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.886+0000 7fbf02000640 1 -- 172.21.15.22:0/1882735884 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8035070 con 0x7fbf04074bf0 2024-09-15T22:41:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.886+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf041aac20 con 0x7fbf04074bf0 2024-09-15T22:41:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.891+0000 7fbf0edf5740 1 Processor -- start 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.891+0000 7fbf02000640 1 -- 172.21.15.22:0/1882735884 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fbef8042030 con 0x7fbf04074bf0 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.891+0000 7fbf0edf5740 1 -- start start 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1734ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1739ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f173c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e7f1691100 con 0x55e7f173a270 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e7f16391b0 con 0x55e7f17348a0 2024-09-15T22:41:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e7f168d0c0 con 0x55e7f17351e0 2024-09-15T22:41:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf09600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1739ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf0a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1734ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf09600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1739ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58702/0 (socket says 172.21.15.22:58702) 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.892+0000 7fbf09600640 1 -- 172.21.15.22:0/175001925 learned_addr learned my addr 172.21.15.22:0/175001925 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf08c00640 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f173c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf09600640 1 -- 172.21.15.22:0/175001925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 msgr2=0x55e7f1734ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf09600640 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1734ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf09600640 1 -- 172.21.15.22:0/175001925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 msgr2=0x55e7f173c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf09600640 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f173c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf09600640 1 -- 172.21.15.22:0/175001925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f13a4210 con 0x55e7f17351e0 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf08c00640 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f173c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf02000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeec0a3370 0x7fbeec0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.893+0000 7fbf09600640 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1739ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbef80f5c20 tx=0x7fbef80f5c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2708d1d94bef5f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.894+0000 7fbf02000640 1 -- 172.21.15.22:0/1882735884 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbef80ef990 con 0x7fbf04074bf0 2024-09-15T22:41:11.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.894+0000 7fbf0a000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeec0a3370 0x7fbeec0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.894+0000 7fbef6600640 1 -- 172.21.15.22:0/175001925 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80b8300 con 0x55e7f17351e0 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.894+0000 7fbef6600640 1 -- 172.21.15.22:0/175001925 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef80c4c20 con 0x55e7f17351e0 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.894+0000 7fbef6600640 1 -- 172.21.15.22:0/175001925 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8005d50 con 0x55e7f17351e0 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 -- 172.21.15.22:0/175001925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 msgr2=0x55e7f1739ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1739ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbef80f5c20 tx=0x7fbef80f5c50 comp rx=0 tx=0).stop 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0a000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeec0a3370 0x7fbeec0a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009270 tx=0x7fbefc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 -- 172.21.15.22:0/175001925 shutdown_connections 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1739ca0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f173c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/175001925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1734ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 -- 172.21.15.22:0/175001925 >> 172.21.15.22:0/175001925 conn(0x55e7f1727700 msgr2=0x55e7f1727b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 -- 172.21.15.22:0/175001925 shutdown_connections 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 -- 172.21.15.22:0/175001925 wait complete. 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.895+0000 7fbf0edf5740 1 -- start start 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 Processor -- start 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f172d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f172dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1732c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e7f172bed0 con 0x55e7f173a270 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e7f161a090 con 0x55e7f17348a0 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e7f172c050 con 0x55e7f17351e0 2024-09-15T22:41:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf0edf5740 10 client.0 _ll_register_callbacks cb 0x55e7f166ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f172dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.896+0000 7fbf09600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f172d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f172dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:58714/0 (socket says 172.21.15.22:58714) 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 -- 172.21.15.22:0/125686127 learned_addr learned my addr 172.21.15.22:0/125686127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf0a000640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1732c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 -- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 msgr2=0x55e7f172d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f172d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 -- 172.21.15.22:0/125686127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 msgr2=0x55e7f1732c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1732c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 -- 172.21.15.22:0/125686127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f1470620 con 0x55e7f17351e0 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf0a000640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1732c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf09600640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f172d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf08c00640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f172dcb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbef0012700 tx=0x7fbef0012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac6a4e363cc7161 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbeeaa00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbeeaa00640 1 -- 172.21.15.22:0/125686127 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0004030 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.897+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef80c4c20 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbeeaa00640 1 -- 172.21.15.22:0/125686127 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbef00041d0 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbeeaa00640 1 -- 172.21.15.22:0/125686127 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbef00043d0 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbf0edf5740 10 client.25693 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e7f1751510 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbeeaa00640 1 -- 172.21.15.22:0/125686127 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef80c4c20 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbeeaa00640 1 -- 172.21.15.22:0/125686127 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbef0003bf0 con 0x55e7f17351e0 2024-09-15T22:41:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbf0edf5740 10 client.25693 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbf0edf5740 10 client.25693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbf0edf5740 20 client.25693 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.898+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f1752a60 0x55e7f1754e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.899+0000 7fbf0edf5740 4 client.25693 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.899+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7f169e830 con 0x55e7f1752a60 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.899+0000 7fbf09600640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f1752a60 0x55e7f1754e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.899+0000 7fbf09600640 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f1752a60 0x55e7f1754e50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f9b58e0e1c1f8 server_cookie=9f3cd55b28c5edd5 in_seq=0 out_seq=0 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.899+0000 7fbeeaa00640 10 client.25693 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbeeaa00640 1 -- 172.21.15.22:0/125686127 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7f169e830 con 0x55e7f1752a60 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbeeaa00640 10 client.25693 handle_command_reply: tid=0 2024-09-15T22:41:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 client.25693 shutdown 2024-09-15T22:41:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 msgr2=0x55e7f172dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f172dcb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbef0012700 tx=0x7fbef0012bc0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 shutdown_connections 2024-09-15T22:41:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f1752a60 0x55e7f1754e50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f172dcb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1732c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/125686127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f172d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 >> 172.21.15.22:0/125686127 conn(0x55e7f1727700 msgr2=0x55e7f1728f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.900+0000 7fbeeaa00640 0 client.25693 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.901+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 shutdown_connections 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.901+0000 7fbf0edf5740 1 -- 172.21.15.22:0/125686127 wait complete. 2024-09-15T22:41:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.901+0000 7fbf0edf5740 20 client.25693 trim_cache size 0 max 16384 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.928+0000 7fbf0edf5740 1 Processor -- start 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.928+0000 7fbf0edf5740 1 -- start start 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.928+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1726770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.928+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1728af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.928+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1729030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.929+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041b1e80 con 0x55e7f173a270 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.929+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041af750 con 0x55e7f17348a0 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.929+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041ad580 con 0x55e7f17351e0 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.929+0000 7fbf0a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1729030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1728af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1729030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49074/0 (socket says 172.21.15.22:49074) 2024-09-15T22:41:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 -- 172.21.15.22:0/2585750124 learned_addr learned my addr 172.21.15.22:0/2585750124 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf09600640 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1726770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 -- 172.21.15.22:0/2585750124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 msgr2=0x55e7f1728af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1728af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 -- 172.21.15.22:0/2585750124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 msgr2=0x55e7f1726770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1726770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.930+0000 7fbf0a000640 1 -- 172.21.15.22:0/2585750124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f1722d60 con 0x55e7f173a270 2024-09-15T22:41:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.931+0000 7fbf0a000640 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1729030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbefc011bb0 tx=0x7fbefc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b43a1fd7d78110 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.932+0000 7fbef5c00640 1 -- 172.21.15.22:0/2585750124 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc020b30 con 0x55e7f173a270 2024-09-15T22:41:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.932+0000 7fbef5c00640 1 -- 172.21.15.22:0/2585750124 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbefc020cd0 con 0x55e7f173a270 2024-09-15T22:41:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.932+0000 7fbef5c00640 1 -- 172.21.15.22:0/2585750124 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc005880 con 0x55e7f173a270 2024-09-15T22:41:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 -- 172.21.15.22:0/2585750124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 msgr2=0x55e7f1729030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1729030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbefc011bb0 tx=0x7fbefc017000 comp rx=0 tx=0).stop 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 -- 172.21.15.22:0/2585750124 shutdown_connections 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1728af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f173a270 0x55e7f1729030 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/2585750124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f17348a0 0x55e7f1726770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.933+0000 7fbf0edf5740 1 -- 172.21.15.22:0/2585750124 >> 172.21.15.22:0/2585750124 conn(0x55e7f1727700 msgr2=0x55e7f1726060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.934+0000 7fbf0edf5740 1 -- 172.21.15.22:0/2585750124 shutdown_connections 2024-09-15T22:41:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.934+0000 7fbf0edf5740 1 -- 172.21.15.22:0/2585750124 wait complete. 2024-09-15T22:41:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.934+0000 7fbf0edf5740 1 -- start start 2024-09-15T22:41:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.934+0000 7fbf0edf5740 1 Processor -- start 2024-09-15T22:41:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 0x55e7f1763cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1764210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f173a270 0x55e7f17bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041adc10 con 0x55e7f17348a0 2024-09-15T22:41:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041af080 con 0x55e7f173a270 2024-09-15T22:41:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041ae2e0 con 0x55e7f17351e0 2024-09-15T22:41:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.935+0000 7fbf0edf5740 10 client.0 _ll_register_callbacks cb 0x7fbef0009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 0x55e7f1763cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 0x55e7f1763cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49086/0 (socket says 172.21.15.22:49086) 2024-09-15T22:41:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 -- 172.21.15.22:0/1108154276 learned_addr learned my addr 172.21.15.22:0/1108154276 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf0a000640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f173a270 0x55e7f17bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf08c00640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1764210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 -- 172.21.15.22:0/1108154276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 msgr2=0x55e7f1764210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1764210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 -- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f173a270 msgr2=0x55e7f17bb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f173a270 0x55e7f17bb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.936+0000 7fbf09600640 1 -- 172.21.15.22:0/1108154276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f17bbaf0 con 0x55e7f17348a0 2024-09-15T22:41:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.937+0000 7fbf08c00640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1764210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.937+0000 7fbf09600640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 0x55e7f1763cd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbef8000c00 tx=0x7fbef8005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a0397e9fbe17e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.937+0000 7fbeeaa00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:41:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.937+0000 7fbeeaa00640 1 -- 172.21.15.22:0/1108154276 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80d4070 con 0x55e7f17348a0 2024-09-15T22:41:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.937+0000 7fbeeaa00640 1 -- 172.21.15.22:0/1108154276 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fbef803bd30 con 0x55e7f17348a0 2024-09-15T22:41:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.937+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbefc020cd0 con 0x55e7f17348a0 2024-09-15T22:41:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.938+0000 7fbeeaa00640 1 -- 172.21.15.22:0/1108154276 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbef8049040 con 0x55e7f17348a0 2024-09-15T22:41:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.938+0000 7fbf0edf5740 10 client.15591 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.939+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e7f17bce00 con 0x55e7f17348a0 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.939+0000 7fbeeaa00640 1 -- 172.21.15.22:0/1108154276 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbefc020cd0 con 0x55e7f17348a0 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.939+0000 7fbeeaa00640 1 -- 172.21.15.22:0/1108154276 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbef804c060 con 0x55e7f17348a0 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf0edf5740 10 client.15591 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf0edf5740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf0edf5740 20 client.15591 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f17bd430 0x55e7f17bf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf0edf5740 4 client.15591 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:41:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7f1698b80 con 0x55e7f17bd430 2024-09-15T22:41:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.940+0000 7fbf08c00640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f17bd430 0x55e7f17bf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.941+0000 7fbf08c00640 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f17bd430 0x55e7f17bf820 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c625d148a11cac9 server_cookie=7927d18c65bf3ca2 in_seq=0 out_seq=0 2024-09-15T22:41:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.941+0000 7fbeeaa00640 10 client.15591 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:11.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:11 smithi110 ceph-mon[35282]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 251 MiB/s wr, 907 op/s 2024-09-15T22:41:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbeeaa00640 1 -- 172.21.15.22:0/1108154276 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7f1698b80 con 0x55e7f17bd430 2024-09-15T22:41:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbeeaa00640 10 client.15591 handle_command_reply: tid=0 2024-09-15T22:41:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 client.15591 shutdown 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 msgr2=0x55e7f1763cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 0x55e7f1763cd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbef8000c00 tx=0x7fbef8005c90 comp rx=0 tx=0).stop 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 shutdown_connections 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55e7f17bd430 0x55e7f17bf820 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7f17351e0 0x55e7f1764210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e7f173a270 0x55e7f17bb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 --2- 172.21.15.22:0/1108154276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7f17348a0 0x55e7f1763cd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbeeaa00640 0 client.15591 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 >> 172.21.15.22:0/1108154276 conn(0x55e7f1727700 msgr2=0x55e7f1726880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 shutdown_connections 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.963+0000 7fbf0edf5740 1 -- 172.21.15.22:0/1108154276 wait complete. 2024-09-15T22:41:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0edf5740 20 client.15591 trim_cache size 0 max 16384 2024-09-15T22:41:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:41:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:41:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:41:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:41:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeec0a3370 msgr2=0x7fbeec0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeec0a3370 0x7fbeec0a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009270 tx=0x7fbefc009680 comp rx=0 tx=0).stop 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 msgr2=0x7fbf04070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 0x7fbf04070b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbef802a9b0 tx=0x7fbef8032ce0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 shutdown_connections 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf041099d0 0x7fbf041aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fbeec0a3370 0x7fbeec0a5830 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf040761d0 0x7fbf04071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 --2- 172.21.15.22:0/1882735884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf04074bf0 0x7fbf04070b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.964+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 >> 172.21.15.22:0/1882735884 conn(0x7fbf040fd2e0 msgr2=0x7fbf04105960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.965+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 shutdown_connections 2024-09-15T22:41:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:11.967+0000 7fbf0c000640 1 -- 172.21.15.22:0/1882735884 wait complete. 2024-09-15T22:41:13.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:13 smithi022 ceph-mon[30634]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 264 MiB/s wr, 956 op/s 2024-09-15T22:41:13.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:13 smithi112 ceph-mon[35032]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 264 MiB/s wr, 956 op/s 2024-09-15T22:41:13.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:13 smithi110 ceph-mon[35282]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 264 MiB/s wr, 956 op/s 2024-09-15T22:41:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:15 smithi022 ceph-mon[30634]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 260 MiB/s wr, 939 op/s 2024-09-15T22:41:15.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:15 smithi112 ceph-mon[35032]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 260 MiB/s wr, 939 op/s 2024-09-15T22:41:15.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:15 smithi110 ceph-mon[35282]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 260 MiB/s wr, 939 op/s 2024-09-15T22:41:17.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:17 smithi022 ceph-mon[30634]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 257 MiB/s wr, 923 op/s 2024-09-15T22:41:17.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:17 smithi112 ceph-mon[35032]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 257 MiB/s wr, 923 op/s 2024-09-15T22:41:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:17 smithi110 ceph-mon[35282]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 257 MiB/s wr, 923 op/s 2024-09-15T22:41:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:19 smithi022 ceph-mon[30634]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 279 MiB/s wr, 996 op/s 2024-09-15T22:41:19.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:19 smithi112 ceph-mon[35032]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 279 MiB/s wr, 996 op/s 2024-09-15T22:41:19.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:19 smithi110 ceph-mon[35282]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 279 MiB/s wr, 996 op/s 2024-09-15T22:41:21.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:21 smithi022 ceph-mon[30634]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 260 MiB/s wr, 927 op/s 2024-09-15T22:41:21.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:21 smithi112 ceph-mon[35032]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 260 MiB/s wr, 927 op/s 2024-09-15T22:41:21.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:21 smithi110 ceph-mon[35282]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 260 MiB/s wr, 927 op/s 2024-09-15T22:41:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:23 smithi022 ceph-mon[30634]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 272 MiB/s wr, 972 op/s 2024-09-15T22:41:23.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:23 smithi112 ceph-mon[35032]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 272 MiB/s wr, 972 op/s 2024-09-15T22:41:23.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:23 smithi110 ceph-mon[35282]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 272 MiB/s wr, 972 op/s 2024-09-15T22:41:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.180+0000 7f379a400640 1 -- 172.21.15.22:0/1877917057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3794104f00 msgr2=0x7f37941072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.180+0000 7f379a400640 1 --2- 172.21.15.22:0/1877917057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3794104f00 0x7f37941072f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3780009900 tx=0x7f378002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.188+0000 7f379a400640 1 -- 172.21.15.22:0/1877917057 shutdown_connections 2024-09-15T22:41:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.188+0000 7f379a400640 1 --2- 172.21.15.22:0/1877917057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794107830 0x7f3794109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.188+0000 7f379a400640 1 --2- 172.21.15.22:0/1877917057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3794104f00 0x7f37941072f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.188+0000 7f379a400640 1 --2- 172.21.15.22:0/1877917057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37941025d0 0x7f37941049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.188+0000 7f379a400640 1 -- 172.21.15.22:0/1877917057 >> 172.21.15.22:0/1877917057 conn(0x7f37940fc1b0 msgr2=0x7f37940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.189+0000 7f379a400640 1 -- 172.21.15.22:0/1877917057 shutdown_connections 2024-09-15T22:41:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.191+0000 7f379a400640 1 -- 172.21.15.22:0/1877917057 wait complete. 2024-09-15T22:41:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.192+0000 7f379a400640 1 Processor -- start 2024-09-15T22:41:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.193+0000 7f379a400640 1 -- start start 2024-09-15T22:41:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.194+0000 7f379a400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37941025d0 0x7f379419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.194+0000 7f379a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 0x7f379419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.194+0000 7f379a400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3794107830 0x7f37941a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.194+0000 7f379a400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f379410d8b0 con 0x7f3794107830 2024-09-15T22:41:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.194+0000 7f379a400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f379410d730 con 0x7f37941025d0 2024-09-15T22:41:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.194+0000 7f379a400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f379410da30 con 0x7f3794104f00 2024-09-15T22:41:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3792a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 0x7f379419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3792a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 0x7f379419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48472/0 (socket says 172.21.15.22:48472) 2024-09-15T22:41:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3792a00640 1 -- 172.21.15.22:0/3480633605 learned_addr learned my addr 172.21.15.22:0/3480633605 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3793e00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3794107830 0x7f37941a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3792a00640 1 -- 172.21.15.22:0/3480633605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37941025d0 msgr2=0x7f379419a000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:41:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3792a00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37941025d0 0x7f379419a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.195+0000 7f3792a00640 1 -- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3794107830 msgr2=0x7f37941a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.196+0000 7f3792a00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3794107830 0x7f37941a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.196+0000 7f3792a00640 1 -- 172.21.15.22:0/3480633605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37941a1c20 con 0x7f3794104f00 2024-09-15T22:41:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.197+0000 7f3792a00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 0x7f379419a540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3780031530 tx=0x7f37800049d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.198+0000 7f378be00640 1 -- 172.21.15.22:0/3480633605 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780040070 con 0x7f3794104f00 2024-09-15T22:41:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.198+0000 7f378be00640 1 -- 172.21.15.22:0/3480633605 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37800035f0 con 0x7f3794104f00 2024-09-15T22:41:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.198+0000 7f378be00640 1 -- 172.21.15.22:0/3480633605 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378003c6b0 con 0x7f3794104f00 2024-09-15T22:41:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.198+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37941a1eb0 con 0x7f3794104f00 2024-09-15T22:41:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.198+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37941a22c0 con 0x7f3794104f00 2024-09-15T22:41:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.203+0000 7f379d1c8740 1 Processor -- start 2024-09-15T22:41:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.205+0000 7f378be00640 1 -- 172.21.15.22:0/3480633605 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3780043070 con 0x7f3794104f00 2024-09-15T22:41:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.205+0000 7f379d1c8740 1 -- start start 2024-09-15T22:41:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.205+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59d8a0 0x557a3b59dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.205+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59e1e0 0x557a3b5a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f379d1c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a3b4fa100 con 0x557a3b59d8a0 2024-09-15T22:41:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f379d1c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557a3b4a21b0 con 0x557a3b59e1e0 2024-09-15T22:41:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f379d1c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557a3b4f60c0 con 0x557a3b5a3270 2024-09-15T22:41:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f3792a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f3792a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48474/0 (socket says 172.21.15.22:48474) 2024-09-15T22:41:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f3792a00640 1 -- 172.21.15.22:0/506117067 learned_addr learned my addr 172.21.15.22:0/506117067 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.206+0000 7f3793400640 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59e1e0 0x557a3b5a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3793e00640 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59d8a0 0x557a3b59dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3792a00640 1 -- 172.21.15.22:0/506117067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59e1e0 msgr2=0x557a3b5a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3792a00640 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59e1e0 0x557a3b5a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3792a00640 1 -- 172.21.15.22:0/506117067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59d8a0 msgr2=0x557a3b59dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3792a00640 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59d8a0 0x557a3b59dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3792a00640 1 -- 172.21.15.22:0/506117067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b20d210 con 0x557a3b5a3270 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f378be00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f37780a34a0 0x7f37780a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.207+0000 7f3792a00640 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5a5730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37800f6c20 tx=0x7f37800f6d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618691998d694f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.208+0000 7f378be00640 1 -- 172.21.15.22:0/3480633605 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f37800f0840 con 0x7f3794104f00 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.208+0000 7f3793e00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f37780a34a0 0x7f37780a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.208+0000 7f3788c00640 1 -- 172.21.15.22:0/506117067 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37800b90c0 con 0x557a3b5a3270 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.208+0000 7f3788c00640 1 -- 172.21.15.22:0/506117067 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37800bd520 con 0x557a3b5a3270 2024-09-15T22:41:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.208+0000 7f3788c00640 1 -- 172.21.15.22:0/506117067 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37800bc780 con 0x557a3b5a3270 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 -- 172.21.15.22:0/506117067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 msgr2=0x557a3b5a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5a5730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37800f6c20 tx=0x7f37800f6d10 comp rx=0 tx=0).stop 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f3793e00640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f37780a34a0 0x7f37780a5960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f379406b460 tx=0x7f378c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 -- 172.21.15.22:0/506117067 shutdown_connections 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5a5730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59e1e0 0x557a3b5a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 --2- 172.21.15.22:0/506117067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59d8a0 0x557a3b59dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.209+0000 7f379d1c8740 1 -- 172.21.15.22:0/506117067 >> 172.21.15.22:0/506117067 conn(0x557a3b598f10 msgr2=0x557a3b599310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.210+0000 7f379d1c8740 1 -- 172.21.15.22:0/506117067 shutdown_connections 2024-09-15T22:41:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.210+0000 7f379d1c8740 1 -- 172.21.15.22:0/506117067 wait complete. 2024-09-15T22:41:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.210+0000 7f379d1c8740 1 -- start start 2024-09-15T22:41:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 Processor -- start 2024-09-15T22:41:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a3b5b7010 con 0x557a3b59e1e0 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557a3b483090 con 0x557a3b59d8a0 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557a3b5b7190 con 0x557a3b5a3270 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.211+0000 7f379d1c8740 10 client.0 _ll_register_callbacks cb 0x557a3b4d7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3793e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3792a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3793e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48490/0 (socket says 172.21.15.22:48490) 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3793e00640 1 -- 172.21.15.22:0/2030034087 learned_addr learned my addr 172.21.15.22:0/2030034087 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3793400640 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3792a00640 1 -- 172.21.15.22:0/2030034087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 msgr2=0x557a3b5bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3792a00640 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3792a00640 1 -- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 msgr2=0x557a3b5b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3792a00640 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.212+0000 7f3792a00640 1 -- 172.21.15.22:0/2030034087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3b2d9620 con 0x557a3b59e1e0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f3792a00640 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5b8d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37800f6820 tx=0x7f37800f6380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e963e0f392ff626c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f377d600640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f377d600640 1 -- 172.21.15.22:0/2030034087 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780035030 con 0x557a3b59e1e0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f377d600640 1 -- 172.21.15.22:0/2030034087 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f3780004e90 con 0x557a3b59e1e0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37800bd520 con 0x557a3b59e1e0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f377d600640 1 -- 172.21.15.22:0/2030034087 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f37800bc960 con 0x557a3b59e1e0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f379d1c8740 10 client.15600 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.213+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a3b5b7010 con 0x557a3b59e1e0 2024-09-15T22:41:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f377d600640 1 -- 172.21.15.22:0/2030034087 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37800bd520 con 0x557a3b59e1e0 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f377d600640 1 -- 172.21.15.22:0/2030034087 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f37800c5ce0 con 0x557a3b59e1e0 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f379d1c8740 10 client.15600 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f379d1c8740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f379d1c8740 20 client.15600 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f379d1c8740 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b5c4050 0x557a3b5c6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f379d1c8740 4 client.15600 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a3b507830 con 0x557a3b5c4050 2024-09-15T22:41:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.214+0000 7f3793400640 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b5c4050 0x557a3b5c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.215+0000 7f3793400640 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b5c4050 0x557a3b5c6470 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f461892c8d6a4d0 server_cookie=3c516de99ac944d0 in_seq=0 out_seq=0 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.215+0000 7f377d600640 10 client.15600 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f377d600640 1 -- 172.21.15.22:0/2030034087 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a3b507830 con 0x557a3b5c4050 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f377d600640 10 client.15600 handle_command_reply: tid=0 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 client.15600 shutdown 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 msgr2=0x557a3b5b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5b8d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37800f6820 tx=0x7f37800f6380 comp rx=0 tx=0).stop 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 shutdown_connections 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b5c4050 0x557a3b5c6470 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b5a3270 0x557a3b5bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5b8d60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 --2- 172.21.15.22:0/2030034087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f377d600640 0 client.15600 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 >> 172.21.15.22:0/2030034087 conn(0x557a3b598f10 msgr2=0x557a3b59a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 shutdown_connections 2024-09-15T22:41:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.216+0000 7f379d1c8740 1 -- 172.21.15.22:0/2030034087 wait complete. 2024-09-15T22:41:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.217+0000 7f379d1c8740 20 client.15600 trim_cache size 0 max 16384 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 Processor -- start 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 -- start start 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 0x557a3b5b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b5a3270 0x557a3b599dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3774010d80 con 0x557a3b59e1e0 2024-09-15T22:41:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f377400e650 con 0x557a3b5a3270 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.248+0000 7f379d1c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f377400c480 con 0x557a3b59d8a0 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 0x557a3b5b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3792a00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b5a3270 0x557a3b599dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 0x557a3b5b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48504/0 (socket says 172.21.15.22:48504) 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 -- 172.21.15.22:0/682879854 learned_addr learned my addr 172.21.15.22:0/682879854 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b5a3270 0x557a3b599dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53268/0 (socket says 172.21.15.22:53268) 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 -- 172.21.15.22:0/682879854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b5a3270 msgr2=0x557a3b599dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b5a3270 0x557a3b599dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 -- 172.21.15.22:0/682879854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 msgr2=0x557a3b5bfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5bfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 -- 172.21.15.22:0/682879854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b58bd30 con 0x557a3b59d8a0 2024-09-15T22:41:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.249+0000 7f3793400640 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 0x557a3b5b81b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f37840098d0 tx=0x7f37840090e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187df50008c82cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.250+0000 7f377fe00640 1 -- 172.21.15.22:0/682879854 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784016950 con 0x557a3b59d8a0 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.250+0000 7f377fe00640 1 -- 172.21.15.22:0/682879854 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f378401c2c0 con 0x557a3b59d8a0 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.250+0000 7f377fe00640 1 -- 172.21.15.22:0/682879854 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784014670 con 0x557a3b59d8a0 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 -- 172.21.15.22:0/682879854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 msgr2=0x557a3b5b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 0x557a3b5b81b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f37840098d0 tx=0x7f37840090e0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 -- 172.21.15.22:0/682879854 shutdown_connections 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b5a3270 0x557a3b599dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b59e1e0 0x557a3b5bfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 --2- 172.21.15.22:0/682879854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59d8a0 0x557a3b5b81b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 -- 172.21.15.22:0/682879854 >> 172.21.15.22:0/682879854 conn(0x557a3b598f10 msgr2=0x557a3b5b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 -- 172.21.15.22:0/682879854 shutdown_connections 2024-09-15T22:41:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 -- 172.21.15.22:0/682879854 wait complete. 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.251+0000 7f379d1c8740 1 -- start start 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 Processor -- start 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5bd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 0x557a3b5bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b5a3270 0x557a3b5beb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f377400cb10 con 0x557a3b5a3270 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f377400df80 con 0x557a3b59d8a0 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f377400d1e0 con 0x557a3b59e1e0 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f379d1c8740 10 client.0 _ll_register_callbacks cb 0x7f3784006ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f3792a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 0x557a3b5bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f3793400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f3792a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 0x557a3b5bdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:48518/0 (socket says 172.21.15.22:48518) 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.252+0000 7f3792a00640 1 -- 172.21.15.22:0/744236077 learned_addr learned my addr 172.21.15.22:0/744236077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793e00640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b5a3270 0x557a3b5beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793400640 1 -- 172.21.15.22:0/744236077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 msgr2=0x557a3b5bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793400640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 0x557a3b5bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793400640 1 -- 172.21.15.22:0/744236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b5a3270 msgr2=0x557a3b5beb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793400640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b5a3270 0x557a3b5beb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793400640 1 -- 172.21.15.22:0/744236077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3b5bf160 con 0x557a3b59d8a0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3792a00640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 0x557a3b5bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f3793400640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5bd650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3784004810 tx=0x7f37840093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7669b2bcd1062357 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f377d600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f377d600640 1 -- 172.21.15.22:0/744236077 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378401c470 con 0x557a3b59d8a0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378401c2c0 con 0x557a3b59d8a0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.253+0000 7f377d600640 1 -- 172.21.15.22:0/744236077 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f378401c610 con 0x557a3b59d8a0 2024-09-15T22:41:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f377d600640 1 -- 172.21.15.22:0/744236077 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f378401c810 con 0x557a3b59d8a0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 10 client.25676 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a3b62ee80 con 0x557a3b59d8a0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f377d600640 1 -- 172.21.15.22:0/744236077 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f378401c2c0 con 0x557a3b59d8a0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f377d600640 1 -- 172.21.15.22:0/744236077 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f37840304d0 con 0x557a3b59d8a0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 10 client.25676 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 20 client.25676 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b62f7d0 0x557a3b631bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 4 client.25676 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.254+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a3b501b80 con 0x557a3b62f7d0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.255+0000 7f3792a00640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b62f7d0 0x557a3b631bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.255+0000 7f3792a00640 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b62f7d0 0x557a3b631bf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c571d1a05147f4d server_cookie=7770b07eb0e5c479 in_seq=0 out_seq=0 2024-09-15T22:41:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.255+0000 7f377d600640 10 client.25676 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f377d600640 1 -- 172.21.15.22:0/744236077 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a3b501b80 con 0x557a3b62f7d0 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f377d600640 10 client.25676 handle_command_reply: tid=0 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 client.25676 shutdown 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 msgr2=0x557a3b5bd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5bd650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3784004810 tx=0x7f37840093b0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 shutdown_connections 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x557a3b62f7d0 0x557a3b631bf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557a3b59e1e0 0x557a3b5bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f377d600640 0 client.25676 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a3b5a3270 0x557a3b5beb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 --2- 172.21.15.22:0/744236077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557a3b59d8a0 0x557a3b5bd650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.271+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 >> 172.21.15.22:0/744236077 conn(0x557a3b598f10 msgr2=0x557a3b58f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.272+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 shutdown_connections 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.272+0000 7f379d1c8740 1 -- 172.21.15.22:0/744236077 wait complete. 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.272+0000 7f379d1c8740 20 client.25676 trim_cache size 0 max 16384 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:41:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:41:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:41:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:41:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f37780a34a0 msgr2=0x7f37780a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f37780a34a0 0x7f37780a5960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f379406b460 tx=0x7f378c009500 comp rx=0 tx=0).stop 2024-09-15T22:41:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 msgr2=0x7f379419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 0x7f379419a540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3780031530 tx=0x7f37800049d0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 shutdown_connections 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3794104f00 0x7f379419a540 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f37780a34a0 0x7f37780a5960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3794107830 0x7f37941a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 --2- 172.21.15.22:0/3480633605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37941025d0 0x7f379419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 >> 172.21.15.22:0/3480633605 conn(0x7f37940fc1b0 msgr2=0x7f3794101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 shutdown_connections 2024-09-15T22:41:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:25.273+0000 7f379a400640 1 -- 172.21.15.22:0/3480633605 wait complete. 2024-09-15T22:41:25.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:25 smithi112 ceph-mon[35032]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 267 MiB/s wr, 958 op/s 2024-09-15T22:41:25.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:25 smithi110 ceph-mon[35282]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 267 MiB/s wr, 958 op/s 2024-09-15T22:41:26.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:25 smithi022 ceph-mon[30634]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 267 MiB/s wr, 958 op/s 2024-09-15T22:41:27.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:27 smithi112 ceph-mon[35032]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 256 MiB/s wr, 922 op/s 2024-09-15T22:41:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:27 smithi110 ceph-mon[35282]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 256 MiB/s wr, 922 op/s 2024-09-15T22:41:28.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:27 smithi022 ceph-mon[30634]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 256 MiB/s wr, 922 op/s 2024-09-15T22:41:29.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:29 smithi112 ceph-mon[35032]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 272 MiB/s wr, 985 op/s 2024-09-15T22:41:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:29 smithi110 ceph-mon[35282]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 272 MiB/s wr, 985 op/s 2024-09-15T22:41:30.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:29 smithi022 ceph-mon[30634]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 272 MiB/s wr, 985 op/s 2024-09-15T22:41:31.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:31 smithi110 ceph-mon[35282]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 252 MiB/s wr, 911 op/s 2024-09-15T22:41:32.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:31 smithi022 ceph-mon[30634]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 252 MiB/s wr, 911 op/s 2024-09-15T22:41:32.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:31 smithi112 ceph-mon[35032]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 252 MiB/s wr, 911 op/s 2024-09-15T22:41:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:33 smithi110 ceph-mon[35282]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 272 MiB/s wr, 984 op/s 2024-09-15T22:41:34.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:33 smithi022 ceph-mon[30634]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 272 MiB/s wr, 984 op/s 2024-09-15T22:41:34.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:33 smithi112 ceph-mon[35032]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 272 MiB/s wr, 984 op/s 2024-09-15T22:41:35.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:35 smithi110 ceph-mon[35282]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 961 op/s 2024-09-15T22:41:36.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:35 smithi022 ceph-mon[30634]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 961 op/s 2024-09-15T22:41:36.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:35 smithi112 ceph-mon[35032]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 961 op/s 2024-09-15T22:41:37.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:37 smithi110 ceph-mon[35282]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 256 MiB/s wr, 924 op/s 2024-09-15T22:41:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:37 smithi022 ceph-mon[30634]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 256 MiB/s wr, 924 op/s 2024-09-15T22:41:38.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:37 smithi112 ceph-mon[35032]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 256 MiB/s wr, 924 op/s 2024-09-15T22:41:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 -- 172.21.15.22:0/2219070839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 msgr2=0x7f3934079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 --2- 172.21.15.22:0/2219070839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f3934079030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f392c009860 tx=0x7f392c02a340 comp rx=0 tx=0).stop 2024-09-15T22:41:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 -- 172.21.15.22:0/2219070839 shutdown_connections 2024-09-15T22:41:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 --2- 172.21.15.22:0/2219070839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f3934079030 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 --2- 172.21.15.22:0/2219070839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 0x7f3934078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 --2- 172.21.15.22:0/2219070839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 0x7f3934076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 -- 172.21.15.22:0/2219070839 >> 172.21.15.22:0/2219070839 conn(0x7f39340ff4b0 msgr2=0x7f39341018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 -- 172.21.15.22:0/2219070839 shutdown_connections 2024-09-15T22:41:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.551+0000 7f393a400640 1 -- 172.21.15.22:0/2219070839 wait complete. 2024-09-15T22:41:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.553+0000 7f393a400640 1 Processor -- start 2024-09-15T22:41:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.553+0000 7f393a400640 1 -- start start 2024-09-15T22:41:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f393a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 0x7f393419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f393a400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 0x7f393419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f393a400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f39341a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f393a400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3934113e20 con 0x7f3934078790 2024-09-15T22:41:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f393a400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3934113ca0 con 0x7f3934077df0 2024-09-15T22:41:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f393a400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3934113fa0 con 0x7f3934076bb0 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f3933400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 0x7f393419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f3933400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 0x7f393419e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41280/0 (socket says 172.21.15.22:41280) 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f3933400640 1 -- 172.21.15.22:0/1642797217 learned_addr learned my addr 172.21.15.22:0/1642797217 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.554+0000 7f392aa00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 0x7f393419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f3933e00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f39341a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f392aa00640 1 -- 172.21.15.22:0/1642797217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 msgr2=0x7f393419e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f392aa00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 0x7f393419e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f392aa00640 1 -- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 msgr2=0x7f39341a59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f392aa00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f39341a59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f392aa00640 1 -- 172.21.15.22:0/1642797217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39341038b0 con 0x7f3934077df0 2024-09-15T22:41:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f3933e00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f39341a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.555+0000 7f392aa00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 0x7f393419e930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e790 tx=0x7f391c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.556+0000 7f3930c00640 1 -- 172.21.15.22:0/1642797217 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c00eea0 con 0x7f3934077df0 2024-09-15T22:41:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.556+0000 7f3930c00640 1 -- 172.21.15.22:0/1642797217 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f391c00ccc0 con 0x7f3934077df0 2024-09-15T22:41:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.556+0000 7f3930c00640 1 -- 172.21.15.22:0/1642797217 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c018780 con 0x7f3934077df0 2024-09-15T22:41:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.556+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3934103ba0 con 0x7f3934077df0 2024-09-15T22:41:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.556+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39341040f0 con 0x7f3934077df0 2024-09-15T22:41:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.559+0000 7f393d3bf740 1 Processor -- start 2024-09-15T22:41:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 -- start start 2024-09-15T22:41:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15ebe490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f3930c00640 1 -- 172.21.15.22:0/1642797217 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f391c010430 con 0x7f3934077df0 2024-09-15T22:41:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15ebea60 0x559b15ec0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559b15e1e100 con 0x559b15ebea60 2024-09-15T22:41:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559b15dc61b0 con 0x559b15eb9090 2024-09-15T22:41:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.560+0000 7f393d3bf740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559b15e1a0c0 con 0x559b15eb99d0 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38056/0 (socket says 172.21.15.22:38056) 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 -- 172.21.15.22:0/1047571593 learned_addr learned my addr 172.21.15.22:0/1047571593 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f392aa00640 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15ebea60 0x559b15ec0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933400640 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15ebe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 -- 172.21.15.22:0/1047571593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 msgr2=0x559b15ebe490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15ebe490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 -- 172.21.15.22:0/1047571593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15ebea60 msgr2=0x559b15ec0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15ebea60 0x559b15ec0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.561+0000 7f3933e00640 1 -- 172.21.15.22:0/1047571593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b15b31210 con 0x559b15eb9090 2024-09-15T22:41:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.562+0000 7f3930c00640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f39180a3530 0x7f39180a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.562+0000 7f3933e00640 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb9490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f392c009530 tx=0x7f392c009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ccfba12005689b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.562+0000 7f3930c00640 1 -- 172.21.15.22:0/1642797217 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f391c0cfa60 con 0x7f3934077df0 2024-09-15T22:41:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.562+0000 7f3928c00640 1 -- 172.21.15.22:0/1047571593 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c040020 con 0x559b15eb9090 2024-09-15T22:41:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.562+0000 7f3928c00640 1 -- 172.21.15.22:0/1047571593 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f392c038040 con 0x559b15eb9090 2024-09-15T22:41:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.562+0000 7f3928c00640 1 -- 172.21.15.22:0/1047571593 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c037070 con 0x559b15eb9090 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.563+0000 7f3933400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f39180a3530 0x7f39180a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.563+0000 7f393d3bf740 1 -- 172.21.15.22:0/1047571593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 msgr2=0x559b15eb9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.563+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb9490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f392c009530 tx=0x7f392c009560 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 -- 172.21.15.22:0/1047571593 shutdown_connections 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15ebe490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15ebea60 0x559b15ec0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1047571593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb9490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 -- 172.21.15.22:0/1047571593 >> 172.21.15.22:0/1047571593 conn(0x559b15eb4700 msgr2=0x559b15eb4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f3933400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f39180a3530 0x7f39180a59f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x559b15eba400 tx=0x7f3924009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 -- 172.21.15.22:0/1047571593 shutdown_connections 2024-09-15T22:41:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.564+0000 7f393d3bf740 1 -- 172.21.15.22:0/1047571593 wait complete. 2024-09-15T22:41:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.565+0000 7f393d3bf740 1 -- start start 2024-09-15T22:41:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.565+0000 7f393d3bf740 1 Processor -- start 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb9090 0x559b15ec3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15ec3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15eca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559b15ec19d0 con 0x559b15eb99d0 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559b15da7090 con 0x559b15ebea60 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559b15ec1b50 con 0x559b15eb9090 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f393d3bf740 10 client.0 _ll_register_callbacks cb 0x559b15dfbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f3933400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb9090 0x559b15ec3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f3933400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb9090 0x559b15ec3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41304/0 (socket says 172.21.15.22:41304) 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f3933400640 1 -- 172.21.15.22:0/3258800607 learned_addr learned my addr 172.21.15.22:0/3258800607 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.566+0000 7f3933e00640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15eca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f392aa00640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15ec3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3933e00640 1 -- 172.21.15.22:0/3258800607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb9090 msgr2=0x559b15ec3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3933e00640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb9090 0x559b15ec3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3933e00640 1 -- 172.21.15.22:0/3258800607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 msgr2=0x559b15ec3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3933e00640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15ec3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3933e00640 1 -- 172.21.15.22:0/3258800607 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b15bfd620 con 0x559b15ebea60 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f392aa00640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15ec3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3933e00640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15eca7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f392c009250 tx=0x7f392c005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366fb4c065c97c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3921600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.567+0000 7f3921600640 1 -- 172.21.15.22:0/3258800607 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c049070 con 0x559b15ebea60 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f3921600640 1 -- 172.21.15.22:0/3258800607 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f392c0053c0 con 0x559b15ebea60 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f392c038040 con 0x559b15ebea60 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f3921600640 1 -- 172.21.15.22:0/3258800607 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f392c055050 con 0x559b15ebea60 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f393d3bf740 10 client.25688 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b15ecd5b0 con 0x559b15ebea60 2024-09-15T22:41:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f3921600640 1 -- 172.21.15.22:0/3258800607 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f392c038040 con 0x559b15ebea60 2024-09-15T22:41:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.568+0000 7f3921600640 1 -- 172.21.15.22:0/3258800607 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f392c0035f0 con 0x559b15ebea60 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.569+0000 7f393d3bf740 10 client.25688 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.569+0000 7f393d3bf740 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.569+0000 7f393d3bf740 20 client.25688 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.569+0000 7f393d3bf740 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15ece900 0x559b15ed0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.569+0000 7f393d3bf740 4 client.25688 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.569+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b15e2b830 con 0x559b15ece900 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.570+0000 7f3933400640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15ece900 0x559b15ed0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.570+0000 7f3933400640 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15ece900 0x559b15ed0cf0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b363d193f160ab server_cookie=cbef08874478edb2 in_seq=0 out_seq=0 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.570+0000 7f3921600640 10 client.25688 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.571+0000 7f3921600640 1 -- 172.21.15.22:0/3258800607 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b15e2b830 con 0x559b15ece900 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.571+0000 7f3921600640 10 client.25688 handle_command_reply: tid=0 2024-09-15T22:41:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.571+0000 7f393d3bf740 1 client.25688 shutdown 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.571+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 msgr2=0x559b15eca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.571+0000 7f393d3bf740 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15eca7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f392c009250 tx=0x7f392c005d30 comp rx=0 tx=0).stop 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 shutdown_connections 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15ece900 0x559b15ed0cf0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15eca7c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15ec3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 --2- 172.21.15.22:0/3258800607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb9090 0x559b15ec3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f3921600640 0 client.25688 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 >> 172.21.15.22:0/3258800607 conn(0x559b15eb4700 msgr2=0x559b15eb5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 shutdown_connections 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 1 -- 172.21.15.22:0/3258800607 wait complete. 2024-09-15T22:41:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.572+0000 7f393d3bf740 20 client.25688 trim_cache size 0 max 16384 2024-09-15T22:41:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.596+0000 7f393d3bf740 1 Processor -- start 2024-09-15T22:41:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.596+0000 7f393d3bf740 1 -- start start 2024-09-15T22:41:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15eca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15ebea60 0x559b15ed5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f393d3bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39341ba5d0 con 0x559b15eb99d0 2024-09-15T22:41:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f393d3bf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39341b7ea0 con 0x559b15eb9090 2024-09-15T22:41:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f393d3bf740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f393410ad70 con 0x559b15ebea60 2024-09-15T22:41:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f3933400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f3933400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:38070/0 (socket says 172.21.15.22:38070) 2024-09-15T22:41:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f3933400640 1 -- 172.21.15.22:0/2813088285 learned_addr learned my addr 172.21.15.22:0/2813088285 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f3933e00640 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15ebea60 0x559b15ed5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.597+0000 7f392aa00640 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15eca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f3933e00640 1 -- 172.21.15.22:0/2813088285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 msgr2=0x559b15eb3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f3933e00640 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f3933e00640 1 -- 172.21.15.22:0/2813088285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 msgr2=0x559b15eca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f3933e00640 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15eca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f3933e00640 1 -- 172.21.15.22:0/2813088285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b15ebe7f0 con 0x559b15ebea60 2024-09-15T22:41:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f392aa00640 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15eca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.598+0000 7f3933e00640 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15ebea60 0x559b15ed5570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f392c009780 tx=0x7f392c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99a657f9891c83c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.599+0000 7f3923e00640 1 -- 172.21.15.22:0/2813088285 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c052020 con 0x559b15ebea60 2024-09-15T22:41:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.599+0000 7f3923e00640 1 -- 172.21.15.22:0/2813088285 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f392c005520 con 0x559b15ebea60 2024-09-15T22:41:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.599+0000 7f3923e00640 1 -- 172.21.15.22:0/2813088285 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c049040 con 0x559b15ebea60 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 -- 172.21.15.22:0/2813088285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15ebea60 msgr2=0x559b15ed5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15ebea60 0x559b15ed5570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f392c009780 tx=0x7f392c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 -- 172.21.15.22:0/2813088285 shutdown_connections 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15ebea60 0x559b15ed5570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb99d0 0x559b15eca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 --2- 172.21.15.22:0/2813088285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15eb9090 0x559b15eb3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 -- 172.21.15.22:0/2813088285 >> 172.21.15.22:0/2813088285 conn(0x559b15eb4700 msgr2=0x559b15eb3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 -- 172.21.15.22:0/2813088285 shutdown_connections 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.600+0000 7f393d3bf740 1 -- 172.21.15.22:0/2813088285 wait complete. 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 -- start start 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 Processor -- start 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb9090 0x559b15eca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15eca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15ec8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f393410b400 con 0x559b15eb9090 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39341b77d0 con 0x559b15ebea60 2024-09-15T22:41:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f393410bad0 con 0x559b15eb99d0 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.601+0000 7f393d3bf740 10 client.0 _ll_register_callbacks cb 0x7f391c0d2f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb9090 0x559b15eca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f392aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15eca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f392aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15eca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:41332/0 (socket says 172.21.15.22:41332) 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f392aa00640 1 -- 172.21.15.22:0/1944881197 learned_addr learned my addr 172.21.15.22:0/1944881197 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933e00640 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15ec8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933e00640 1 -- 172.21.15.22:0/1944881197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 msgr2=0x559b15eca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933e00640 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15eca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933e00640 1 -- 172.21.15.22:0/1944881197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb9090 msgr2=0x559b15eca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933e00640 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb9090 0x559b15eca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.602+0000 7f3933e00640 1 -- 172.21.15.22:0/1944881197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b15ec9060 con 0x559b15ebea60 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.603+0000 7f3933e00640 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15ec8830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x559b15ebe1e0 tx=0x7f392c004010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74cd5272d4e1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.603+0000 7f3921600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.603+0000 7f3921600640 1 -- 172.21.15.22:0/1944881197 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c052070 con 0x559b15ebea60 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.604+0000 7f3921600640 1 -- 172.21.15.22:0/1944881197 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f392c032440 con 0x559b15ebea60 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.604+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f392c005520 con 0x559b15ebea60 2024-09-15T22:41:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.604+0000 7f3921600640 1 -- 172.21.15.22:0/1944881197 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f392c040070 con 0x559b15ebea60 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.604+0000 7f393d3bf740 10 client.25694 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.604+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b15f39ff0 con 0x559b15ebea60 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.604+0000 7f3921600640 1 -- 172.21.15.22:0/1944881197 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f392c005520 con 0x559b15ebea60 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f3921600640 1 -- 172.21.15.22:0/1944881197 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f392c060030 con 0x559b15ebea60 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f393d3bf740 10 client.25694 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f393d3bf740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f393d3bf740 20 client.25694 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15f3a830 0x559b15f3cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f393d3bf740 4 client.25694 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:41:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.606+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b15e25b80 con 0x559b15f3a830 2024-09-15T22:41:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.607+0000 7f3933400640 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15f3a830 0x559b15f3cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.609+0000 7f3921600640 10 client.25694 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.609+0000 7f3933400640 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15f3a830 0x559b15f3cc20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3f139de548e9b8 server_cookie=ad883831de2493a5 in_seq=0 out_seq=0 2024-09-15T22:41:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.640+0000 7f3921600640 1 -- 172.21.15.22:0/1944881197 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b15e25b80 con 0x559b15f3a830 2024-09-15T22:41:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.640+0000 7f3921600640 10 client.25694 handle_command_reply: tid=0 2024-09-15T22:41:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.640+0000 7f393d3bf740 1 client.25694 shutdown 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 msgr2=0x559b15ec8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15ec8830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x559b15ebe1e0 tx=0x7f392c004010 comp rx=0 tx=0).stop 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 shutdown_connections 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x559b15f3a830 0x559b15f3cc20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b15eb99d0 0x559b15eca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559b15ebea60 0x559b15ec8830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 --2- 172.21.15.22:0/1944881197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b15eb9090 0x559b15eca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 >> 172.21.15.22:0/1944881197 conn(0x559b15eb4700 msgr2=0x559b15eb3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.641+0000 7f3921600640 0 client.25694 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.642+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 shutdown_connections 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.642+0000 7f393d3bf740 1 -- 172.21.15.22:0/1944881197 wait complete. 2024-09-15T22:41:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.642+0000 7f393d3bf740 20 client.25694 trim_cache size 0 max 16384 2024-09-15T22:41:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:41:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:41:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:41:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f39180a3530 msgr2=0x7f39180a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f39180a3530 0x7f39180a59f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x559b15eba400 tx=0x7f3924009720 comp rx=0 tx=0).stop 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 msgr2=0x7f393419e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 0x7f393419e930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e790 tx=0x7f391c00ec50 comp rx=0 tx=0).stop 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 shutdown_connections 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f39180a3530 0x7f39180a59f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3934078790 0x7f39341a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3934077df0 0x7f393419e930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 --2- 172.21.15.22:0/1642797217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3934076bb0 0x7f393419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.644+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 >> 172.21.15.22:0/1642797217 conn(0x7f39340ff4b0 msgr2=0x7f3934100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.645+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 shutdown_connections 2024-09-15T22:41:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:38.645+0000 7f393a400640 1 -- 172.21.15.22:0/1642797217 wait complete. 2024-09-15T22:41:39.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:39 smithi110 ceph-mon[35282]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 274 MiB/s wr, 990 op/s 2024-09-15T22:41:40.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:39 smithi022 ceph-mon[30634]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 274 MiB/s wr, 990 op/s 2024-09-15T22:41:40.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:39 smithi112 ceph-mon[35032]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 274 MiB/s wr, 990 op/s 2024-09-15T22:41:42.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:41 smithi022 ceph-mon[30634]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 256 MiB/s wr, 930 op/s 2024-09-15T22:41:42.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:41 smithi112 ceph-mon[35032]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 256 MiB/s wr, 930 op/s 2024-09-15T22:41:42.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:41 smithi110 ceph-mon[35282]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 256 MiB/s wr, 930 op/s 2024-09-15T22:41:44.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:43 smithi022 ceph-mon[30634]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 273 MiB/s wr, 1.00k op/s 2024-09-15T22:41:44.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:43 smithi112 ceph-mon[35032]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 273 MiB/s wr, 1.00k op/s 2024-09-15T22:41:44.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:43 smithi110 ceph-mon[35282]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 273 MiB/s wr, 1.00k op/s 2024-09-15T22:41:46.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:45 smithi022 ceph-mon[30634]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 267 MiB/s wr, 979 op/s 2024-09-15T22:41:46.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:45 smithi112 ceph-mon[35032]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 267 MiB/s wr, 979 op/s 2024-09-15T22:41:46.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:45 smithi110 ceph-mon[35282]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 267 MiB/s wr, 979 op/s 2024-09-15T22:41:48.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:47 smithi022 ceph-mon[30634]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 963 op/s 2024-09-15T22:41:48.104 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:47 smithi112 ceph-mon[35032]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 963 op/s 2024-09-15T22:41:48.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:47 smithi110 ceph-mon[35282]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 963 op/s 2024-09-15T22:41:50.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:49 smithi022 ceph-mon[30634]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 281 MiB/s wr, 1.03k op/s 2024-09-15T22:41:50.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:49 smithi112 ceph-mon[35032]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 281 MiB/s wr, 1.03k op/s 2024-09-15T22:41:50.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:49 smithi110 ceph-mon[35282]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 281 MiB/s wr, 1.03k op/s 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.803+0000 7f86e7800640 1 -- 172.21.15.22:0/4280170439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 msgr2=0x7f86e01049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.803+0000 7f86e7800640 1 --2- 172.21.15.22:0/4280170439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01049c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009900 tx=0x7f86d402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 -- 172.21.15.22:0/4280170439 shutdown_connections 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 --2- 172.21.15.22:0/4280170439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0107830 0x7f86e0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 --2- 172.21.15.22:0/4280170439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0104f00 0x7f86e01072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 --2- 172.21.15.22:0/4280170439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01049c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 -- 172.21.15.22:0/4280170439 >> 172.21.15.22:0/4280170439 conn(0x7f86e00fc1b0 msgr2=0x7f86e00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 -- 172.21.15.22:0/4280170439 shutdown_connections 2024-09-15T22:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.804+0000 7f86e7800640 1 -- 172.21.15.22:0/4280170439 wait complete. 2024-09-15T22:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.805+0000 7f86e7800640 1 Processor -- start 2024-09-15T22:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.805+0000 7f86e7800640 1 -- start start 2024-09-15T22:41:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e7800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0104f00 0x7f86e0196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e7800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0107830 0x7f86e0193420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e7800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86e010d860 con 0x7f86e0107830 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f86e010d6e0 con 0x7f86e01025d0 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e7800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86e010d9e0 con 0x7f86e0104f00 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86e5800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0107830 0x7f86e0193420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0104f00 0x7f86e0196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0104f00 0x7f86e0196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:60978/0 (socket says 172.21.15.22:60978) 2024-09-15T22:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.806+0000 7f86dfe00640 1 -- 172.21.15.22:0/3409840093 learned_addr learned my addr 172.21.15.22:0/3409840093 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e5800640 1 -- 172.21.15.22:0/3409840093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0104f00 msgr2=0x7f86e0196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e5800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0104f00 0x7f86e0196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e5800640 1 -- 172.21.15.22:0/3409840093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 msgr2=0x7f86e01968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e5800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e5800640 1 -- 172.21.15.22:0/3409840093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e0193ce0 con 0x7f86e0107830 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.807+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.808+0000 7f86e5800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0107830 0x7f86e0193420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86d8005fd0 tx=0x7f86d800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.808+0000 7f86dd600640 1 -- 172.21.15.22:0/3409840093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8004d20 con 0x7f86e0107830 2024-09-15T22:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.808+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e01a6470 con 0x7f86e0107830 2024-09-15T22:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.808+0000 7f86dd600640 1 -- 172.21.15.22:0/3409840093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86d8005020 con 0x7f86e0107830 2024-09-15T22:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.808+0000 7f86dd600640 1 -- 172.21.15.22:0/3409840093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d80116d0 con 0x7f86e0107830 2024-09-15T22:41:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.808+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e01a6880 con 0x7f86e0107830 2024-09-15T22:41:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.813+0000 7f86ea5e5740 1 Processor -- start 2024-09-15T22:41:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.817+0000 7f86dd600640 1 -- 172.21.15.22:0/3409840093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f86d8005540 con 0x7f86e0107830 2024-09-15T22:41:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 -- start start 2024-09-15T22:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab36490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab369d0 0x5637cab3b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab3df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637caa9b100 con 0x5637cab369d0 2024-09-15T22:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5637caa431b0 con 0x5637cab36090 2024-09-15T22:41:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.818+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5637caa970c0 con 0x5637cab3ba60 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.819+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab3df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.819+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab36490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.819+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab36490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:52648/0 (socket says 172.21.15.22:52648) 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.819+0000 7f86dfe00640 1 -- 172.21.15.22:0/2624263702 learned_addr learned my addr 172.21.15.22:0/2624263702 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dd600640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f86c80a33c0 0x7f86c80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dfe00640 1 -- 172.21.15.22:0/2624263702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 msgr2=0x5637cab3df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dfe00640 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab3df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dfe00640 1 -- 172.21.15.22:0/2624263702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab369d0 msgr2=0x5637cab3b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dfe00640 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab369d0 0x5637cab3b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dfe00640 1 -- 172.21.15.22:0/2624263702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ca7ae210 con 0x5637cab36090 2024-09-15T22:41:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dd600640 1 -- 172.21.15.22:0/3409840093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f86d80cf9e0 con 0x7f86e0107830 2024-09-15T22:41:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.820+0000 7f86dfe00640 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab36490 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86cc012830 tx=0x7f86cc00b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c6d79f55d45f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.821+0000 7f86e5800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f86c80a33c0 0x7f86c80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.821+0000 7f86d2000640 1 -- 172.21.15.22:0/2624263702 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc004030 con 0x5637cab36090 2024-09-15T22:41:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.822+0000 7f86e5800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f86c80a33c0 0x7f86c80a5880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f86d8005ba0 tx=0x7f86d8005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.825+0000 7f86d2000640 1 -- 172.21.15.22:0/2624263702 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86cc00fc40 con 0x5637cab36090 2024-09-15T22:41:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.825+0000 7f86d2000640 1 -- 172.21.15.22:0/2624263702 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc003930 con 0x5637cab36090 2024-09-15T22:41:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 -- 172.21.15.22:0/2624263702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 msgr2=0x5637cab36490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab36490 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86cc012830 tx=0x7f86cc00b410 comp rx=0 tx=0).stop 2024-09-15T22:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 -- 172.21.15.22:0/2624263702 shutdown_connections 2024-09-15T22:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab3df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab369d0 0x5637cab3b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/2624263702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab36490 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.826+0000 7f86ea5e5740 1 -- 172.21.15.22:0/2624263702 >> 172.21.15.22:0/2624263702 conn(0x5637cab31700 msgr2=0x5637cab31b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.828+0000 7f86ea5e5740 1 -- 172.21.15.22:0/2624263702 shutdown_connections 2024-09-15T22:41:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.828+0000 7f86ea5e5740 1 -- 172.21.15.22:0/2624263702 wait complete. 2024-09-15T22:41:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.828+0000 7f86ea5e5740 1 -- start start 2024-09-15T22:41:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 Processor -- start 2024-09-15T22:41:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab3ba60 0x5637cab58830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637cab4fa40 con 0x5637cab36090 2024-09-15T22:41:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5637caa24090 con 0x5637cab3ba60 2024-09-15T22:41:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5637cab4fbc0 con 0x5637cab369d0 2024-09-15T22:41:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.829+0000 7f86ea5e5740 10 client.0 _ll_register_callbacks cb 0x5637caa78f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.830+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.830+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51788/0 (socket says 172.21.15.22:51788) 2024-09-15T22:41:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.830+0000 7f86dfe00640 1 -- 172.21.15.22:0/3737396424 learned_addr learned my addr 172.21.15.22:0/3737396424 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.830+0000 7f86dfe00640 1 -- 172.21.15.22:0/3737396424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 msgr2=0x5637cab517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.831+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.834+0000 7f86dfe00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.834+0000 7f86dfe00640 1 -- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab3ba60 msgr2=0x5637cab58830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:41:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.834+0000 7f86dfe00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab3ba60 0x5637cab58830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.834+0000 7f86dfe00640 1 -- 172.21.15.22:0/3737396424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ca87a620 con 0x5637cab36090 2024-09-15T22:41:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.834+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:41:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.835+0000 7f86dfe00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab512b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f86cc010000 tx=0x7f86cc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dc8d17d5f67a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.835+0000 7f86c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-15T22:41:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.835+0000 7f86c6a00640 1 -- 172.21.15.22:0/3737396424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc02a430 con 0x5637cab36090 2024-09-15T22:41:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.835+0000 7f86c6a00640 1 -- 172.21.15.22:0/3737396424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f86cc02a5d0 con 0x5637cab36090 2024-09-15T22:41:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.836+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86cc00fc40 con 0x5637cab36090 2024-09-15T22:41:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.837+0000 7f86c6a00640 1 -- 172.21.15.22:0/3737396424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86cc02a7d0 con 0x5637cab36090 2024-09-15T22:41:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.837+0000 7f86ea5e5740 10 client.15627 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.837+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5637cab5b620 con 0x5637cab36090 2024-09-15T22:41:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.838+0000 7f86c6a00640 1 -- 172.21.15.22:0/3737396424 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86cc00fc40 con 0x5637cab36090 2024-09-15T22:41:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.838+0000 7f86c6a00640 1 -- 172.21.15.22:0/3737396424 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86cc02ca20 con 0x5637cab36090 2024-09-15T22:41:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.838+0000 7f86ea5e5740 10 client.15627 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.838+0000 7f86ea5e5740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.839+0000 7f86ea5e5740 20 client.15627 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.839+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab5cad0 0x5637cab5eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.839+0000 7f86ea5e5740 4 client.15627 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:41:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.839+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637caaa8830 con 0x5637cab5cad0 2024-09-15T22:41:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.839+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab5cad0 0x5637cab5eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.840+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab5cad0 0x5637cab5eec0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86a6190fead8c449 server_cookie=cff51afe89ad6ede in_seq=0 out_seq=0 2024-09-15T22:41:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.840+0000 7f86c6a00640 10 client.15627 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86c6a00640 1 -- 172.21.15.22:0/3737396424 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637caaa8830 con 0x5637cab5cad0 2024-09-15T22:41:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86c6a00640 10 client.15627 handle_command_reply: tid=0 2024-09-15T22:41:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 client.15627 shutdown 2024-09-15T22:41:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 msgr2=0x5637cab512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab512b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f86cc010000 tx=0x7f86cc00be70 comp rx=0 tx=0).stop 2024-09-15T22:41:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 shutdown_connections 2024-09-15T22:41:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab5cad0 0x5637cab5eec0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab3ba60 0x5637cab58830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3737396424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab512b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 >> 172.21.15.22:0/3737396424 conn(0x5637cab31700 msgr2=0x5637cab32f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.841+0000 7f86c6a00640 0 client.15627 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.842+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 shutdown_connections 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.842+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3737396424 wait complete. 2024-09-15T22:41:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.842+0000 7f86ea5e5740 20 client.15627 trim_cache size 0 max 16384 2024-09-15T22:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 Processor -- start 2024-09-15T22:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 -- start start 2024-09-15T22:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab369d0 0x5637cab58750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab32af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01a9790 con 0x5637cab36090 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01a7060 con 0x5637cab369d0 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0072770 con 0x5637cab3ba60 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.869+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51792/0 (socket says 172.21.15.22:51792) 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86dfe00640 1 -- 172.21.15.22:0/4000903317 learned_addr learned my addr 172.21.15.22:0/4000903317 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86e4e00640 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab369d0 0x5637cab58750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86dfe00640 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab32af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86e4e00640 1 -- 172.21.15.22:0/4000903317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 msgr2=0x5637cab32af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86e4e00640 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab32af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86e4e00640 1 -- 172.21.15.22:0/4000903317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 msgr2=0x5637cab516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86e4e00640 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86e4e00640 1 -- 172.21.15.22:0/4000903317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637cab2cd60 con 0x5637cab369d0 2024-09-15T22:41:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.870+0000 7f86dfe00640 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:41:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.871+0000 7f86e4e00640 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab369d0 0x5637cab58750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009850 tx=0x7f86d4031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b90ebda1894f4032 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.871+0000 7f86d1600640 1 -- 172.21.15.22:0/4000903317 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d404a070 con 0x5637cab369d0 2024-09-15T22:41:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.871+0000 7f86d1600640 1 -- 172.21.15.22:0/4000903317 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86d4005520 con 0x5637cab369d0 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.871+0000 7f86d1600640 1 -- 172.21.15.22:0/4000903317 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4035070 con 0x5637cab369d0 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 -- 172.21.15.22:0/4000903317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab369d0 msgr2=0x5637cab58750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab369d0 0x5637cab58750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009850 tx=0x7f86d4031400 comp rx=0 tx=0).stop 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 -- 172.21.15.22:0/4000903317 shutdown_connections 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab3ba60 0x5637cab32af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab369d0 0x5637cab58750 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/4000903317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab36090 0x5637cab516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 -- 172.21.15.22:0/4000903317 >> 172.21.15.22:0/4000903317 conn(0x5637cab31700 msgr2=0x5637cab30880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 -- 172.21.15.22:0/4000903317 shutdown_connections 2024-09-15T22:41:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 -- 172.21.15.22:0/4000903317 wait complete. 2024-09-15T22:41:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.872+0000 7f86ea5e5740 1 -- start start 2024-09-15T22:41:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 Processor -- start 2024-09-15T22:41:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab55dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab3ba60 0x5637cab56dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0072e00 con 0x5637cab3ba60 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0074270 con 0x5637cab36090 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00734d0 con 0x5637cab369d0 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86ea5e5740 10 client.0 _ll_register_callbacks cb 0x7f86cc00bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86e4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab55dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.873+0000 7f86e4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab55dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:32810/0 (socket says 172.21.15.22:32810) 2024-09-15T22:41:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 -- 172.21.15.22:0/3963606913 learned_addr learned my addr 172.21.15.22:0/3963606913 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:41:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86dfe00640 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab3ba60 0x5637cab56dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 -- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 msgr2=0x5637cab55880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 -- 172.21.15.22:0/3963606913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab3ba60 msgr2=0x5637cab56dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:41:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab3ba60 0x5637cab56dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 -- 172.21.15.22:0/3963606913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637cab573e0 con 0x5637cab369d0 2024-09-15T22:41:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86e4e00640 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab55dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f86d40314e0 tx=0x7f86d4004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5693ac1097f2a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.874+0000 7f86c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:41:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.875+0000 7f86c6a00640 1 -- 172.21.15.22:0/3963606913 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4035030 con 0x5637cab369d0 2024-09-15T22:41:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.875+0000 7f86c6a00640 1 -- 172.21.15.22:0/3963606913 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f86d4005040 con 0x5637cab369d0 2024-09-15T22:41:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.875+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86d4005520 con 0x5637cab369d0 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.875+0000 7f86c6a00640 1 -- 172.21.15.22:0/3963606913 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86d404a070 con 0x5637cab369d0 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.875+0000 7f86ea5e5740 10 client.25747 fetch_fsmap learned FSMap version 25 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.875+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5637cab586f0 con 0x5637cab369d0 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86c6a00640 1 -- 172.21.15.22:0/3963606913 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86d4005520 con 0x5637cab369d0 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86c6a00640 1 -- 172.21.15.22:0/3963606913 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86d403c440 con 0x5637cab369d0 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86ea5e5740 10 client.25747 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86ea5e5740 10 client.25747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86ea5e5740 20 client.25747 populate_metadata read hostname 'smithi022' 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab449a0 0x5637cab46dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86ea5e5740 4 client.25747 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5637caaa2b80 con 0x5637cab449a0 2024-09-15T22:41:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.876+0000 7f86dfe00640 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab449a0 0x5637cab46dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.877+0000 7f86dfe00640 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab449a0 0x5637cab46dc0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6cd24a5511117a2 server_cookie=993db494df40dacd in_seq=0 out_seq=0 2024-09-15T22:41:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.877+0000 7f86c6a00640 10 client.25747 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.896+0000 7f86c6a00640 1 -- 172.21.15.22:0/3963606913 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5637caaa2b80 con 0x5637cab449a0 2024-09-15T22:41:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.896+0000 7f86c6a00640 10 client.25747 handle_command_reply: tid=0 2024-09-15T22:41:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.897+0000 7f86ea5e5740 1 client.25747 shutdown 2024-09-15T22:41:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.898+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 msgr2=0x5637cab55dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.898+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab55dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f86d40314e0 tx=0x7f86d4004820 comp rx=0 tx=0).stop 2024-09-15T22:41:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 shutdown_connections 2024-09-15T22:41:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5637cab449a0 0x5637cab46dc0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5637cab369d0 0x5637cab55dc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637cab3ba60 0x5637cab56dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 --2- 172.21.15.22:0/3963606913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5637cab36090 0x5637cab55880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 >> 172.21.15.22:0/3963606913 conn(0x5637cab31700 msgr2=0x5637cab31ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86c6a00640 0 client.25747 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:41:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 shutdown_connections 2024-09-15T22:41:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 1 -- 172.21.15.22:0/3963606913 wait complete. 2024-09-15T22:41:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.899+0000 7f86ea5e5740 20 client.25747 trim_cache size 0 max 16384 2024-09-15T22:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:41:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f86c80a33c0 msgr2=0x7f86c80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f86c80a33c0 0x7f86c80a5880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f86d8005ba0 tx=0x7f86d8005940 comp rx=0 tx=0).stop 2024-09-15T22:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0107830 msgr2=0x7f86e0193420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0107830 0x7f86e0193420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86d8005fd0 tx=0x7f86d800edd0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 shutdown_connections 2024-09-15T22:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e0104f00 0x7f86e0196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f86c80a33c0 0x7f86c80a5880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.902+0000 7f86e7800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86e0107830 0x7f86e0193420 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.903+0000 7f86e7800640 1 --2- 172.21.15.22:0/3409840093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e01025d0 0x7f86e01968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.903+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 >> 172.21.15.22:0/3409840093 conn(0x7f86e00fc1b0 msgr2=0x7f86e0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.903+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 shutdown_connections 2024-09-15T22:41:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:41:51.903+0000 7f86e7800640 1 -- 172.21.15.22:0/3409840093 wait complete. 2024-09-15T22:41:52.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:51 smithi022 ceph-mon[30634]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 966 op/s 2024-09-15T22:41:52.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:51 smithi112 ceph-mon[35032]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 966 op/s 2024-09-15T22:41:52.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:51 smithi110 ceph-mon[35282]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 263 MiB/s wr, 966 op/s 2024-09-15T22:41:54.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:53 smithi022 ceph-mon[30634]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 275 MiB/s wr, 1.01k op/s 2024-09-15T22:41:54.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:53 smithi112 ceph-mon[35032]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 275 MiB/s wr, 1.01k op/s 2024-09-15T22:41:54.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:53 smithi110 ceph-mon[35282]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 275 MiB/s wr, 1.01k op/s 2024-09-15T22:41:56.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:55 smithi022 ceph-mon[30634]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 269 MiB/s wr, 975 op/s 2024-09-15T22:41:56.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:55 smithi112 ceph-mon[35032]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 269 MiB/s wr, 975 op/s 2024-09-15T22:41:56.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:55 smithi110 ceph-mon[35282]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 269 MiB/s wr, 975 op/s 2024-09-15T22:41:58.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:57 smithi112 ceph-mon[35032]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 256 MiB/s wr, 933 op/s 2024-09-15T22:41:58.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:57 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:58.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:57 smithi110 ceph-mon[35282]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 256 MiB/s wr, 933 op/s 2024-09-15T22:41:58.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:57 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:58.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:57 smithi022 ceph-mon[30634]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 256 MiB/s wr, 933 op/s 2024-09-15T22:41:58.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:57 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:59.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:59.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:59.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:58 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:41:59.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:59.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:59.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:58 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:41:59.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:59.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:59.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:58 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:42:00.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:41:59 smithi112 ceph-mon[35032]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 275 MiB/s wr, 1.01k op/s 2024-09-15T22:42:00.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:41:59 smithi110 ceph-mon[35282]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 275 MiB/s wr, 1.01k op/s 2024-09-15T22:42:00.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:41:59 smithi022 ceph-mon[30634]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 275 MiB/s wr, 1.01k op/s 2024-09-15T22:42:01.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:00 smithi110 ceph-mon[35282]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 254 MiB/s wr, 926 op/s 2024-09-15T22:42:01.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:00 smithi022 ceph-mon[30634]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 254 MiB/s wr, 926 op/s 2024-09-15T22:42:01.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:00 smithi112 ceph-mon[35032]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 254 MiB/s wr, 926 op/s 2024-09-15T22:42:03.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:02 smithi022 ceph-mon[30634]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 271 MiB/s wr, 989 op/s 2024-09-15T22:42:03.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:02 smithi112 ceph-mon[35032]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 271 MiB/s wr, 989 op/s 2024-09-15T22:42:03.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:02 smithi110 ceph-mon[35282]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 271 MiB/s wr, 989 op/s 2024-09-15T22:42:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.172+0000 7f9edb000640 1 -- 172.21.15.22:0/3028375605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed4101d80 msgr2=0x7f9ed4108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.172+0000 7f9edb000640 1 --2- 172.21.15.22:0/3028375605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed4101d80 0x7f9ed4108610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009900 tx=0x7f9ec402c790 comp rx=0 tx=0).stop 2024-09-15T22:42:05.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.176+0000 7f9edb000640 1 -- 172.21.15.22:0/3028375605 shutdown_connections 2024-09-15T22:42:05.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.176+0000 7f9edb000640 1 --2- 172.21.15.22:0/3028375605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed4101d80 0x7f9ed4108610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.176+0000 7f9edb000640 1 --2- 172.21.15.22:0/3028375605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed41013c0 0x7f9ed4101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.176+0000 7f9edb000640 1 --2- 172.21.15.22:0/3028375605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41001d0 0x7f9ed41005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.178 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.176+0000 7f9edb000640 1 -- 172.21.15.22:0/3028375605 >> 172.21.15.22:0/3028375605 conn(0x7f9ed40fb930 msgr2=0x7f9ed40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.180+0000 7f9edb000640 1 -- 172.21.15.22:0/3028375605 shutdown_connections 2024-09-15T22:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.180+0000 7f9edb000640 1 -- 172.21.15.22:0/3028375605 wait complete. 2024-09-15T22:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.183+0000 7f9edb000640 1 Processor -- start 2024-09-15T22:42:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.185+0000 7f9edb000640 1 -- start start 2024-09-15T22:42:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.186+0000 7f9edb000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed41001d0 0x7f9ed41a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.186+0000 7f9edb000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 0x7f9ed41a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.186+0000 7f9edb000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed4101d80 0x7f9ed41ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9ed9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed4101d80 0x7f9ed41ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9ed3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 0x7f9ed41a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9ed3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 0x7f9ed41a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:54166/0 (socket says 172.21.15.22:54166) 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9ed9000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed4101d80 0x7f9ed41ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50228/0 (socket says 172.21.15.22:50228) 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9ed3400640 1 -- 172.21.15.22:0/499060252 learned_addr learned my addr 172.21.15.22:0/499060252 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed410b640 con 0x7f9ed4101d80 2024-09-15T22:42:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed410b4c0 con 0x7f9ed41001d0 2024-09-15T22:42:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.187+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed410b7c0 con 0x7f9ed41013c0 2024-09-15T22:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.189+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed41001d0 0x7f9ed41a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.192+0000 7f9ed3400640 1 -- 172.21.15.22:0/499060252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed41001d0 msgr2=0x7f9ed41a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.192+0000 7f9ed3400640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed41001d0 0x7f9ed41a6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.192+0000 7f9ed3400640 1 -- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed4101d80 msgr2=0x7f9ed41ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.192+0000 7f9ed3400640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed4101d80 0x7f9ed41ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.194+0000 7f9ed3400640 1 -- 172.21.15.22:0/499060252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed41ae870 con 0x7f9ed41013c0 2024-09-15T22:42:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.198+0000 7f9ed3400640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 0x7f9ed41a71a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00d950 tx=0x7f9ebc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.200+0000 7f9ed0c00640 1 -- 172.21.15.22:0/499060252 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc017070 con 0x7f9ed41013c0 2024-09-15T22:42:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.202+0000 7f9ed0c00640 1 -- 172.21.15.22:0/499060252 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ebc009c30 con 0x7f9ed41013c0 2024-09-15T22:42:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.202+0000 7f9ed0c00640 1 -- 172.21.15.22:0/499060252 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00f6b0 con 0x7f9ed41013c0 2024-09-15T22:42:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.203+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed41aeb60 con 0x7f9ed41013c0 2024-09-15T22:42:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.203+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed41af030 con 0x7f9ed41013c0 2024-09-15T22:42:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.209+0000 7f9ed0c00640 1 -- 172.21.15.22:0/499060252 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9ebc0109d0 con 0x7f9ed41013c0 2024-09-15T22:42:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.212+0000 7f9eddeb5740 1 Processor -- start 2024-09-15T22:42:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.212+0000 7f9eddeb5740 1 -- start start 2024-09-15T22:42:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.213+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b0865490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.213+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 0x5570b086a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b086aa60 0x5570b086cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5570b07ca100 con 0x5570b0865090 2024-09-15T22:42:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5570b07721b0 con 0x5570b08659d0 2024-09-15T22:42:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5570b07c60c0 con 0x5570b086aa60 2024-09-15T22:42:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 0x5570b086a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 0x5570b086a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:40096/0 (socket says 172.21.15.22:40096) 2024-09-15T22:42:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2312774846 learned_addr learned my addr 172.21.15.22:0/2312774846 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.214+0000 7f9ed0c00640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a34b0 0x7f9eb40a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3400640 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b086aa60 0x5570b086cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2312774846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b086aa60 msgr2=0x5570b086cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b086aa60 0x5570b086cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2312774846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 msgr2=0x5570b0865490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b0865490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2312774846 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b04dd210 con 0x5570b08659d0 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed9000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a34b0 0x7f9eb40a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.215+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 0x5570b086a490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00a4b0 tx=0x7f9ecc0096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1deeb21bcc5c598 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.216+0000 7f9ed0c00640 1 -- 172.21.15.22:0/499060252 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9ebc0cf480 con 0x7f9ed41013c0 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.216+0000 7f9ec9600640 1 -- 172.21.15.22:0/2312774846 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc018020 con 0x5570b08659d0 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.216+0000 7f9ec9600640 1 -- 172.21.15.22:0/2312774846 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ecc014cf0 con 0x5570b08659d0 2024-09-15T22:42:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.216+0000 7f9ec9600640 1 -- 172.21.15.22:0/2312774846 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc018020 con 0x5570b08659d0 2024-09-15T22:42:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.217+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2312774846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 msgr2=0x5570b086a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.217+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 0x5570b086a490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00a4b0 tx=0x7f9ecc0096d0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.217+0000 7f9ed9000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a34b0 0x7f9eb40a5970 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4006010 tx=0x7f9ec400f500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.218+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2312774846 shutdown_connections 2024-09-15T22:42:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.218+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b086aa60 0x5570b086cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.218+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b08659d0 0x5570b086a490 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.218+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2312774846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b0865490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.218+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2312774846 >> 172.21.15.22:0/2312774846 conn(0x5570b0860700 msgr2=0x5570b0860b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.219+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2312774846 shutdown_connections 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.219+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2312774846 wait complete. 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.219+0000 7f9eddeb5740 1 -- start start 2024-09-15T22:42:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 Processor -- start 2024-09-15T22:42:05.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b086f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b086f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b086aa60 0x5570b08767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5570b086da30 con 0x5570b086aa60 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5570b0753090 con 0x5570b0865090 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5570b086dbb0 con 0x5570b08659d0 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.220+0000 7f9eddeb5740 10 client.0 _ll_register_callbacks cb 0x5570b07a7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.221+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b086f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.221+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b086f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:40098/0 (socket says 172.21.15.22:40098) 2024-09-15T22:42:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.221+0000 7f9ed3e00640 1 -- 172.21.15.22:0/1287063191 learned_addr learned my addr 172.21.15.22:0/1287063191 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.221+0000 7f9ed3400640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b086f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3e00640 1 -- 172.21.15.22:0/1287063191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 msgr2=0x5570b086f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b086f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3e00640 1 -- 172.21.15.22:0/1287063191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b086aa60 msgr2=0x5570b08767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b086aa60 0x5570b08767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3e00640 1 -- 172.21.15.22:0/1287063191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b05a9620 con 0x5570b0865090 2024-09-15T22:42:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3400640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b086f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.222+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b086f270 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00afd0 tx=0x7f9ecc014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13cdfee3a2fa6e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.223+0000 7f9ec2000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.223+0000 7f9ec2000640 1 -- 172.21.15.22:0/1287063191 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc018030 con 0x5570b0865090 2024-09-15T22:42:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.223+0000 7f9ec2000640 1 -- 172.21.15.22:0/1287063191 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9ecc01d420 con 0x5570b0865090 2024-09-15T22:42:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.223+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ecc014cf0 con 0x5570b0865090 2024-09-15T22:42:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.224+0000 7f9ec2000640 1 -- 172.21.15.22:0/1287063191 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ecc009c60 con 0x5570b0865090 2024-09-15T22:42:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.224+0000 7f9eddeb5740 10 client.25718 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.224+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5570b08795e0 con 0x5570b0865090 2024-09-15T22:42:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.224+0000 7f9ec2000640 1 -- 172.21.15.22:0/1287063191 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ecc014cf0 con 0x5570b0865090 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.224+0000 7f9ec2000640 1 -- 172.21.15.22:0/1287063191 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ecc027520 con 0x5570b0865090 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.225+0000 7f9eddeb5740 10 client.25718 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.225+0000 7f9eddeb5740 10 client.25718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.225+0000 7f9eddeb5740 20 client.25718 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.225+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b087aab0 0x5570b087cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.225+0000 7f9eddeb5740 4 client.25718 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.225+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570b07d7830 con 0x5570b087aab0 2024-09-15T22:42:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.226+0000 7f9ed3400640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b087aab0 0x5570b087cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.227+0000 7f9ed3400640 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b087aab0 0x5570b087cf50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c959b34b1ac0fd4 server_cookie=577237dbb99b19e4 in_seq=0 out_seq=0 2024-09-15T22:42:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.227+0000 7f9ec2000640 10 client.25718 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.228+0000 7f9ec2000640 1 -- 172.21.15.22:0/1287063191 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570b07d7830 con 0x5570b087aab0 2024-09-15T22:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.228+0000 7f9ec2000640 10 client.25718 handle_command_reply: tid=0 2024-09-15T22:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.228+0000 7f9eddeb5740 1 client.25718 shutdown 2024-09-15T22:42:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.228+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 msgr2=0x5570b086f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.228+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b086f270 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00afd0 tx=0x7f9ecc014840 comp rx=0 tx=0).stop 2024-09-15T22:42:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 shutdown_connections 2024-09-15T22:42:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b087aab0 0x5570b087cf50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b086f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b086aa60 0x5570b08767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/1287063191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b086f270 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9ec2000640 0 client.25718 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 >> 172.21.15.22:0/1287063191 conn(0x5570b0860700 msgr2=0x5570b0861f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 shutdown_connections 2024-09-15T22:42:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 1 -- 172.21.15.22:0/1287063191 wait complete. 2024-09-15T22:42:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.229+0000 7f9eddeb5740 20 client.25718 trim_cache size 0 max 16384 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 Processor -- start 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 -- start start 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0860700 0x5570b0860ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b08767b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b0861020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41ba710 con 0x5570b0865090 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b7fe0 con 0x5570b0860700 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.250+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b5dd0 con 0x5570b08659d0 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0860700 0x5570b0860ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0860700 0x5570b0860ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:40114/0 (socket says 172.21.15.22:40114) 2024-09-15T22:42:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3e00640 1 -- 172.21.15.22:0/3312382030 learned_addr learned my addr 172.21.15.22:0/3312382030 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3400640 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b08767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed9000640 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b0861020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3400640 1 -- 172.21.15.22:0/3312382030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 msgr2=0x5570b0861020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3400640 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b0861020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3400640 1 -- 172.21.15.22:0/3312382030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0860700 msgr2=0x5570b0860ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3400640 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0860700 0x5570b0860ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.251+0000 7f9ed3400640 1 -- 172.21.15.22:0/3312382030 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b086dd50 con 0x5570b0865090 2024-09-15T22:42:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.252+0000 7f9ed3400640 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b08767b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009610 tx=0x7f9ebc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5197f6ac596116b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.252+0000 7f9ec8c00640 1 -- 172.21.15.22:0/3312382030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc09bb20 con 0x5570b0865090 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.252+0000 7f9ec8c00640 1 -- 172.21.15.22:0/3312382030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ebc09ce50 con 0x5570b0865090 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.252+0000 7f9ec8c00640 1 -- 172.21.15.22:0/3312382030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc09bfe0 con 0x5570b0865090 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 -- 172.21.15.22:0/3312382030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 msgr2=0x5570b08767b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b08767b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009610 tx=0x7f9ebc000bc0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 -- 172.21.15.22:0/3312382030 shutdown_connections 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b08659d0 0x5570b0861020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b0865090 0x5570b08767b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/3312382030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0860700 0x5570b0860ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 -- 172.21.15.22:0/3312382030 >> 172.21.15.22:0/3312382030 conn(0x5570b086a580 msgr2=0x5570b086f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 -- 172.21.15.22:0/3312382030 shutdown_connections 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.253+0000 7f9eddeb5740 1 -- 172.21.15.22:0/3312382030 wait complete. 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 -- start start 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 Processor -- start 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 0x5570b0873810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b0873d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b08659d0 0x5570b0874d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b64a0 con 0x5570b08659d0 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b7910 con 0x5570b0865090 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41b6b70 con 0x5570b0860700 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.254+0000 7f9eddeb5740 10 client.0 _ll_register_callbacks cb 0x7f9ecc009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.255+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 0x5570b0873810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.255+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 0x5570b0873810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:54216/0 (socket says 172.21.15.22:54216) 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.255+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2123360819 learned_addr learned my addr 172.21.15.22:0/2123360819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.255+0000 7f9ed3400640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b0873d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.255+0000 7f9ed9000640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b08659d0 0x5570b0874d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 msgr2=0x5570b0873d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b0873d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2123360819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b08659d0 msgr2=0x5570b0874d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b08659d0 0x5570b0874d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3e00640 1 -- 172.21.15.22:0/2123360819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b0875370 con 0x5570b0860700 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed9000640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b08659d0 0x5570b0874d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3400640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b0873d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ed3e00640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 0x5570b0873810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00afd0 tx=0x7f9ecc013ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d711f6345cbc32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ec2000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ec2000640 1 -- 172.21.15.22:0/2123360819 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc03e060 con 0x5570b0860700 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9ec2000640 1 -- 172.21.15.22:0/2123360819 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9ecc027410 con 0x5570b0860700 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.256+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ebc09ce50 con 0x5570b0860700 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.257+0000 7f9ec2000640 1 -- 172.21.15.22:0/2123360819 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ecc035040 con 0x5570b0860700 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.257+0000 7f9eddeb5740 10 client.25762 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.257+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5570b0876680 con 0x5570b0860700 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.257+0000 7f9ec2000640 1 -- 172.21.15.22:0/2123360819 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ebc09ce50 con 0x5570b0860700 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9ec2000640 1 -- 172.21.15.22:0/2123360819 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ecc014840 con 0x5570b0860700 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9eddeb5740 10 client.25762 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9eddeb5740 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9eddeb5740 20 client.25762 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b086aa60 0x5570b08e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9eddeb5740 4 client.25762 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570b07d1b80 con 0x5570b086aa60 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.258+0000 7f9ed3400640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b086aa60 0x5570b08e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.259+0000 7f9ed3400640 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b086aa60 0x5570b08e7ad0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13ac8212f6a75b4 server_cookie=4f1fa874125b654a in_seq=0 out_seq=0 2024-09-15T22:42:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.259+0000 7f9ec2000640 10 client.25762 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9ec2000640 1 -- 172.21.15.22:0/2123360819 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570b07d1b80 con 0x5570b086aa60 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9ec2000640 10 client.25762 handle_command_reply: tid=0 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 client.25762 shutdown 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 msgr2=0x5570b0873810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 0x5570b0873810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00afd0 tx=0x7f9ecc013ff0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 shutdown_connections 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5570b086aa60 0x5570b08e7ad0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570b08659d0 0x5570b0874d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5570b0865090 0x5570b0873d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 --2- 172.21.15.22:0/2123360819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570b0860700 0x5570b0873810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9ec2000640 0 client.25762 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 >> 172.21.15.22:0/2123360819 conn(0x5570b086a580 msgr2=0x5570b085f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 shutdown_connections 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 1 -- 172.21.15.22:0/2123360819 wait complete. 2024-09-15T22:42:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.277+0000 7f9eddeb5740 20 client.25762 trim_cache size 0 max 16384 2024-09-15T22:42:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:42:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:42:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:42:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a34b0 msgr2=0x7f9eb40a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a34b0 0x7f9eb40a5970 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4006010 tx=0x7f9ec400f500 comp rx=0 tx=0).stop 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 msgr2=0x7f9ed41a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 0x7f9ed41a71a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00d950 tx=0x7f9ebc00de10 comp rx=0 tx=0).stop 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 shutdown_connections 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ed41013c0 0x7f9ed41a71a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9eb40a34b0 0x7f9eb40a5970 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ed4101d80 0x7f9ed41ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 --2- 172.21.15.22:0/499060252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ed41001d0 0x7f9ed41a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 >> 172.21.15.22:0/499060252 conn(0x7f9ed40fb930 msgr2=0x7f9ed41046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 shutdown_connections 2024-09-15T22:42:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:05.278+0000 7f9edb000640 1 -- 172.21.15.22:0/499060252 wait complete. 2024-09-15T22:42:05.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:04 smithi022 ceph-mon[30634]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 269 MiB/s wr, 978 op/s 2024-09-15T22:42:05.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:04 smithi112 ceph-mon[35032]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 269 MiB/s wr, 978 op/s 2024-09-15T22:42:05.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:04 smithi110 ceph-mon[35282]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 269 MiB/s wr, 978 op/s 2024-09-15T22:42:07.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:07 smithi022 ceph-mon[30634]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 937 op/s 2024-09-15T22:42:07.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:07 smithi112 ceph-mon[35032]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 937 op/s 2024-09-15T22:42:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:07 smithi110 ceph-mon[35282]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 937 op/s 2024-09-15T22:42:09.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:09 smithi022 ceph-mon[30634]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 276 MiB/s wr, 1.00k op/s 2024-09-15T22:42:09.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:09 smithi112 ceph-mon[35032]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 276 MiB/s wr, 1.00k op/s 2024-09-15T22:42:09.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:09 smithi110 ceph-mon[35282]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 276 MiB/s wr, 1.00k op/s 2024-09-15T22:42:11.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:11 smithi112 ceph-mon[35032]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 253 MiB/s wr, 922 op/s 2024-09-15T22:42:11.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:11 smithi110 ceph-mon[35282]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 253 MiB/s wr, 922 op/s 2024-09-15T22:42:11.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:11 smithi022 ceph-mon[30634]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 253 MiB/s wr, 922 op/s 2024-09-15T22:42:13.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:13 smithi112 ceph-mon[35032]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 276 MiB/s wr, 1.01k op/s 2024-09-15T22:42:13.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:13 smithi110 ceph-mon[35282]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 276 MiB/s wr, 1.01k op/s 2024-09-15T22:42:13.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:13 smithi022 ceph-mon[30634]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 276 MiB/s wr, 1.01k op/s 2024-09-15T22:42:15.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:15 smithi110 ceph-mon[35282]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 982 op/s 2024-09-15T22:42:15.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:15 smithi022 ceph-mon[30634]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 982 op/s 2024-09-15T22:42:15.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:15 smithi112 ceph-mon[35032]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 268 MiB/s wr, 982 op/s 2024-09-15T22:42:17.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:17 smithi110 ceph-mon[35282]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 261 MiB/s wr, 954 op/s 2024-09-15T22:42:17.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:17 smithi022 ceph-mon[30634]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 261 MiB/s wr, 954 op/s 2024-09-15T22:42:17.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:17 smithi112 ceph-mon[35032]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 261 MiB/s wr, 954 op/s 2024-09-15T22:42:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 -- 172.21.15.22:0/1845384627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c104f50 msgr2=0x7f689c1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 --2- 172.21.15.22:0/1845384627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c104f50 0x7f689c1053d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6888009860 tx=0x7f688802a340 comp rx=0 tx=0).stop 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 -- 172.21.15.22:0/1845384627 shutdown_connections 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 --2- 172.21.15.22:0/1845384627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c104f50 0x7f689c1053d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 --2- 172.21.15.22:0/1845384627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f689c105910 0x7f689c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 --2- 172.21.15.22:0/1845384627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 0x7f689c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 -- 172.21.15.22:0/1845384627 >> 172.21.15.22:0/1845384627 conn(0x7f689c0ff4e0 msgr2=0x7f689c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 -- 172.21.15.22:0/1845384627 shutdown_connections 2024-09-15T22:42:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.466+0000 7f68a3c00640 1 -- 172.21.15.22:0/1845384627 wait complete. 2024-09-15T22:42:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.467+0000 7f68a3c00640 1 Processor -- start 2024-09-15T22:42:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 -- start start 2024-09-15T22:42:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 0x7f689c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f689c104f50 0x7f689c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 0x7f689c1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10f9c0 con 0x7f689c104f50 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10f840 con 0x7f689c103d60 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10fb40 con 0x7f689c105910 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 0x7f689c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 0x7f689c1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f689be00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f689c104f50 0x7f689c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 0x7f689c1a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:40964/0 (socket says 172.21.15.22:40964) 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 0x7f689c199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39290/0 (socket says 172.21.15.22:39290) 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.468+0000 7f68a1c00640 1 -- 172.21.15.22:0/2939602237 learned_addr learned my addr 172.21.15.22:0/2939602237 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a1c00640 1 -- 172.21.15.22:0/2939602237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 msgr2=0x7f689c199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a1c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 0x7f689c199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a1c00640 1 -- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f689c104f50 msgr2=0x7f689c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a1c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f689c104f50 0x7f689c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a1c00640 1 -- 172.21.15.22:0/2939602237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c1a1bd0 con 0x7f689c105910 2024-09-15T22:42:18.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a1c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 0x7f689c1a1560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f689400eaa0 tx=0x7f689400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f6899600640 1 -- 172.21.15.22:0/2939602237 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689400cdb0 con 0x7f689c105910 2024-09-15T22:42:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f6899600640 1 -- 172.21.15.22:0/2939602237 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6894005020 con 0x7f689c105910 2024-09-15T22:42:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f6899600640 1 -- 172.21.15.22:0/2939602237 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68940116b0 con 0x7f689c105910 2024-09-15T22:42:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c1a1ec0 con 0x7f689c105910 2024-09-15T22:42:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.469+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1a2330 con 0x7f689c105910 2024-09-15T22:42:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.472+0000 7f6899600640 1 -- 172.21.15.22:0/2939602237 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6894005560 con 0x7f689c105910 2024-09-15T22:42:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 Processor -- start 2024-09-15T22:42:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 -- start start 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ff2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 0x563430ff7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff7a60 0x563430ff9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563430f57100 con 0x563430ff7a60 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563430eff1b0 con 0x563430ff2090 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.473+0000 7f68a6a65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563430f530c0 con 0x563430ff29d0 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 0x563430ff7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f689be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ff2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 0x563430ff7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:40966/0 (socket says 172.21.15.22:40966) 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 -- 172.21.15.22:0/301893848 learned_addr learned my addr 172.21.15.22:0/301893848 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f689be00640 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff7a60 0x563430ff9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 -- 172.21.15.22:0/301893848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 msgr2=0x563430ff2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ff2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 -- 172.21.15.22:0/301893848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff7a60 msgr2=0x563430ff9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff7a60 0x563430ff9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 -- 172.21.15.22:0/301893848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563430c6a210 con 0x563430ff29d0 2024-09-15T22:42:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f6899600640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68840a32f0 0x7f68840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.474+0000 7f68a1200640 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 0x563430ff7490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6890009c80 tx=0x7f6890011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c86b5b06deb9e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.475+0000 7f6899600640 1 -- 172.21.15.22:0/2939602237 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f68940cfaf0 con 0x7f689c105910 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.475+0000 7f688e000640 1 -- 172.21.15.22:0/301893848 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890005220 con 0x563430ff29d0 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.475+0000 7f688e000640 1 -- 172.21.15.22:0/301893848 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6890009e30 con 0x563430ff29d0 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.475+0000 7f689be00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68840a32f0 0x7f68840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.475+0000 7f688e000640 1 -- 172.21.15.22:0/301893848 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890019890 con 0x563430ff29d0 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 -- 172.21.15.22:0/301893848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 msgr2=0x563430ff7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 0x563430ff7490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6890009c80 tx=0x7f6890011810 comp rx=0 tx=0).stop 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f689be00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68840a32f0 0x7f68840a57b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6888009830 tx=0x7f6888030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 -- 172.21.15.22:0/301893848 shutdown_connections 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff29d0 0x563430ff7490 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff7a60 0x563430ff9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 --2- 172.21.15.22:0/301893848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ff2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 -- 172.21.15.22:0/301893848 >> 172.21.15.22:0/301893848 conn(0x563430fed700 msgr2=0x563430fedb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 -- 172.21.15.22:0/301893848 shutdown_connections 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.476+0000 7f68a6a65740 1 -- 172.21.15.22:0/301893848 wait complete. 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 -- start start 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 Processor -- start 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x5634310037e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563430ffaad0 con 0x563430ff2090 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563430ee0090 con 0x563430ff29d0 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563430ffac50 con 0x563430ff7a60 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.477+0000 7f68a6a65740 10 client.0 _ll_register_callbacks cb 0x563430f34f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x5634310037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x5634310037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:40970/0 (socket says 172.21.15.22:40970) 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f689be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 -- 172.21.15.22:0/1044300881 learned_addr learned my addr 172.21.15.22:0/1044300881 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:18.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 -- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 msgr2=0x563430ffc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.484 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 -- 172.21.15.22:0/1044300881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 msgr2=0x563430ffc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 -- 172.21.15.22:0/1044300881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563430d36620 con 0x563430ff7a60 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f689be00640 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f68a1c00640 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x5634310037e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68940985e0 tx=0x7f689409c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135d1a42bd5a35e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.478+0000 7f6882a00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f6882a00640 1 -- 172.21.15.22:0/1044300881 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689401f030 con 0x563430ff7a60 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f6882a00640 1 -- 172.21.15.22:0/1044300881 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f68940a0120 con 0x563430ff7a60 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6890009e30 con 0x563430ff7a60 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f6882a00640 1 -- 172.21.15.22:0/1044300881 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f68940987f0 con 0x563430ff7a60 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 10 client.25774 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563431006640 con 0x563430ff7a60 2024-09-15T22:42:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f6882a00640 1 -- 172.21.15.22:0/1044300881 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6890009e30 con 0x563430ff7a60 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f6882a00640 1 -- 172.21.15.22:0/1044300881 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f689400f040 con 0x563430ff7a60 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 10 client.25774 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 10 client.25774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 20 client.25774 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343100a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 4 client.25774 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.479+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563430f64830 con 0x563431007ce0 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.480+0000 7f68a1200640 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343100a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.480+0000 7f68a1200640 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343100a0d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b16e84ba57e0909a server_cookie=bf285c74e8fd6a17 in_seq=0 out_seq=0 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.480+0000 7f6882a00640 10 client.25774 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f6882a00640 1 -- 172.21.15.22:0/1044300881 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563430f64830 con 0x563431007ce0 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f6882a00640 10 client.25774 handle_command_reply: tid=0 2024-09-15T22:42:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 client.25774 shutdown 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 msgr2=0x5634310037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x5634310037e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68940985e0 tx=0x7f689409c2e0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 shutdown_connections 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343100a0d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f6882a00640 0 client.25774 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x5634310037e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1044300881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.481+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 >> 172.21.15.22:0/1044300881 conn(0x563430fed700 msgr2=0x563430feef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.482+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 shutdown_connections 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.482+0000 7f68a6a65740 1 -- 172.21.15.22:0/1044300881 wait complete. 2024-09-15T22:42:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.482+0000 7f68a6a65740 20 client.25774 trim_cache size 0 max 16384 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 Processor -- start 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 -- start start 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1ada70 con 0x563430ff29d0 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1ab340 con 0x563430ff2090 2024-09-15T22:42:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a6a65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1a9170 con 0x563430ff7a60 2024-09-15T22:42:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39316/0 (socket says 172.21.15.22:39316) 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.501+0000 7f68a1200640 1 -- 172.21.15.22:0/740674647 learned_addr learned my addr 172.21.15.22:0/740674647 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1c00640 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431003770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1200640 1 -- 172.21.15.22:0/740674647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 msgr2=0x563431003770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1200640 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431003770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1200640 1 -- 172.21.15.22:0/740674647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff29d0 msgr2=0x563430ffc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f689be00640 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1200640 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1200640 1 -- 172.21.15.22:0/740674647 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563430ff2eb0 con 0x563430ff2090 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f689be00640 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.502+0000 7f68a1200640 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ffc260 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x563430ff3400 tx=0x7f6890005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42ea64254928aad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.503+0000 7f688d600640 1 -- 172.21.15.22:0/740674647 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890034070 con 0x563430ff2090 2024-09-15T22:42:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.503+0000 7f688d600640 1 -- 172.21.15.22:0/740674647 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6890019bb0 con 0x563430ff2090 2024-09-15T22:42:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.503+0000 7f688d600640 1 -- 172.21.15.22:0/740674647 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689002eb80 con 0x563430ff2090 2024-09-15T22:42:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 -- 172.21.15.22:0/740674647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 msgr2=0x563430ffc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ffc260 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x563430ff3400 tx=0x7f6890005fd0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 -- 172.21.15.22:0/740674647 shutdown_connections 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431003770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff29d0 0x563430ffc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 --2- 172.21.15.22:0/740674647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff2090 0x563430ffc260 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 -- 172.21.15.22:0/740674647 >> 172.21.15.22:0/740674647 conn(0x563430fed700 msgr2=0x563430fe86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 -- 172.21.15.22:0/740674647 shutdown_connections 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.504+0000 7f68a6a65740 1 -- 172.21.15.22:0/740674647 wait complete. 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 -- start start 2024-09-15T22:42:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 Processor -- start 2024-09-15T22:42:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563431000640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563431000b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1a9800 con 0x563430ff2090 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1aac70 con 0x563430ff29d0 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1a9ed0 con 0x563430ff7a60 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f68a6a65740 10 client.0 _ll_register_callbacks cb 0x7f689409bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.505+0000 7f689be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563431000b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563431000b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:39322/0 (socket says 172.21.15.22:39322) 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 -- 172.21.15.22:0/1668416247 learned_addr learned my addr 172.21.15.22:0/1668416247 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f68a1200640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563431000640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f68a1c00640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 -- 172.21.15.22:0/1668416247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 msgr2=0x563431079200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431079200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 -- 172.21.15.22:0/1668416247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 msgr2=0x563431000640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563431000640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 -- 172.21.15.22:0/1668416247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563431079740 con 0x563430ff29d0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f68a1c00640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431079200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f689be00640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563431000b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6888000c00 tx=0x7f68880056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77effc9879a2d0da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.506+0000 7f6882a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f6882a00640 1 -- 172.21.15.22:0/1668416247 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888037040 con 0x563430ff29d0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6890019bb0 con 0x563430ff29d0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f6882a00640 1 -- 172.21.15.22:0/1668416247 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f6888003c00 con 0x563430ff29d0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f6882a00640 1 -- 172.21.15.22:0/1668416247 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f688805b050 con 0x563430ff29d0 2024-09-15T22:42:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f68a6a65740 10 client.25742 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56343107a8b0 con 0x563430ff29d0 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.507+0000 7f6882a00640 1 -- 172.21.15.22:0/1668416247 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6890019bb0 con 0x563430ff29d0 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f6882a00640 1 -- 172.21.15.22:0/1668416247 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f688803f5d0 con 0x563430ff29d0 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a6a65740 10 client.25742 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a6a65740 10 client.25742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a6a65740 20 client.25742 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343107d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a6a65740 4 client.25742 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563430f5eb80 con 0x563431007ce0 2024-09-15T22:42:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.508+0000 7f68a1200640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343107d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.509+0000 7f68a1200640 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343107d2f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a348f6eb89908af server_cookie=724741bfff3ffef7 in_seq=0 out_seq=0 2024-09-15T22:42:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.509+0000 7f6882a00640 10 client.25742 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.534+0000 7f6882a00640 1 -- 172.21.15.22:0/1668416247 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563430f5eb80 con 0x563431007ce0 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.534+0000 7f6882a00640 10 client.25742 handle_command_reply: tid=0 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.534+0000 7f68a6a65740 1 client.25742 shutdown 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 msgr2=0x563431000b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563431000b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6888000c00 tx=0x7f68880056d0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 shutdown_connections 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563431007ce0 0x56343107d2f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563430ff7a60 0x563431079200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563430ff29d0 0x563431000b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 --2- 172.21.15.22:0/1668416247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563430ff2090 0x563431000640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 >> 172.21.15.22:0/1668416247 conn(0x563430fed700 msgr2=0x563430ff3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f6882a00640 0 client.25742 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 shutdown_connections 2024-09-15T22:42:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 1 -- 172.21.15.22:0/1668416247 wait complete. 2024-09-15T22:42:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.535+0000 7f68a6a65740 20 client.25742 trim_cache size 0 max 16384 2024-09-15T22:42:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:42:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:42:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:42:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.536+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68840a32f0 msgr2=0x7f68840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.536+0000 7f68a3c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68840a32f0 0x7f68840a57b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6888009830 tx=0x7f6888030550 comp rx=0 tx=0).stop 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.536+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 msgr2=0x7f689c1a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.536+0000 7f68a3c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 0x7f689c1a1560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f689400eaa0 tx=0x7f689400ef60 comp rx=0 tx=0).stop 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 shutdown_connections 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f689c105910 0x7f689c1a1560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68840a32f0 0x7f68840a57b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f689c104f50 0x7f689c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 --2- 172.21.15.22:0/2939602237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c103d60 0x7f689c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 >> 172.21.15.22:0/2939602237 conn(0x7f689c0ff4e0 msgr2=0x7f689c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 shutdown_connections 2024-09-15T22:42:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:18.537+0000 7f68a3c00640 1 -- 172.21.15.22:0/2939602237 wait complete. 2024-09-15T22:42:19.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:19 smithi022 ceph-mon[30634]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 278 MiB/s wr, 1.02k op/s 2024-09-15T22:42:19.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:19 smithi112 ceph-mon[35032]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 278 MiB/s wr, 1.02k op/s 2024-09-15T22:42:19.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:19 smithi110 ceph-mon[35282]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 278 MiB/s wr, 1.02k op/s 2024-09-15T22:42:21.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:21 smithi022 ceph-mon[30634]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 265 MiB/s wr, 970 op/s 2024-09-15T22:42:21.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:21 smithi112 ceph-mon[35032]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 265 MiB/s wr, 970 op/s 2024-09-15T22:42:21.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:21 smithi110 ceph-mon[35282]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 265 MiB/s wr, 970 op/s 2024-09-15T22:42:23.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:23 smithi022 ceph-mon[30634]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 283 MiB/s wr, 1.04k op/s 2024-09-15T22:42:23.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:23 smithi112 ceph-mon[35032]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 283 MiB/s wr, 1.04k op/s 2024-09-15T22:42:23.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:23 smithi110 ceph-mon[35282]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 283 MiB/s wr, 1.04k op/s 2024-09-15T22:42:25.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:25 smithi022 ceph-mon[30634]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 277 MiB/s wr, 1.02k op/s 2024-09-15T22:42:25.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:25 smithi112 ceph-mon[35032]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 277 MiB/s wr, 1.02k op/s 2024-09-15T22:42:25.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:25 smithi110 ceph-mon[35282]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 277 MiB/s wr, 1.02k op/s 2024-09-15T22:42:27.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:27 smithi022 ceph-mon[30634]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 985 op/s 2024-09-15T22:42:27.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:27 smithi112 ceph-mon[35032]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 985 op/s 2024-09-15T22:42:27.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:27 smithi110 ceph-mon[35282]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 985 op/s 2024-09-15T22:42:29.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:29 smithi112 ceph-mon[35032]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 285 MiB/s wr, 1.06k op/s 2024-09-15T22:42:29.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:29 smithi110 ceph-mon[35282]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 285 MiB/s wr, 1.06k op/s 2024-09-15T22:42:29.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:29 smithi022 ceph-mon[30634]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 285 MiB/s wr, 1.06k op/s 2024-09-15T22:42:31.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:31 smithi112 ceph-mon[35032]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 989 op/s 2024-09-15T22:42:31.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:31 smithi110 ceph-mon[35282]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 989 op/s 2024-09-15T22:42:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 -- 172.21.15.22:0/983091926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60109700 msgr2=0x7f8c60109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 --2- 172.21.15.22:0/983091926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60109700 0x7f8c60109b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009900 tx=0x7f8c5002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 -- 172.21.15.22:0/983091926 shutdown_connections 2024-09-15T22:42:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 --2- 172.21.15.22:0/983091926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c600736c0 0x7f8c60119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 --2- 172.21.15.22:0/983091926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c60072d20 0x7f8c60073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 --2- 172.21.15.22:0/983091926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60109700 0x7f8c60109b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 -- 172.21.15.22:0/983091926 >> 172.21.15.22:0/983091926 conn(0x7f8c6006ece0 msgr2=0x7f8c60071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 -- 172.21.15.22:0/983091926 shutdown_connections 2024-09-15T22:42:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.770+0000 7f8c67000640 1 -- 172.21.15.22:0/983091926 wait complete. 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.771+0000 7f8c67000640 1 Processor -- start 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.771+0000 7f8c67000640 1 -- start start 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c67000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 0x7f8c601a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c67000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c600736c0 0x7f8c601a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c67000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c60109700 0x7f8c601ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c67000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6011c600 con 0x7f8c600736c0 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c67000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6011c480 con 0x7f8c60072d20 2024-09-15T22:42:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c67000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6011c780 con 0x7f8c60109700 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 0x7f8c601a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 0x7f8c601a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37490/0 (socket says 172.21.15.22:37490) 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c5fe00640 1 -- 172.21.15.22:0/2059294729 learned_addr learned my addr 172.21.15.22:0/2059294729 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c65000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c60109700 0x7f8c601ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c5f400640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c600736c0 0x7f8c601a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c65000640 1 -- 172.21.15.22:0/2059294729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 msgr2=0x7f8c601a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c65000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 0x7f8c601a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c65000640 1 -- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c600736c0 msgr2=0x7f8c601a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c65000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c600736c0 0x7f8c601a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c65000640 1 -- 172.21.15.22:0/2059294729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601ae7f0 con 0x7f8c60109700 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.772+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 0x7f8c601a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.773+0000 7f8c65000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c60109700 0x7f8c601ae180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009fd0 tx=0x7f8c5800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.773+0000 7f8c5cc00640 1 -- 172.21.15.22:0/2059294729 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800ce20 con 0x7f8c60109700 2024-09-15T22:42:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.773+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601aeae0 con 0x7f8c60109700 2024-09-15T22:42:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.773+0000 7f8c5cc00640 1 -- 172.21.15.22:0/2059294729 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c58005020 con 0x7f8c60109700 2024-09-15T22:42:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.773+0000 7f8c5cc00640 1 -- 172.21.15.22:0/2059294729 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58010720 con 0x7f8c60109700 2024-09-15T22:42:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.773+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601af030 con 0x7f8c60109700 2024-09-15T22:42:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.776+0000 7f8c69e58740 1 Processor -- start 2024-09-15T22:42:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.778+0000 7f8c5cc00640 1 -- 172.21.15.22:0/2059294729 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8c58005540 con 0x7f8c60109700 2024-09-15T22:42:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.778+0000 7f8c69e58740 1 -- start start 2024-09-15T22:42:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 0x560549b86490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b869d0 0x560549b8b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b8df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c69e58740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560549aeb100 con 0x560549b8ba60 2024-09-15T22:42:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c69e58740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560549a931b0 con 0x560549b869d0 2024-09-15T22:42:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c69e58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560549ae70c0 con 0x560549b86090 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 0x560549b86490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b869d0 0x560549b8b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 0x560549b86490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50644/0 (socket says 172.21.15.22:50644) 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5f400640 1 -- 172.21.15.22:0/1153190503 learned_addr learned my addr 172.21.15.22:0/1153190503 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5f400640 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b8df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5fe00640 1 -- 172.21.15.22:0/1153190503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 msgr2=0x560549b86490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 0x560549b86490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5fe00640 1 -- 172.21.15.22:0/1153190503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 msgr2=0x560549b8df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b8df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5fe00640 1 -- 172.21.15.22:0/1153190503 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605497fe210 con 0x560549b869d0 2024-09-15T22:42:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.779+0000 7f8c5f400640 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 0x560549b86490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.780+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b869d0 0x560549b8b490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c50006010 tx=0x7f8c50004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b57242066ad330b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.780+0000 7f8c5cc00640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c440a32f0 0x7f8c440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:31 smithi022 ceph-mon[30634]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 266 MiB/s wr, 989 op/s 2024-09-15T22:42:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.780+0000 7f8c5cc00640 1 -- 172.21.15.22:0/2059294729 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8c580cff40 con 0x7f8c60109700 2024-09-15T22:42:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.781+0000 7f8c5f400640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c440a32f0 0x7f8c440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.781+0000 7f8c55600640 1 -- 172.21.15.22:0/1153190503 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50040070 con 0x560549b869d0 2024-09-15T22:42:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.781+0000 7f8c55600640 1 -- 172.21.15.22:0/1153190503 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c500047a0 con 0x560549b869d0 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.781+0000 7f8c55600640 1 -- 172.21.15.22:0/1153190503 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50035040 con 0x560549b869d0 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 -- 172.21.15.22:0/1153190503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b869d0 msgr2=0x560549b8b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c5f400640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c440a32f0 0x7f8c440a57b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00bfd0 tx=0x7f8c4c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b869d0 0x560549b8b490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c50006010 tx=0x7f8c50004520 comp rx=0 tx=0).stop 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 -- 172.21.15.22:0/1153190503 shutdown_connections 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b8df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b869d0 0x560549b8b490 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1153190503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b86090 0x560549b86490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 -- 172.21.15.22:0/1153190503 >> 172.21.15.22:0/1153190503 conn(0x560549b81700 msgr2=0x560549b81b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 -- 172.21.15.22:0/1153190503 shutdown_connections 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 -- 172.21.15.22:0/1153190503 wait complete. 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.782+0000 7f8c69e58740 1 -- start start 2024-09-15T22:42:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 Processor -- start 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b90270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549b97780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560549b8e9d0 con 0x560549b86090 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560549a74090 con 0x560549b8ba60 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560549b8eb50 con 0x560549b869d0 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c69e58740 10 client.0 _ll_register_callbacks cb 0x560549ac8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b907b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:50652/0 (socket says 172.21.15.22:50652) 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c5f400640 1 -- 172.21.15.22:0/2228949524 learned_addr learned my addr 172.21.15.22:0/2228949524 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.783+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b90270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c65000640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549b97780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c5f400640 1 -- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 msgr2=0x560549b97780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c5f400640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549b97780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c5f400640 1 -- 172.21.15.22:0/2228949524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 msgr2=0x560549b90270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c5f400640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b90270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c5f400640 1 -- 172.21.15.22:0/2228949524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605498ca620 con 0x560549b869d0 2024-09-15T22:42:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c5f400640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b907b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c005fd0 tx=0x7f8c4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf08dd91621ca4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c4a000640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:42:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c4a000640 1 -- 172.21.15.22:0/2228949524 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c004020 con 0x560549b869d0 2024-09-15T22:42:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c500047a0 con 0x560549b869d0 2024-09-15T22:42:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c4a000640 1 -- 172.21.15.22:0/2228949524 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8c4c0041c0 con 0x560549b869d0 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c4a000640 1 -- 172.21.15.22:0/2228949524 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8c4c0043c0 con 0x560549b869d0 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c69e58740 10 client.25792 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.784+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560549b9a5e0 con 0x560549b869d0 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c4a000640 1 -- 172.21.15.22:0/2228949524 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c500047a0 con 0x560549b869d0 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c4a000640 1 -- 172.21.15.22:0/2228949524 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8c4c031020 con 0x560549b869d0 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c69e58740 10 client.25792 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c69e58740 10 client.25792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c69e58740 20 client.25792 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c69e58740 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549b9bc60 0x560549b9e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c69e58740 4 client.25792 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560549af8830 con 0x560549b9bc60 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.785+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549b9bc60 0x560549b9e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.786+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549b9bc60 0x560549b9e0f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0d498c887a619be server_cookie=c6f8595c1987452d in_seq=0 out_seq=0 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.786+0000 7f8c4a000640 10 client.25792 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c4a000640 1 -- 172.21.15.22:0/2228949524 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560549af8830 con 0x560549b9bc60 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c4a000640 10 client.25792 handle_command_reply: tid=0 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 client.25792 shutdown 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 msgr2=0x560549b907b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b907b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c005fd0 tx=0x7f8c4c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 shutdown_connections 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549b9bc60 0x560549b9e0f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b907b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c4a000640 0 client.25792 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549b97780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 --2- 172.21.15.22:0/2228949524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b90270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 >> 172.21.15.22:0/2228949524 conn(0x560549b81700 msgr2=0x560549b82f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 shutdown_connections 2024-09-15T22:42:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 1 -- 172.21.15.22:0/2228949524 wait complete. 2024-09-15T22:42:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.787+0000 7f8c69e58740 20 client.25792 trim_cache size 0 max 16384 2024-09-15T22:42:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 Processor -- start 2024-09-15T22:42:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 -- start start 2024-09-15T22:42:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b80770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b97740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549ba29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601ba6c0 con 0x560549b86090 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.815+0000 7f8c69e58740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601b7f90 con 0x560549b8ba60 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.816+0000 7f8c69e58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601b5dc0 con 0x560549b869d0 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.816+0000 7f8c65000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549ba29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.816+0000 7f8c65000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549ba29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37510/0 (socket says 172.21.15.22:37510) 2024-09-15T22:42:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.816+0000 7f8c65000640 1 -- 172.21.15.22:0/1942197350 learned_addr learned my addr 172.21.15.22:0/1942197350 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.817+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b80770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.817+0000 7f8c65000640 1 -- 172.21.15.22:0/1942197350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 msgr2=0x560549b97740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:42:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.817+0000 7f8c65000640 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b97740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.817+0000 7f8c65000640 1 -- 172.21.15.22:0/1942197350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 msgr2=0x560549b80770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.817+0000 7f8c65000640 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b80770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.817+0000 7f8c65000640 1 -- 172.21.15.22:0/1942197350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560549b8e280 con 0x560549b8ba60 2024-09-15T22:42:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.818+0000 7f8c65000640 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549ba29f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c760 tx=0x7f8c5809c160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61546577d253271f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.819+0000 7f8c54c00640 1 -- 172.21.15.22:0/1942197350 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580b4070 con 0x560549b8ba60 2024-09-15T22:42:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.819+0000 7f8c54c00640 1 -- 172.21.15.22:0/1942197350 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c5809c520 con 0x560549b8ba60 2024-09-15T22:42:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.819+0000 7f8c54c00640 1 -- 172.21.15.22:0/1942197350 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580a4d00 con 0x560549b8ba60 2024-09-15T22:42:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 -- 172.21.15.22:0/1942197350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 msgr2=0x560549ba29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549ba29f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c760 tx=0x7f8c5809c160 comp rx=0 tx=0).stop 2024-09-15T22:42:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 -- 172.21.15.22:0/1942197350 shutdown_connections 2024-09-15T22:42:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b97740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b8ba60 0x560549ba29f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 --2- 172.21.15.22:0/1942197350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b86090 0x560549b80770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.821+0000 7f8c69e58740 1 -- 172.21.15.22:0/1942197350 >> 172.21.15.22:0/1942197350 conn(0x560549b81700 msgr2=0x560549b80060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.822+0000 7f8c69e58740 1 -- 172.21.15.22:0/1942197350 shutdown_connections 2024-09-15T22:42:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.822+0000 7f8c69e58740 1 -- 172.21.15.22:0/1942197350 wait complete. 2024-09-15T22:42:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.823+0000 7f8c69e58740 1 -- start start 2024-09-15T22:42:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.823+0000 7f8c69e58740 1 Processor -- start 2024-09-15T22:42:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.824+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 0x560549b92c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.824+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b93140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.825+0000 7f8c69e58740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b96110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.825+0000 7f8c69e58740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601b6450 con 0x560549b8ba60 2024-09-15T22:42:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.825+0000 7f8c69e58740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601b78c0 con 0x560549b86090 2024-09-15T22:42:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.825+0000 7f8c69e58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601b6b20 con 0x560549b869d0 2024-09-15T22:42:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.825+0000 7f8c69e58740 10 client.0 _ll_register_callbacks cb 0x7f8c4c00ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.826+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 0x560549b92c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.826+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 0x560549b92c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:37516/0 (socket says 172.21.15.22:37516) 2024-09-15T22:42:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.826+0000 7f8c5fe00640 1 -- 172.21.15.22:0/3987955516 learned_addr learned my addr 172.21.15.22:0/3987955516 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.826+0000 7f8c5f400640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b93140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.826+0000 7f8c65000640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b96110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c5fe00640 1 -- 172.21.15.22:0/3987955516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 msgr2=0x560549b93140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b93140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c5fe00640 1 -- 172.21.15.22:0/3987955516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 msgr2=0x560549b96110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b96110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c5fe00640 1 -- 172.21.15.22:0/3987955516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560549b96720 con 0x560549b86090 2024-09-15T22:42:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c65000640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b96110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.827+0000 7f8c4a000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.828+0000 7f8c5fe00640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 0x560549b92c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c5002a9e0 tx=0x7f8c500315b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9403482c770b005 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.828+0000 7f8c4a000640 1 -- 172.21.15.22:0/3987955516 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50040040 con 0x560549b86090 2024-09-15T22:42:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.828+0000 7f8c4a000640 1 -- 172.21.15.22:0/3987955516 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8c50031730 con 0x560549b86090 2024-09-15T22:42:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.829+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5809c520 con 0x560549b86090 2024-09-15T22:42:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.829+0000 7f8c4a000640 1 -- 172.21.15.22:0/3987955516 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8c50035040 con 0x560549b86090 2024-09-15T22:42:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.829+0000 7f8c69e58740 10 client.25760 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.829+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560549b97aa0 con 0x560549b86090 2024-09-15T22:42:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.830+0000 7f8c4a000640 1 -- 172.21.15.22:0/3987955516 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c5809c520 con 0x560549b86090 2024-09-15T22:42:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.830+0000 7f8c4a000640 1 -- 172.21.15.22:0/3987955516 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8c50003cc0 con 0x560549b86090 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c69e58740 10 client.25760 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c69e58740 10 client.25760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c69e58740 20 client.25760 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c69e58740 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549c17d80 0x560549c1a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c69e58740 4 client.25760 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560549af2b80 con 0x560549c17d80 2024-09-15T22:42:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.831+0000 7f8c5f400640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549c17d80 0x560549c1a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.832+0000 7f8c5f400640 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549c17d80 0x560549c1a170 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e0502e9ddf3d8b server_cookie=5b93f20eada309df in_seq=0 out_seq=0 2024-09-15T22:42:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.832+0000 7f8c4a000640 10 client.25760 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.854+0000 7f8c4a000640 1 -- 172.21.15.22:0/3987955516 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560549af2b80 con 0x560549c17d80 2024-09-15T22:42:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.854+0000 7f8c4a000640 10 client.25760 handle_command_reply: tid=0 2024-09-15T22:42:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.854+0000 7f8c69e58740 1 client.25760 shutdown 2024-09-15T22:42:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 msgr2=0x560549b92c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 0x560549b92c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c5002a9e0 tx=0x7f8c500315b0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 shutdown_connections 2024-09-15T22:42:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x560549c17d80 0x560549c1a170 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560549b869d0 0x560549b93140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560549b8ba60 0x560549b96110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 --2- 172.21.15.22:0/3987955516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560549b86090 0x560549b92c00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 >> 172.21.15.22:0/3987955516 conn(0x560549b81700 msgr2=0x560549b80060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c4a000640 0 client.25760 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 shutdown_connections 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.855+0000 7f8c69e58740 1 -- 172.21.15.22:0/3987955516 wait complete. 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.856+0000 7f8c69e58740 20 client.25760 trim_cache size 0 max 16384 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:42:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:42:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:42:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.858+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c440a32f0 msgr2=0x7f8c440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.858+0000 7f8c67000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c440a32f0 0x7f8c440a57b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00bfd0 tx=0x7f8c4c004730 comp rx=0 tx=0).stop 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.858+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c60109700 msgr2=0x7f8c601ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.858+0000 7f8c67000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c60109700 0x7f8c601ae180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009fd0 tx=0x7f8c5800ef10 comp rx=0 tx=0).stop 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.859+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 shutdown_connections 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.859+0000 7f8c67000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c60109700 0x7f8c601ae180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.859+0000 7f8c67000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8c440a32f0 0x7f8c440a57b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.859+0000 7f8c67000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c600736c0 0x7f8c601a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.859+0000 7f8c67000640 1 --2- 172.21.15.22:0/2059294729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c60072d20 0x7f8c601a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.859+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 >> 172.21.15.22:0/2059294729 conn(0x7f8c6006ece0 msgr2=0x7f8c600716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.860+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 shutdown_connections 2024-09-15T22:42:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:31.860+0000 7f8c67000640 1 -- 172.21.15.22:0/2059294729 wait complete. 2024-09-15T22:42:33.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:33 smithi112 ceph-mon[35032]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 280 MiB/s wr, 1.04k op/s 2024-09-15T22:42:33.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:33 smithi110 ceph-mon[35282]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 280 MiB/s wr, 1.04k op/s 2024-09-15T22:42:33.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:33 smithi022 ceph-mon[30634]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 280 MiB/s wr, 1.04k op/s 2024-09-15T22:42:35.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:35 smithi110 ceph-mon[35282]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 270 MiB/s wr, 1.01k op/s 2024-09-15T22:42:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:35 smithi022 ceph-mon[30634]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 270 MiB/s wr, 1.01k op/s 2024-09-15T22:42:35.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:35 smithi112 ceph-mon[35032]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 270 MiB/s wr, 1.01k op/s 2024-09-15T22:42:37.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:37 smithi110 ceph-mon[35282]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 259 MiB/s wr, 968 op/s 2024-09-15T22:42:37.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:37 smithi022 ceph-mon[30634]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 259 MiB/s wr, 968 op/s 2024-09-15T22:42:37.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:37 smithi112 ceph-mon[35032]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 259 MiB/s wr, 968 op/s 2024-09-15T22:42:39.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:39 smithi110 ceph-mon[35282]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 279 MiB/s wr, 1.05k op/s 2024-09-15T22:42:39.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:39 smithi022 ceph-mon[30634]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 279 MiB/s wr, 1.05k op/s 2024-09-15T22:42:39.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:39 smithi112 ceph-mon[35032]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 279 MiB/s wr, 1.05k op/s 2024-09-15T22:42:41.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:41 smithi110 ceph-mon[35282]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 257 MiB/s wr, 959 op/s 2024-09-15T22:42:41.787 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:41 smithi022 ceph-mon[30634]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 257 MiB/s wr, 959 op/s 2024-09-15T22:42:41.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:41 smithi112 ceph-mon[35032]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 257 MiB/s wr, 959 op/s 2024-09-15T22:42:43.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:43 smithi110 ceph-mon[35282]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 1.02k op/s 2024-09-15T22:42:43.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:43 smithi022 ceph-mon[30634]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 1.02k op/s 2024-09-15T22:42:43.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:43 smithi112 ceph-mon[35032]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 272 MiB/s wr, 1.02k op/s 2024-09-15T22:42:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 -- 172.21.15.22:0/236470677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 msgr2=0x7f8d70103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 --2- 172.21.15.22:0/236470677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 0x7f8d70103680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009900 tx=0x7f8d6402a480 comp rx=0 tx=0).stop 2024-09-15T22:42:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 -- 172.21.15.22:0/236470677 shutdown_connections 2024-09-15T22:42:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 --2- 172.21.15.22:0/236470677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d701066d0 0x7f8d70108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 --2- 172.21.15.22:0/236470677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d70103bc0 0x7f8d70106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 --2- 172.21.15.22:0/236470677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 0x7f8d70103680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.091+0000 7f8d78000640 1 -- 172.21.15.22:0/236470677 >> 172.21.15.22:0/236470677 conn(0x7f8d700fb500 msgr2=0x7f8d700fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.092+0000 7f8d78000640 1 -- 172.21.15.22:0/236470677 shutdown_connections 2024-09-15T22:42:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.092+0000 7f8d78000640 1 -- 172.21.15.22:0/236470677 wait complete. 2024-09-15T22:42:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.093+0000 7f8d78000640 1 Processor -- start 2024-09-15T22:42:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.094+0000 7f8d78000640 1 -- start start 2024-09-15T22:42:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.094+0000 7f8d78000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 0x7f8d7019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d78000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d70103bc0 0x7f8d7019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d78000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 0x7f8d701a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d78000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7010d830 con 0x7f8d701066d0 2024-09-15T22:42:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d78000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7010d6b0 con 0x7f8d70103bc0 2024-09-15T22:42:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d78000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7010d9b0 con 0x7f8d70101290 2024-09-15T22:42:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d76000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 0x7f8d701a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d76000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 0x7f8d701a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48468/0 (socket says 172.21.15.22:48468) 2024-09-15T22:42:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d76000640 1 -- 172.21.15.22:0/2708821797 learned_addr learned my addr 172.21.15.22:0/2708821797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.095+0000 7f8d74c00640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d70103bc0 0x7f8d7019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.096+0000 7f8d76000640 1 -- 172.21.15.22:0/2708821797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 msgr2=0x7f8d7019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.096+0000 7f8d76000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 0x7f8d7019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.096+0000 7f8d76000640 1 -- 172.21.15.22:0/2708821797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d70103bc0 msgr2=0x7f8d7019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.096+0000 7f8d76000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d70103bc0 0x7f8d7019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.096+0000 7f8d76000640 1 -- 172.21.15.22:0/2708821797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d701a1c50 con 0x7f8d701066d0 2024-09-15T22:42:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.096+0000 7f8d76000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 0x7f8d701a15e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800eaa0 tx=0x7f8d6800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.097+0000 7f8d6e000640 1 -- 172.21.15.22:0/2708821797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6800cdb0 con 0x7f8d701066d0 2024-09-15T22:42:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.097+0000 7f8d6e000640 1 -- 172.21.15.22:0/2708821797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68005020 con 0x7f8d701066d0 2024-09-15T22:42:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.097+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d701a1f40 con 0x7f8d701066d0 2024-09-15T22:42:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.097+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d701a2400 con 0x7f8d701066d0 2024-09-15T22:42:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.097+0000 7f8d6e000640 1 -- 172.21.15.22:0/2708821797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d680116b0 con 0x7f8d701066d0 2024-09-15T22:42:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.102+0000 7f8d7ae84740 1 Processor -- start 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d6e000640 1 -- 172.21.15.22:0/2708821797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8d68011850 con 0x7f8d701066d0 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 -- start start 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e701490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 0x55688e706490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e708f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55688e666100 con 0x55688e7019d0 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55688e60e1b0 con 0x55688e701090 2024-09-15T22:42:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.103+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55688e6620c0 con 0x55688e706a60 2024-09-15T22:42:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.104+0000 7f8d75600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 0x55688e706490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.104+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e708f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.104+0000 7f8d75600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 0x55688e706490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48476/0 (socket says 172.21.15.22:48476) 2024-09-15T22:42:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.104+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e708f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:38454/0 (socket says 172.21.15.22:38454) 2024-09-15T22:42:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.104+0000 7f8d75600640 1 -- 172.21.15.22:0/4012824400 learned_addr learned my addr 172.21.15.22:0/4012824400 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.104+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e701490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d75600640 1 -- 172.21.15.22:0/4012824400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 msgr2=0x55688e708f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d75600640 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e708f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d75600640 1 -- 172.21.15.22:0/4012824400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 msgr2=0x55688e701490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d75600640 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e701490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d75600640 1 -- 172.21.15.22:0/4012824400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55688e379210 con 0x55688e7019d0 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d6e000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d580a33f0 0x7f8d580a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.105+0000 7f8d6e000640 1 -- 172.21.15.22:0/2708821797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8d680cfb70 con 0x7f8d701066d0 2024-09-15T22:42:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.106+0000 7f8d75600640 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 0x55688e706490 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8d640314e0 tx=0x7f8d64000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce29c4a377b5e5b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.107+0000 7f8d74c00640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d580a33f0 0x7f8d580a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.107+0000 7f8d62600640 1 -- 172.21.15.22:0/4012824400 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6403e070 con 0x55688e7019d0 2024-09-15T22:42:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.107+0000 7f8d62600640 1 -- 172.21.15.22:0/4012824400 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d64005530 con 0x55688e7019d0 2024-09-15T22:42:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.107+0000 7f8d62600640 1 -- 172.21.15.22:0/4012824400 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64035040 con 0x55688e7019d0 2024-09-15T22:42:45.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.108+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4012824400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 msgr2=0x55688e706490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.108+0000 7f8d74c00640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d580a33f0 0x7f8d580a58b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8d7019b540 tx=0x7f8d5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.108+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 0x55688e706490 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8d640314e0 tx=0x7f8d64000bc0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.114+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4012824400 shutdown_connections 2024-09-15T22:42:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.114+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e708f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.114+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e7019d0 0x55688e706490 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.114+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4012824400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e701490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.114+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4012824400 >> 172.21.15.22:0/4012824400 conn(0x55688e6fc700 msgr2=0x55688e6fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.114+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4012824400 shutdown_connections 2024-09-15T22:42:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.115+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4012824400 wait complete. 2024-09-15T22:42:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.115+0000 7f8d7ae84740 1 -- start start 2024-09-15T22:42:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.116+0000 7f8d7ae84740 1 Processor -- start 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e713ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e7019d0 0x55688e713ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e706a60 0x55688e71b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55688e7099d0 con 0x55688e706a60 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55688e5ef090 con 0x55688e701090 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55688e709b50 con 0x55688e7019d0 2024-09-15T22:42:45.118 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d7ae84740 10 client.0 _ll_register_callbacks cb 0x55688e643f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:45.119 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e7019d0 0x55688e713ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e7019d0 0x55688e713ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:38460/0 (socket says 172.21.15.22:38460) 2024-09-15T22:42:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.117+0000 7f8d74c00640 1 -- 172.21.15.22:0/1255001775 learned_addr learned my addr 172.21.15.22:0/1255001775 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.118+0000 7f8d75600640 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e713ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.119+0000 7f8d75600640 1 -- 172.21.15.22:0/1255001775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e7019d0 msgr2=0x55688e713ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.119+0000 7f8d75600640 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e7019d0 0x55688e713ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.119+0000 7f8d75600640 1 -- 172.21.15.22:0/1255001775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e706a60 msgr2=0x55688e71b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.119+0000 7f8d75600640 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e706a60 0x55688e71b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.119+0000 7f8d75600640 1 -- 172.21.15.22:0/1255001775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55688e445620 con 0x55688e701090 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.119+0000 7f8d75600640 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e713ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d64004b00 tx=0x7f8d640048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99304dfaffe0643b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.120+0000 7f8d56a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.120+0000 7f8d56a00640 1 -- 172.21.15.22:0/1255001775 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6403e030 con 0x55688e701090 2024-09-15T22:42:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.120+0000 7f8d56a00640 1 -- 172.21.15.22:0/1255001775 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8d64004340 con 0x55688e701090 2024-09-15T22:42:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.120+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d64005530 con 0x55688e701090 2024-09-15T22:42:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.121+0000 7f8d56a00640 1 -- 172.21.15.22:0/1255001775 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d64035040 con 0x55688e701090 2024-09-15T22:42:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.121+0000 7f8d7ae84740 10 client.25772 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.121+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55688e70d7f0 con 0x55688e701090 2024-09-15T22:42:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d56a00640 1 -- 172.21.15.22:0/1255001775 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d64005530 con 0x55688e701090 2024-09-15T22:42:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d56a00640 1 -- 172.21.15.22:0/1255001775 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d640035f0 con 0x55688e701090 2024-09-15T22:42:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d7ae84740 10 client.25772 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d7ae84740 10 client.25772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d7ae84740 20 client.25772 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e70ec00 0x55688e711030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d7ae84740 4 client.25772 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55688e673830 con 0x55688e70ec00 2024-09-15T22:42:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.122+0000 7f8d74c00640 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e70ec00 0x55688e711030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.123+0000 7f8d74c00640 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e70ec00 0x55688e711030 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=603f312fa8713133 server_cookie=f664fb1ce5b43c42 in_seq=0 out_seq=0 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.123+0000 7f8d56a00640 10 client.25772 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d56a00640 1 -- 172.21.15.22:0/1255001775 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55688e673830 con 0x55688e70ec00 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d56a00640 10 client.25772 handle_command_reply: tid=0 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 client.25772 shutdown 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 msgr2=0x55688e713ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e713ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d64004b00 tx=0x7f8d640048f0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 shutdown_connections 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e70ec00 0x55688e711030 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e7019d0 0x55688e713ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e706a60 0x55688e71b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/1255001775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e701090 0x55688e713ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.124+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 >> 172.21.15.22:0/1255001775 conn(0x55688e6fc700 msgr2=0x55688e6fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.125+0000 7f8d56a00640 0 client.25772 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.125+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 shutdown_connections 2024-09-15T22:42:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.125+0000 7f8d7ae84740 1 -- 172.21.15.22:0/1255001775 wait complete. 2024-09-15T22:42:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.125+0000 7f8d7ae84740 20 client.25772 trim_cache size 0 max 16384 2024-09-15T22:42:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 Processor -- start 2024-09-15T22:42:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 -- start start 2024-09-15T22:42:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e713750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e71afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e713c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50010e20 con 0x55688e701090 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5000e6f0 con 0x55688e7019d0 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.145+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5000c520 con 0x55688e706a60 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e71afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d76000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e713c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e71afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:42544/0 (socket says 172.21.15.22:42544) 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 -- 172.21.15.22:0/4291016744 learned_addr learned my addr 172.21.15.22:0/4291016744 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d76000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e713c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:38470/0 (socket says 172.21.15.22:38470) 2024-09-15T22:42:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d75600640 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e713750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 -- 172.21.15.22:0/4291016744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 msgr2=0x55688e713c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e713c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 -- 172.21.15.22:0/4291016744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 msgr2=0x55688e713750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e713750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 -- 172.21.15.22:0/4291016744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55688e7093d0 con 0x55688e7019d0 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d76000640 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e713c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.146+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e71afc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009b70 tx=0x7f8d5c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67e3f34fad9c06a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d61c00640 1 -- 172.21.15.22:0/4291016744 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c02f070 con 0x55688e7019d0 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d61c00640 1 -- 172.21.15.22:0/4291016744 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c022e10 con 0x55688e7019d0 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d61c00640 1 -- 172.21.15.22:0/4291016744 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c029bc0 con 0x55688e7019d0 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4291016744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 msgr2=0x55688e71afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e71afc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009b70 tx=0x7f8d5c004730 comp rx=0 tx=0).stop 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4291016744 shutdown_connections 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e713c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e71afc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4291016744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e713750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.147+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4291016744 >> 172.21.15.22:0/4291016744 conn(0x55688e6fc700 msgr2=0x55688e702c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.148+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4291016744 shutdown_connections 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.148+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4291016744 wait complete. 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.148+0000 7f8d7ae84740 1 -- start start 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.148+0000 7f8d7ae84740 1 Processor -- start 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.148+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e717bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.148+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e718100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d7ae84740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e790560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5000cbb0 con 0x55688e701090 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5000e020 con 0x55688e7019d0 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d7ae84740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5000d280 con 0x55688e706a60 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d7ae84740 10 client.0 _ll_register_callbacks cb 0x7f8d5c009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e718100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e718100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:42558/0 (socket says 172.21.15.22:42558) 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 -- 172.21.15.22:0/4007130525 learned_addr learned my addr 172.21.15.22:0/4007130525 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d75600640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e717bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d76000640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e790560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 -- 172.21.15.22:0/4007130525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 msgr2=0x55688e790560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e790560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 -- 172.21.15.22:0/4007130525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 msgr2=0x55688e717bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e717bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 -- 172.21.15.22:0/4007130525 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55688e71b1f0 con 0x55688e7019d0 2024-09-15T22:42:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d75600640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e717bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d74c00640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e718100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c023fd0 tx=0x7f8d5c009ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31dc55e829d2dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.149+0000 7f8d56a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d56a00640 1 -- 172.21.15.22:0/4007130525 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c02f030 con 0x55688e7019d0 2024-09-15T22:42:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d56a00640 1 -- 172.21.15.22:0/4007130525 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8d5c028040 con 0x55688e7019d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d5c022e10 con 0x55688e7019d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d56a00640 1 -- 172.21.15.22:0/4007130525 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d5c022930 con 0x55688e7019d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d7ae84740 10 client.25778 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55688e791a50 con 0x55688e7019d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.150+0000 7f8d56a00640 1 -- 172.21.15.22:0/4007130525 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c022e10 con 0x55688e7019d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d56a00640 1 -- 172.21.15.22:0/4007130525 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d5c035740 con 0x55688e7019d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d7ae84740 10 client.25778 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d7ae84740 10 client.25778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d7ae84740 20 client.25778 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e7923d0 0x55688e7947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d7ae84740 4 client.25778 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55688e66db80 con 0x55688e7923d0 2024-09-15T22:42:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d75600640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e7923d0 0x55688e7947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d75600640 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e7923d0 0x55688e7947f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba96cf631bf1490 server_cookie=642adbaf62cfbc93 in_seq=0 out_seq=0 2024-09-15T22:42:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.151+0000 7f8d56a00640 10 client.25778 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.171+0000 7f8d56a00640 1 -- 172.21.15.22:0/4007130525 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55688e66db80 con 0x55688e7923d0 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.171+0000 7f8d56a00640 10 client.25778 handle_command_reply: tid=0 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.171+0000 7f8d7ae84740 1 client.25778 shutdown 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.171+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 msgr2=0x55688e718100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e718100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c023fd0 tx=0x7f8d5c009ce0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 shutdown_connections 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55688e7923d0 0x55688e7947f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55688e706a60 0x55688e790560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55688e7019d0 0x55688e718100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 --2- 172.21.15.22:0/4007130525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55688e701090 0x55688e717bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 >> 172.21.15.22:0/4007130525 conn(0x55688e6fc700 msgr2=0x55688e713750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d56a00640 0 client.25778 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 shutdown_connections 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 1 -- 172.21.15.22:0/4007130525 wait complete. 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.172+0000 7f8d7ae84740 20 client.25778 trim_cache size 0 max 16384 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:42:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:42:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d580a33f0 msgr2=0x7f8d580a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d580a33f0 0x7f8d580a58b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8d7019b540 tx=0x7f8d5c005f90 comp rx=0 tx=0).stop 2024-09-15T22:42:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 msgr2=0x7f8d701a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 0x7f8d701a15e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800eaa0 tx=0x7f8d6800ef60 comp rx=0 tx=0).stop 2024-09-15T22:42:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 shutdown_connections 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8d580a33f0 0x7f8d580a58b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d701066d0 0x7f8d701a15e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d70103bc0 0x7f8d7019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 --2- 172.21.15.22:0/2708821797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d70101290 0x7f8d7019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.173+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 >> 172.21.15.22:0/2708821797 conn(0x7f8d700fb500 msgr2=0x7f8d7010c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.174+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 shutdown_connections 2024-09-15T22:42:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:45.174+0000 7f8d78000640 1 -- 172.21.15.22:0/2708821797 wait complete. 2024-09-15T22:42:45.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:45 smithi110 ceph-mon[35282]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 970 op/s 2024-09-15T22:42:45.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:45 smithi022 ceph-mon[30634]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 970 op/s 2024-09-15T22:42:45.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:45 smithi112 ceph-mon[35032]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 261 MiB/s wr, 970 op/s 2024-09-15T22:42:47.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:47 smithi110 ceph-mon[35282]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 254 MiB/s wr, 945 op/s 2024-09-15T22:42:47.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:47 smithi022 ceph-mon[30634]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 254 MiB/s wr, 945 op/s 2024-09-15T22:42:47.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:47 smithi112 ceph-mon[35032]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 254 MiB/s wr, 945 op/s 2024-09-15T22:42:49.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:49 smithi110 ceph-mon[35282]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 998 op/s 2024-09-15T22:42:49.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:49 smithi022 ceph-mon[30634]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 998 op/s 2024-09-15T22:42:49.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:49 smithi112 ceph-mon[35032]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 998 op/s 2024-09-15T22:42:51.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:51 smithi110 ceph-mon[35282]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 926 op/s 2024-09-15T22:42:51.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:51 smithi022 ceph-mon[30634]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 926 op/s 2024-09-15T22:42:51.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:51 smithi112 ceph-mon[35032]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 MiB/s wr, 926 op/s 2024-09-15T22:42:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:53 smithi110 ceph-mon[35282]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 984 op/s 2024-09-15T22:42:53.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:53 smithi022 ceph-mon[30634]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 984 op/s 2024-09-15T22:42:53.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:53 smithi112 ceph-mon[35032]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 267 MiB/s wr, 984 op/s 2024-09-15T22:42:55.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:55 smithi022 ceph-mon[30634]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 264 MiB/s wr, 974 op/s 2024-09-15T22:42:55.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:55 smithi112 ceph-mon[35032]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 264 MiB/s wr, 974 op/s 2024-09-15T22:42:55.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:55 smithi110 ceph-mon[35282]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 264 MiB/s wr, 974 op/s 2024-09-15T22:42:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:57 smithi022 ceph-mon[30634]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 257 MiB/s wr, 955 op/s 2024-09-15T22:42:57.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:57 smithi112 ceph-mon[35032]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 257 MiB/s wr, 955 op/s 2024-09-15T22:42:57.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:57 smithi110 ceph-mon[35282]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 257 MiB/s wr, 955 op/s 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.409+0000 7fb648000640 1 -- 172.21.15.22:0/1407392667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640104f50 msgr2=0x7fb6401053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.409+0000 7fb648000640 1 --2- 172.21.15.22:0/1407392667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640104f50 0x7fb6401053d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009900 tx=0x7fb62c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.409+0000 7fb648000640 1 -- 172.21.15.22:0/1407392667 shutdown_connections 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.409+0000 7fb648000640 1 --2- 172.21.15.22:0/1407392667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640104f50 0x7fb6401053d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.409+0000 7fb648000640 1 --2- 172.21.15.22:0/1407392667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640105910 0x7fb64010c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.409+0000 7fb648000640 1 --2- 172.21.15.22:0/1407392667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640103d60 0x7fb640104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.410+0000 7fb648000640 1 -- 172.21.15.22:0/1407392667 >> 172.21.15.22:0/1407392667 conn(0x7fb6400ff4e0 msgr2=0x7fb640101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.410+0000 7fb648000640 1 -- 172.21.15.22:0/1407392667 shutdown_connections 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.410+0000 7fb648000640 1 -- 172.21.15.22:0/1407392667 wait complete. 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 Processor -- start 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 -- start start 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640103d60 0x7fb640199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640104f50 0x7fb64019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640105910 0x7fb6401a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010fa10 con 0x7fb640105910 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010f890 con 0x7fb640104f50 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb648000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010fb90 con 0x7fb640103d60 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb644c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640104f50 0x7fb64019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb645600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640103d60 0x7fb640199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb644c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640104f50 0x7fb64019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:32860/0 (socket says 172.21.15.22:32860) 2024-09-15T22:42:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.411+0000 7fb644c00640 1 -- 172.21.15.22:0/2201144106 learned_addr learned my addr 172.21.15.22:0/2201144106 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb646000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640105910 0x7fb6401a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb645600640 1 -- 172.21.15.22:0/2201144106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640104f50 msgr2=0x7fb64019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb645600640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640104f50 0x7fb64019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb645600640 1 -- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640105910 msgr2=0x7fb6401a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb645600640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640105910 0x7fb6401a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb645600640 1 -- 172.21.15.22:0/2201144106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6401a1ba0 con 0x7fb640103d60 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb646000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640105910 0x7fb6401a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb645600640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640103d60 0x7fb640199f80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb640104db0 tx=0x7fb63400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.412+0000 7fb63e000640 1 -- 172.21.15.22:0/2201144106 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb634017070 con 0x7fb640103d60 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.413+0000 7fb63e000640 1 -- 172.21.15.22:0/2201144106 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb634009c30 con 0x7fb640103d60 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.413+0000 7fb63e000640 1 -- 172.21.15.22:0/2201144106 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63400f620 con 0x7fb640103d60 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.413+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6401a1e90 con 0x7fb640103d60 2024-09-15T22:42:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.413+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6401a2240 con 0x7fb640103d60 2024-09-15T22:42:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 Processor -- start 2024-09-15T22:42:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 -- start start 2024-09-15T22:42:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb63e000640 1 -- 172.21.15.22:0/2201144106 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb63401a070 con 0x7fb640103d60 2024-09-15T22:42:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09f0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09f5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5618b0955100 con 0x5618b09f5a60 2024-09-15T22:42:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5618b08fd1b0 con 0x5618b09f0090 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.417+0000 7fb64b01f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5618b09510c0 con 0x5618b09f09d0 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:32866/0 (socket says 172.21.15.22:32866) 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 -- 172.21.15.22:0/1665245523 learned_addr learned my addr 172.21.15.22:0/1665245523 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb645600640 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb644c00640 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 -- 172.21.15.22:0/1665245523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 msgr2=0x5618b09f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 -- 172.21.15.22:0/1665245523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 msgr2=0x5618b09f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.418+0000 7fb646000640 1 -- 172.21.15.22:0/1665245523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b0668210 con 0x5618b09f0090 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.419+0000 7fb646000640 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09f0490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb638009f10 tx=0x7fb63800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a4070291007d09e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.419+0000 7fb632600640 1 -- 172.21.15.22:0/1665245523 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638003b70 con 0x5618b09f0090 2024-09-15T22:42:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.419+0000 7fb632600640 1 -- 172.21.15.22:0/1665245523 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb638003d10 con 0x5618b09f0090 2024-09-15T22:42:58.422 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.419+0000 7fb632600640 1 -- 172.21.15.22:0/1665245523 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638011aa0 con 0x5618b09f0090 2024-09-15T22:42:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.420+0000 7fb63e000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb6280a3370 0x7fb6280a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.420+0000 7fb64b01f740 1 -- 172.21.15.22:0/1665245523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 msgr2=0x5618b09f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.420+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09f0490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb638009f10 tx=0x7fb63800f730 comp rx=0 tx=0).stop 2024-09-15T22:42:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.420+0000 7fb63e000640 1 -- 172.21.15.22:0/2201144106 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb6340cf370 con 0x7fb640103d60 2024-09-15T22:42:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.421+0000 7fb64b01f740 1 -- 172.21.15.22:0/1665245523 shutdown_connections 2024-09-15T22:42:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.421+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.421+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.421+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1665245523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09f0490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.421+0000 7fb64b01f740 1 -- 172.21.15.22:0/1665245523 >> 172.21.15.22:0/1665245523 conn(0x5618b09eb700 msgr2=0x5618b09ebb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.422+0000 7fb645600640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb6280a3370 0x7fb6280a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.423+0000 7fb64b01f740 1 -- 172.21.15.22:0/1665245523 shutdown_connections 2024-09-15T22:42:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.423+0000 7fb64b01f740 1 -- 172.21.15.22:0/1665245523 wait complete. 2024-09-15T22:42:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.424+0000 7fb64b01f740 1 -- start start 2024-09-15T22:42:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.424+0000 7fb64b01f740 1 Processor -- start 2024-09-15T22:42:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f09d0 0x5618b09fa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b0a01790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5618b09f8a30 con 0x5618b09f5a60 2024-09-15T22:42:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5618b08de090 con 0x5618b09f09d0 2024-09-15T22:42:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5618b09f8bb0 con 0x5618b09f0090 2024-09-15T22:42:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.425+0000 7fb64b01f740 10 client.0 _ll_register_callbacks cb 0x5618b0932f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.426+0000 7fb646000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.426+0000 7fb646000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09fa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:38902/0 (socket says 172.21.15.22:38902) 2024-09-15T22:42:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.426+0000 7fb646000640 1 -- 172.21.15.22:0/370059199 learned_addr learned my addr 172.21.15.22:0/370059199 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.426+0000 7fb644c00640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f09d0 0x5618b09fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.426+0000 7fb646000640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b0a01790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.427+0000 7fb644c00640 1 -- 172.21.15.22:0/370059199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 msgr2=0x5618b09fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.427+0000 7fb644c00640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.427+0000 7fb644c00640 1 -- 172.21.15.22:0/370059199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 msgr2=0x5618b0a01790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.427+0000 7fb644c00640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b0a01790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.427+0000 7fb644c00640 1 -- 172.21.15.22:0/370059199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b0734620 con 0x5618b09f09d0 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.428+0000 7fb644c00640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f09d0 0x5618b09fa750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb62c006010 tx=0x7fb62c0043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbaec468af0ad90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.428+0000 7fb626a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.429+0000 7fb626a00640 1 -- 172.21.15.22:0/370059199 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c035040 con 0x5618b09f09d0 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.429+0000 7fb626a00640 1 -- 172.21.15.22:0/370059199 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb62c005220 con 0x5618b09f09d0 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.429+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb638003d10 con 0x5618b09f09d0 2024-09-15T22:42:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.429+0000 7fb645600640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb6280a3370 0x7fb6280a5830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb634005fd0 tx=0x7fb63400bed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.432+0000 7fb626a00640 1 -- 172.21.15.22:0/370059199 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb62c005420 con 0x5618b09f09d0 2024-09-15T22:42:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 10 client.25790 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618b0a045f0 con 0x5618b09f09d0 2024-09-15T22:42:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb626a00640 1 -- 172.21.15.22:0/370059199 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb638003d10 con 0x5618b09f09d0 2024-09-15T22:42:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb626a00640 1 -- 172.21.15.22:0/370059199 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb62c031a30 con 0x5618b09f09d0 2024-09-15T22:42:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 10 client.25790 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 10 client.25790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 20 client.25790 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a05cc0 0x5618b0a080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 4 client.25790 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:42:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.433+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618b0962830 con 0x5618b0a05cc0 2024-09-15T22:42:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.435+0000 7fb646000640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a05cc0 0x5618b0a080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.435+0000 7fb646000640 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a05cc0 0x5618b0a080d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e05a28407cac1ac3 server_cookie=5b81dcc1e7827a8a in_seq=0 out_seq=0 2024-09-15T22:42:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.435+0000 7fb626a00640 10 client.25790 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.436+0000 7fb626a00640 1 -- 172.21.15.22:0/370059199 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618b0962830 con 0x5618b0a05cc0 2024-09-15T22:42:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.436+0000 7fb626a00640 10 client.25790 handle_command_reply: tid=0 2024-09-15T22:42:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.436+0000 7fb64b01f740 1 client.25790 shutdown 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f09d0 msgr2=0x5618b09fa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f09d0 0x5618b09fa750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb62c006010 tx=0x7fb62c0043b0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 shutdown_connections 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a05cc0 0x5618b0a080d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b0a01790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f09d0 0x5618b09fa750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 --2- 172.21.15.22:0/370059199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09fa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb626a00640 0 client.25790 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 >> 172.21.15.22:0/370059199 conn(0x5618b09eb700 msgr2=0x5618b09ecf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 shutdown_connections 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 1 -- 172.21.15.22:0/370059199 wait complete. 2024-09-15T22:42:58.439 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.437+0000 7fb64b01f740 20 client.25790 trim_cache size 0 max 16384 2024-09-15T22:42:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.467+0000 7fb64b01f740 1 Processor -- start 2024-09-15T22:42:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.467+0000 7fb64b01f740 1 -- start start 2024-09-15T22:42:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.468+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09ea770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.468+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f09d0 0x5618b0a01750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.468+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f5a60 0x5618b09ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.469+0000 7fb64b01f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401adb30 con 0x5618b09f09d0 2024-09-15T22:42:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.469+0000 7fb64b01f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ab400 con 0x5618b09f5a60 2024-09-15T22:42:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.469+0000 7fb64b01f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401a9230 con 0x5618b09f0090 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.469+0000 7fb646000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.470+0000 7fb644c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f09d0 0x5618b0a01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09ea770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:38918/0 (socket says 172.21.15.22:38918) 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 -- 172.21.15.22:0/3727124728 learned_addr learned my addr 172.21.15.22:0/3727124728 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f5a60 0x5618b09ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 -- 172.21.15.22:0/3727124728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f5a60 msgr2=0x5618b09ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f5a60 0x5618b09ecaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 -- 172.21.15.22:0/3727124728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f09d0 msgr2=0x5618b0a01750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f09d0 0x5618b0a01750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.471+0000 7fb646000640 1 -- 172.21.15.22:0/3727124728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b09e6d60 con 0x5618b09f0090 2024-09-15T22:42:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.472+0000 7fb646000640 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09ea770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb638009b50 tx=0x7fb638000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b61cce0b677a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.472+0000 7fb631c00640 1 -- 172.21.15.22:0/3727124728 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63802e040 con 0x5618b09f0090 2024-09-15T22:42:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.472+0000 7fb631c00640 1 -- 172.21.15.22:0/3727124728 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb638013310 con 0x5618b09f0090 2024-09-15T22:42:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.472+0000 7fb631c00640 1 -- 172.21.15.22:0/3727124728 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638024040 con 0x5618b09f0090 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.473+0000 7fb64b01f740 1 -- 172.21.15.22:0/3727124728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 msgr2=0x5618b09ea770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09ea770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb638009b50 tx=0x7fb638000f40 comp rx=0 tx=0).stop 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 -- 172.21.15.22:0/3727124728 shutdown_connections 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f5a60 0x5618b09ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f09d0 0x5618b0a01750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 --2- 172.21.15.22:0/3727124728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f0090 0x5618b09ea770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 -- 172.21.15.22:0/3727124728 >> 172.21.15.22:0/3727124728 conn(0x5618b09eb700 msgr2=0x5618b09ea060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 -- 172.21.15.22:0/3727124728 shutdown_connections 2024-09-15T22:42:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.474+0000 7fb64b01f740 1 -- 172.21.15.22:0/3727124728 wait complete. 2024-09-15T22:42:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.475+0000 7fb64b01f740 1 -- start start 2024-09-15T22:42:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.475+0000 7fb64b01f740 1 Processor -- start 2024-09-15T22:42:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.475+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09fea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb64b01f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb64b01f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401a98c0 con 0x5618b09f5a60 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb64b01f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401aad30 con 0x5618b09f0090 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb64b01f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401a9f90 con 0x5618b09f09d0 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb64b01f740 10 client.0 _ll_register_callbacks cb 0x7fb62c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb646000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb646000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09fea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:32896/0 (socket says 172.21.15.22:32896) 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb646000640 1 -- 172.21.15.22:0/1968540288 learned_addr learned my addr 172.21.15.22:0/1968540288 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:42:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb646000640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.476+0000 7fb644c00640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb646000640 1 -- 172.21.15.22:0/1968540288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 msgr2=0x5618b09fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb646000640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09fefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb646000640 1 -- 172.21.15.22:0/1968540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 msgr2=0x5618b09fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb646000640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb646000640 1 -- 172.21.15.22:0/1968540288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b0a005d0 con 0x5618b09f0090 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb646000640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09fea70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6380099e0 tx=0x7fb638005f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1ea08ee306f72d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.477+0000 7fb626a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:42:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb626a00640 1 -- 172.21.15.22:0/1968540288 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638013eb0 con 0x5618b09f0090 2024-09-15T22:42:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb626a00640 1 -- 172.21.15.22:0/1968540288 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb6380134c0 con 0x5618b09f0090 2024-09-15T22:42:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb638013310 con 0x5618b09f0090 2024-09-15T22:42:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb626a00640 1 -- 172.21.15.22:0/1968540288 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb6380136c0 con 0x5618b09f0090 2024-09-15T22:42:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb64b01f740 10 client.25796 fetch_fsmap learned FSMap version 25 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618b0a018e0 con 0x5618b09f0090 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.478+0000 7fb626a00640 1 -- 172.21.15.22:0/1968540288 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb638013310 con 0x5618b09f0090 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb626a00640 1 -- 172.21.15.22:0/1968540288 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb638033070 con 0x5618b09f0090 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb64b01f740 10 client.25796 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb64b01f740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb64b01f740 20 client.25796 populate_metadata read hostname 'smithi022' 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a70d40 0x5618b0a73130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb64b01f740 4 client.25796 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618b095cb80 con 0x5618b0a70d40 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.479+0000 7fb644c00640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a70d40 0x5618b0a73130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.480+0000 7fb644c00640 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a70d40 0x5618b0a73130 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77891f01b8bbef1 server_cookie=e6a886eb69c5414f in_seq=0 out_seq=0 2024-09-15T22:42:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.480+0000 7fb626a00640 10 client.25796 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.524+0000 7fb626a00640 1 -- 172.21.15.22:0/1968540288 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618b095cb80 con 0x5618b0a70d40 2024-09-15T22:42:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.524+0000 7fb626a00640 10 client.25796 handle_command_reply: tid=0 2024-09-15T22:42:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.524+0000 7fb64b01f740 1 client.25796 shutdown 2024-09-15T22:42:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.525+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 msgr2=0x5618b09fea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.525+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09fea70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6380099e0 tx=0x7fb638005f30 comp rx=0 tx=0).stop 2024-09-15T22:42:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 shutdown_connections 2024-09-15T22:42:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x5618b0a70d40 0x5618b0a73130 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618b09f09d0 0x5618b09fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618b09f5a60 0x5618b09fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 --2- 172.21.15.22:0/1968540288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5618b09f0090 0x5618b09fea70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 >> 172.21.15.22:0/1968540288 conn(0x5618b09eb700 msgr2=0x5618b09ea880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb626a00640 0 client.25796 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:42:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.526+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 shutdown_connections 2024-09-15T22:42:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.527+0000 7fb64b01f740 1 -- 172.21.15.22:0/1968540288 wait complete. 2024-09-15T22:42:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.527+0000 7fb64b01f740 20 client.25796 trim_cache size 0 max 16384 2024-09-15T22:42:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:42:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:42:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:42:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb6280a3370 msgr2=0x7fb6280a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb6280a3370 0x7fb6280a5830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb634005fd0 tx=0x7fb63400bed0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640103d60 msgr2=0x7fb640199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640103d60 0x7fb640199f80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb640104db0 tx=0x7fb63400dde0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 shutdown_connections 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb6280a3370 0x7fb6280a5830 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640105910 0x7fb6401a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640104f50 0x7fb64019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 --2- 172.21.15.22:0/2201144106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb640103d60 0x7fb640199f80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 >> 172.21.15.22:0/2201144106 conn(0x7fb6400ff4e0 msgr2=0x7fb640108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 shutdown_connections 2024-09-15T22:42:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:42:58.528+0000 7fb648000640 1 -- 172.21.15.22:0/2201144106 wait complete. 2024-09-15T22:42:59.754 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:59 smithi112 ceph-mon[35032]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 273 MiB/s wr, 1.01k op/s 2024-09-15T22:42:59.755 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:42:59 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:59.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:59 smithi022 ceph-mon[30634]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 273 MiB/s wr, 1.01k op/s 2024-09-15T22:42:59.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:42:59 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:59.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:59 smithi110 ceph-mon[35282]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 273 MiB/s wr, 1.01k op/s 2024-09-15T22:42:59.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:42:59 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:43:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:01 smithi112 ceph-mon[35032]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 263 MiB/s wr, 967 op/s 2024-09-15T22:43:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:01 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:01 smithi110 ceph-mon[35282]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 263 MiB/s wr, 967 op/s 2024-09-15T22:43:01.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:01.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:01 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:02.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:01 smithi022 ceph-mon[30634]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 263 MiB/s wr, 967 op/s 2024-09-15T22:43:02.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:02.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:02.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:02.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:01 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:04.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:03 smithi022 ceph-mon[30634]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 267 MiB/s wr, 975 op/s 2024-09-15T22:43:04.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:04.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:03 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:04.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:03 smithi112 ceph-mon[35032]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 267 MiB/s wr, 975 op/s 2024-09-15T22:43:04.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:04.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:03 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:04.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:03 smithi110 ceph-mon[35282]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 267 MiB/s wr, 975 op/s 2024-09-15T22:43:04.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:04.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:03 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:05.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:43:05.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:43:05.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:04 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:05.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:43:05.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:43:05.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:04 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:05.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:43:05.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:43:05.206 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:04 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:43:06.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:05 smithi022 ceph-mon[30634]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 262 MiB/s wr, 953 op/s 2024-09-15T22:43:06.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:05 smithi112 ceph-mon[35032]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 262 MiB/s wr, 953 op/s 2024-09-15T22:43:06.209 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:05 smithi110 ceph-mon[35282]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 262 MiB/s wr, 953 op/s 2024-09-15T22:43:08.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:07 smithi112 ceph-mon[35032]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 253 MiB/s wr, 916 op/s 2024-09-15T22:43:08.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:07 smithi110 ceph-mon[35282]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 253 MiB/s wr, 916 op/s 2024-09-15T22:43:08.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:07 smithi022 ceph-mon[30634]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 253 MiB/s wr, 916 op/s 2024-09-15T22:43:10.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:09 smithi112 ceph-mon[35032]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 274 MiB/s wr, 986 op/s 2024-09-15T22:43:10.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:09 smithi110 ceph-mon[35282]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 274 MiB/s wr, 986 op/s 2024-09-15T22:43:10.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:09 smithi022 ceph-mon[30634]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 274 MiB/s wr, 986 op/s 2024-09-15T22:43:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 -- 172.21.15.22:0/317061124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3081001b0 msgr2=0x7ff3081025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 --2- 172.21.15.22:0/317061124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3081001b0 0x7ff3081025c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009900 tx=0x7ff2f402a410 comp rx=0 tx=0).stop 2024-09-15T22:43:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 -- 172.21.15.22:0/317061124 shutdown_connections 2024-09-15T22:43:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 --2- 172.21.15.22:0/317061124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3081054b0 0x7ff308105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 --2- 172.21.15.22:0/317061124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff308102b00 0x7ff308104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 --2- 172.21.15.22:0/317061124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3081001b0 0x7ff3081025c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 -- 172.21.15.22:0/317061124 >> 172.21.15.22:0/317061124 conn(0x7ff3080fbfa0 msgr2=0x7ff3080fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 -- 172.21.15.22:0/317061124 shutdown_connections 2024-09-15T22:43:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.744+0000 7ff30da00640 1 -- 172.21.15.22:0/317061124 wait complete. 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.745+0000 7ff30da00640 1 Processor -- start 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.745+0000 7ff30da00640 1 -- start start 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 0x7ff30819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff308102b00 0x7ff30819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30da00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3081054b0 0x7ff3081a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30da00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff308113c20 con 0x7ff3081054b0 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff308113aa0 con 0x7ff3081001b0 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff308113da0 con 0x7ff308102b00 2024-09-15T22:43:11.748 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff307e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 0x7ff30819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff307e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 0x7ff30819e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53922/0 (socket says 172.21.15.22:53922) 2024-09-15T22:43:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff307e00640 1 -- 172.21.15.22:0/4294825701 learned_addr learned my addr 172.21.15.22:0/4294825701 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff307400640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff308102b00 0x7ff30819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.746+0000 7ff30d000640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3081054b0 0x7ff3081a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff307e00640 1 -- 172.21.15.22:0/4294825701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff308102b00 msgr2=0x7ff30819e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff307e00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff308102b00 0x7ff30819e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff307e00640 1 -- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3081054b0 msgr2=0x7ff3081a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff307e00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3081054b0 0x7ff3081a5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff307e00640 1 -- 172.21.15.22:0/4294825701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3081a5ed0 con 0x7ff3081001b0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff307e00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 0x7ff30819e2b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4031440 tx=0x7ff2f4032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.747+0000 7ff304c00640 1 -- 172.21.15.22:0/4294825701 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f403f030 con 0x7ff3081001b0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.748+0000 7ff304c00640 1 -- 172.21.15.22:0/4294825701 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f4003ce0 con 0x7ff3081001b0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.748+0000 7ff304c00640 1 -- 172.21.15.22:0/4294825701 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4035070 con 0x7ff3081001b0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.748+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3081a6160 con 0x7ff3081001b0 2024-09-15T22:43:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.748+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a66a0 con 0x7ff3081001b0 2024-09-15T22:43:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.751+0000 7ff304c00640 1 -- 172.21.15.22:0/4294825701 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff2f4042030 con 0x7ff3081001b0 2024-09-15T22:43:11.752 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.751+0000 7ff31202b740 1 Processor -- start 2024-09-15T22:43:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.751+0000 7ff31202b740 1 -- start start 2024-09-15T22:43:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff31202b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 0x55b5736d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff31202b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff31202b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736dcc30 0x55b5736df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff31202b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b57363c100 con 0x55b5736dcc30 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff31202b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5735e41b0 con 0x55b5736d7260 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff31202b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b5736380c0 con 0x55b5736d7ba0 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff30d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 0x55b5736d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff30d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 0x55b5736d7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53932/0 (socket says 172.21.15.22:53932) 2024-09-15T22:43:11.754 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff30d000640 1 -- 172.21.15.22:0/3816951573 learned_addr learned my addr 172.21.15.22:0/3816951573 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff307e00640 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.752+0000 7ff307400640 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736dcc30 0x55b5736df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff30d000640 1 -- 172.21.15.22:0/3816951573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 msgr2=0x55b5736dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff30d000640 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff30d000640 1 -- 172.21.15.22:0/3816951573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736dcc30 msgr2=0x55b5736df0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff30d000640 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736dcc30 0x55b5736df0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff30d000640 1 -- 172.21.15.22:0/3816951573 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b57334f210 con 0x55b5736d7260 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff304c00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2ec0a32c0 0x7ff2ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff304c00640 1 -- 172.21.15.22:0/4294825701 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff2f40efd80 con 0x7ff3081001b0 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff30d000640 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 0x55b5736d7660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff300009fd0 tx=0x7ff3000118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33703cf6cda4bc76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff307e00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2ec0a32c0 0x7ff2ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff2fd600640 1 -- 172.21.15.22:0/3816951573 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300004d20 con 0x55b5736d7260 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff2fd600640 1 -- 172.21.15.22:0/3816951573 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff300004050 con 0x55b5736d7260 2024-09-15T22:43:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.753+0000 7ff2fd600640 1 -- 172.21.15.22:0/3816951573 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300005260 con 0x55b5736d7260 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 -- 172.21.15.22:0/3816951573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 msgr2=0x55b5736d7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 0x55b5736d7660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff300009fd0 tx=0x7ff3000118d0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff307e00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2ec0a32c0 0x7ff2ec0a5780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b8870 tx=0x7ff2f40b8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 -- 172.21.15.22:0/3816951573 shutdown_connections 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736dcc30 0x55b5736df0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 --2- 172.21.15.22:0/3816951573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7260 0x55b5736d7660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.754+0000 7ff31202b740 1 -- 172.21.15.22:0/3816951573 >> 172.21.15.22:0/3816951573 conn(0x55b5736d28d0 msgr2=0x55b5736d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.755+0000 7ff31202b740 1 -- 172.21.15.22:0/3816951573 shutdown_connections 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.755+0000 7ff31202b740 1 -- 172.21.15.22:0/3816951573 wait complete. 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.755+0000 7ff31202b740 1 -- start start 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 Processor -- start 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736dcc30 0x55b5736e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b5736dfc00 con 0x55b5736d7260 2024-09-15T22:43:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5735c5090 con 0x55b5736d7ba0 2024-09-15T22:43:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b5736dfd80 con 0x55b5736dcc30 2024-09-15T22:43:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.756+0000 7ff31202b740 10 client.0 _ll_register_callbacks cb 0x55b573619f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff30d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff30d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44596/0 (socket says 172.21.15.22:44596) 2024-09-15T22:43:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff30d000640 1 -- 172.21.15.22:0/1686685323 learned_addr learned my addr 172.21.15.22:0/1686685323 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff30d000640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736dcc30 0x55b5736e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 -- 172.21.15.22:0/1686685323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736dcc30 msgr2=0x55b5736e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736dcc30 0x55b5736e89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 -- 172.21.15.22:0/1686685323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 msgr2=0x55b5736e1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 -- 172.21.15.22:0/1686685323 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b57341b620 con 0x55b5736d7ba0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff307400640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736e19b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff30819f7c0 tx=0x7ff2f8012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10cbec8b34fdd40f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.757+0000 7ff2f2000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff2f2000640 1 -- 172.21.15.22:0/1686685323 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8004050 con 0x55b5736d7ba0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff2f2000640 1 -- 172.21.15.22:0/1686685323 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff2f80041f0 con 0x55b5736d7ba0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff300004050 con 0x55b5736d7ba0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff2f2000640 1 -- 172.21.15.22:0/1686685323 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2f80043f0 con 0x55b5736d7ba0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff31202b740 10 client.25808 fetch_fsmap learned FSMap version 25 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5736fc8c0 con 0x55b5736d7ba0 2024-09-15T22:43:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.758+0000 7ff2f2000640 1 -- 172.21.15.22:0/1686685323 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff300004050 con 0x55b5736d7ba0 2024-09-15T22:43:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff2f2000640 1 -- 172.21.15.22:0/1686685323 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2f8003bc0 con 0x55b5736d7ba0 2024-09-15T22:43:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff31202b740 10 client.25808 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:43:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff31202b740 10 client.25808 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:43:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff31202b740 20 client.25808 populate_metadata read hostname 'smithi022' 2024-09-15T22:43:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff31202b740 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736fdfc0 0x55b573700420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff31202b740 4 client.25808 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:43:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.759+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b573649830 con 0x55b5736fdfc0 2024-09-15T22:43:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.760+0000 7ff30d000640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736fdfc0 0x55b573700420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.760+0000 7ff30d000640 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736fdfc0 0x55b573700420 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e17f328b4658b7 server_cookie=4414afe743ff5a34 in_seq=0 out_seq=0 2024-09-15T22:43:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.760+0000 7ff2f2000640 10 client.25808 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.761+0000 7ff2f2000640 1 -- 172.21.15.22:0/1686685323 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b573649830 con 0x55b5736fdfc0 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.761+0000 7ff2f2000640 10 client.25808 handle_command_reply: tid=0 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.761+0000 7ff31202b740 1 client.25808 shutdown 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 msgr2=0x55b5736e19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736e19b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff30819f7c0 tx=0x7ff2f8012b60 comp rx=0 tx=0).stop 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 shutdown_connections 2024-09-15T22:43:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736fdfc0 0x55b573700420 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736dcc30 0x55b5736e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736e19b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 --2- 172.21.15.22:0/1686685323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 >> 172.21.15.22:0/1686685323 conn(0x55b5736d28d0 msgr2=0x55b5736d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff2f2000640 0 client.25808 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 shutdown_connections 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 1 -- 172.21.15.22:0/1686685323 wait complete. 2024-09-15T22:43:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.762+0000 7ff31202b740 20 client.25808 trim_cache size 0 max 16384 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 Processor -- start 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 -- start start 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d28d0 0x55b5736d3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7260 0x55b5736e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081a9520 con 0x55b5736d28d0 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081a6df0 con 0x55b5736d7ba0 2024-09-15T22:43:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.778+0000 7ff31202b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff308072630 con 0x55b5736d7260 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d28d0 0x55b5736d3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53954/0 (socket says 172.21.15.22:53954) 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 -- 172.21.15.22:0/3697449095 learned_addr learned my addr 172.21.15.22:0/3697449095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff307400640 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7260 0x55b5736e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 -- 172.21.15.22:0/3697449095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7260 msgr2=0x55b5736e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7260 0x55b5736e89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 -- 172.21.15.22:0/3697449095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d28d0 msgr2=0x55b5736d3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d28d0 0x55b5736d3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.779+0000 7ff30d000640 1 -- 172.21.15.22:0/3697449095 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5736d26f0 con 0x55b5736d7ba0 2024-09-15T22:43:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.780+0000 7ff30d000640 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736d3c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff300009fd0 tx=0x7ff300005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1680e6967779eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.780+0000 7ff2fcc00640 1 -- 172.21.15.22:0/3697449095 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000040b0 con 0x55b5736d7ba0 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.780+0000 7ff2fcc00640 1 -- 172.21.15.22:0/3697449095 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff300004730 con 0x55b5736d7ba0 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.780+0000 7ff2fcc00640 1 -- 172.21.15.22:0/3697449095 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30000fd50 con 0x55b5736d7ba0 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 -- 172.21.15.22:0/3697449095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 msgr2=0x55b5736d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736d3c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff300009fd0 tx=0x7ff300005fd0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 -- 172.21.15.22:0/3697449095 shutdown_connections 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7260 0x55b5736e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d7ba0 0x55b5736d3c90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 --2- 172.21.15.22:0/3697449095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d28d0 0x55b5736d3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.781+0000 7ff31202b740 1 -- 172.21.15.22:0/3697449095 >> 172.21.15.22:0/3697449095 conn(0x55b5736dc750 msgr2=0x55b5736d8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.789+0000 7ff31202b740 1 -- 172.21.15.22:0/3697449095 shutdown_connections 2024-09-15T22:43:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.789+0000 7ff31202b740 1 -- 172.21.15.22:0/3697449095 wait complete. 2024-09-15T22:43:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.790+0000 7ff31202b740 1 -- start start 2024-09-15T22:43:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.790+0000 7ff31202b740 1 Processor -- start 2024-09-15T22:43:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.791+0000 7ff31202b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 0x55b5736e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.791+0000 7ff31202b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff31202b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff31202b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff308072cc0 con 0x55b5736d7260 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff31202b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff308074130 con 0x55b5736d28d0 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff31202b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff308073390 con 0x55b5736d7ba0 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff30d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 0x55b5736e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff31202b740 10 client.0 _ll_register_callbacks cb 0x7ff2f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff30d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 0x55b5736e5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:53966/0 (socket says 172.21.15.22:53966) 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff30d000640 1 -- 172.21.15.22:0/367554286 learned_addr learned my addr 172.21.15.22:0/367554286 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.793+0000 7ff30d000640 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.794+0000 7ff30d000640 1 -- 172.21.15.22:0/367554286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 msgr2=0x55b5736e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.794+0000 7ff30d000640 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.794+0000 7ff30d000640 1 -- 172.21.15.22:0/367554286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 msgr2=0x55b5736e5f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.794+0000 7ff30d000640 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e5f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.794+0000 7ff30d000640 1 -- 172.21.15.22:0/367554286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5736e7580 con 0x55b5736d28d0 2024-09-15T22:43:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.796+0000 7ff30d000640 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 0x55b5736e5a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff300000f80 tx=0x7ff300005cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d387349bd504728f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.796+0000 7ff2f2000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.797+0000 7ff2f2000640 1 -- 172.21.15.22:0/367554286 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30000fad0 con 0x55b5736d28d0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.797+0000 7ff2f2000640 1 -- 172.21.15.22:0/367554286 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7ff30000fc70 con 0x55b5736d28d0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.797+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b573643b80 con 0x55b5736d28d0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.797+0000 7ff2f2000640 1 -- 172.21.15.22:0/367554286 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff30000fe70 con 0x55b5736d28d0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.797+0000 7ff31202b740 10 client.25814 fetch_fsmap learned FSMap version 25 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.797+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5736e8890 con 0x55b5736d28d0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff2f2000640 1 -- 172.21.15.22:0/367554286 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b573643b80 con 0x55b5736d28d0 2024-09-15T22:43:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff2f2000640 1 -- 172.21.15.22:0/367554286 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff300028af0 con 0x55b5736d28d0 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff31202b740 10 client.25814 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff31202b740 10 client.25814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff31202b740 20 client.25814 populate_metadata read hostname 'smithi022' 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff31202b740 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736dcc30 0x55b57376ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff31202b740 4 client.25814 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5735c07c0 con 0x55b5736dcc30 2024-09-15T22:43:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.798+0000 7ff307400640 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736dcc30 0x55b57376ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.801+0000 7ff2f2000640 10 client.25814 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.801+0000 7ff307400640 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736dcc30 0x55b57376ae90 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d62af4b1e736ae server_cookie=eeb9ddeb9e4d6f95 in_seq=0 out_seq=0 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff2f2000640 1 -- 172.21.15.22:0/367554286 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5735c07c0 con 0x55b5736dcc30 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff2f2000640 10 client.25814 handle_command_reply: tid=0 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 client.25814 shutdown 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 msgr2=0x55b5736e5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 0x55b5736e5a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff300000f80 tx=0x7ff300005cf0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 shutdown_connections 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55b5736dcc30 0x55b57376ae90 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b5736d7ba0 0x55b5736e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b5736d7260 0x55b5736e5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 --2- 172.21.15.22:0/367554286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5736d28d0 0x55b5736e5a20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 >> 172.21.15.22:0/367554286 conn(0x55b5736dc750 msgr2=0x55b5736d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.825+0000 7ff2f2000640 0 client.25814 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.826+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 shutdown_connections 2024-09-15T22:43:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:43:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:43:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:43:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:43:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.826+0000 7ff31202b740 1 -- 172.21.15.22:0/367554286 wait complete. 2024-09-15T22:43:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.826+0000 7ff31202b740 20 client.25814 trim_cache size 0 max 16384 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.827+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2ec0a32c0 msgr2=0x7ff2ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.827+0000 7ff30da00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2ec0a32c0 0x7ff2ec0a5780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b8870 tx=0x7ff2f40b8040 comp rx=0 tx=0).stop 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.827+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 msgr2=0x7ff30819e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.827+0000 7ff30da00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 0x7ff30819e2b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4031440 tx=0x7ff2f4032ce0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 shutdown_connections 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff308102b00 0x7ff30819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7ff2ec0a32c0 0x7ff2ec0a5780 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3081054b0 0x7ff3081a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 --2- 172.21.15.22:0/4294825701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3081001b0 0x7ff30819e2b0 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4031440 tx=0x7ff2f4032ce0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 >> 172.21.15.22:0/4294825701 conn(0x7ff3080fbfa0 msgr2=0x7ff308103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 shutdown_connections 2024-09-15T22:43:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:11.828+0000 7ff30da00640 1 -- 172.21.15.22:0/4294825701 wait complete. 2024-09-15T22:43:12.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:11 smithi112 ceph-mon[35032]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 927 op/s 2024-09-15T22:43:12.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:11 smithi110 ceph-mon[35282]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 927 op/s 2024-09-15T22:43:12.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:11 smithi022 ceph-mon[30634]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 257 MiB/s wr, 927 op/s 2024-09-15T22:43:14.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:13 smithi110 ceph-mon[35282]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 259 MiB/s wr, 941 op/s 2024-09-15T22:43:14.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:13 smithi022 ceph-mon[30634]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 259 MiB/s wr, 941 op/s 2024-09-15T22:43:14.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:13 smithi112 ceph-mon[35032]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 259 MiB/s wr, 941 op/s 2024-09-15T22:43:15.183 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:14 smithi022 ceph-mon[30634]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 259 MiB/s wr, 946 op/s 2024-09-15T22:43:15.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:14 smithi110 ceph-mon[35282]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 259 MiB/s wr, 946 op/s 2024-09-15T22:43:15.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:14 smithi112 ceph-mon[35032]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 259 MiB/s wr, 946 op/s 2024-09-15T22:43:17.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:17 smithi022 ceph-mon[30634]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 257 MiB/s wr, 938 op/s 2024-09-15T22:43:17.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:17 smithi112 ceph-mon[35032]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 257 MiB/s wr, 938 op/s 2024-09-15T22:43:17.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:17 smithi110 ceph-mon[35282]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 257 MiB/s wr, 938 op/s 2024-09-15T22:43:19.285 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:19 smithi022 ceph-mon[30634]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 278 MiB/s wr, 1.01k op/s 2024-09-15T22:43:19.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:19 smithi112 ceph-mon[35032]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 278 MiB/s wr, 1.01k op/s 2024-09-15T22:43:19.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:19 smithi110 ceph-mon[35282]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 278 MiB/s wr, 1.01k op/s 2024-09-15T22:43:21.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:21 smithi112 ceph-mon[35032]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 954 op/s 2024-09-15T22:43:21.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:21 smithi110 ceph-mon[35282]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 954 op/s 2024-09-15T22:43:21.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:21 smithi022 ceph-mon[30634]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 261 MiB/s wr, 954 op/s 2024-09-15T22:43:23.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:23 smithi112 ceph-mon[35032]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 264 MiB/s wr, 966 op/s 2024-09-15T22:43:23.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:23 smithi110 ceph-mon[35282]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 264 MiB/s wr, 966 op/s 2024-09-15T22:43:23.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:23 smithi022 ceph-mon[30634]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 264 MiB/s wr, 966 op/s 2024-09-15T22:43:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 -- 172.21.15.22:0/1679310179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4109d40 msgr2=0x7f44d41105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 --2- 172.21.15.22:0/1679310179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4109d40 0x7f44d41105d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009ca0 tx=0x7f44cc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 -- 172.21.15.22:0/1679310179 shutdown_connections 2024-09-15T22:43:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 --2- 172.21.15.22:0/1679310179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d4109380 0x7f44d4109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 --2- 172.21.15.22:0/1679310179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4109d40 0x7f44d41105d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 --2- 172.21.15.22:0/1679310179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d4108470 0x7f44d4108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 -- 172.21.15.22:0/1679310179 >> 172.21.15.22:0/1679310179 conn(0x7f44d4077490 msgr2=0x7f44d40798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 -- 172.21.15.22:0/1679310179 shutdown_connections 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.062+0000 7f44da600640 1 -- 172.21.15.22:0/1679310179 wait complete. 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 Processor -- start 2024-09-15T22:43:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 -- start start 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 0x7f44d419e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d4109380 0x7f44d419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d4109d40 0x7f44d41a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4113e30 con 0x7f44d4109380 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4113cb0 con 0x7f44d4108470 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.064+0000 7f44da600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4113fb0 con 0x7f44d4109d40 2024-09-15T22:43:25.067 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 0x7f44d419e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 0x7f44d419e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55474/0 (socket says 172.21.15.22:55474) 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 -- 172.21.15.22:0/1118720925 learned_addr learned my addr 172.21.15.22:0/1118720925 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3e00640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d4109d40 0x7f44d41a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d2a00640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d4109380 0x7f44d419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 -- 172.21.15.22:0/1118720925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d4109d40 msgr2=0x7f44d41a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d4109d40 0x7f44d41a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 -- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d4109380 msgr2=0x7f44d419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d4109380 0x7f44d419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 -- 172.21.15.22:0/1118720925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d41a5f70 con 0x7f44d4108470 2024-09-15T22:43:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.065+0000 7f44d3400640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 0x7f44d419e350 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f44c400d950 tx=0x7f44c400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.069+0000 7f44cbe00640 1 -- 172.21.15.22:0/1118720925 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4017070 con 0x7f44d4108470 2024-09-15T22:43:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.069+0000 7f44cbe00640 1 -- 172.21.15.22:0/1118720925 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44c4009c30 con 0x7f44d4108470 2024-09-15T22:43:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.069+0000 7f44cbe00640 1 -- 172.21.15.22:0/1118720925 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c400f6b0 con 0x7f44d4108470 2024-09-15T22:43:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.073+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d41a6260 con 0x7f44d4108470 2024-09-15T22:43:25.075 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.073+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d41a6760 con 0x7f44d4108470 2024-09-15T22:43:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.081+0000 7f44dd49e740 1 Processor -- start 2024-09-15T22:43:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.083+0000 7f44dd49e740 1 -- start start 2024-09-15T22:43:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.084+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff89d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.084+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d9d0 0x563cff8a2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.084+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff8a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.084+0000 7f44dd49e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563cff802100 con 0x563cff89d9d0 2024-09-15T22:43:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.084+0000 7f44dd49e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cff7aa1b0 con 0x563cff8a2a60 2024-09-15T22:43:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.084+0000 7f44dd49e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563cff7fe0c0 con 0x563cff89d090 2024-09-15T22:43:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.087+0000 7f44d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff8a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.087+0000 7f44d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff8a4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55490/0 (socket says 172.21.15.22:55490) 2024-09-15T22:43:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.087+0000 7f44d2a00640 1 -- 172.21.15.22:0/2105087153 learned_addr learned my addr 172.21.15.22:0/2105087153 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.087+0000 7f44cbe00640 1 -- 172.21.15.22:0/1118720925 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f44c40109d0 con 0x7f44d4108470 2024-09-15T22:43:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.087+0000 7f44d3e00640 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff89d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.088+0000 7f44d2a00640 1 -- 172.21.15.22:0/2105087153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 msgr2=0x563cff89d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.088+0000 7f44d2a00640 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff89d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.088+0000 7f44d2a00640 1 -- 172.21.15.22:0/2105087153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d9d0 msgr2=0x563cff8a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.088+0000 7f44d2a00640 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d9d0 0x563cff8a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.088+0000 7f44d2a00640 1 -- 172.21.15.22:0/2105087153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cff515210 con 0x563cff8a2a60 2024-09-15T22:43:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.089+0000 7f44cbe00640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44b80a34e0 0x7f44b80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.090+0000 7f44cbe00640 1 -- 172.21.15.22:0/1118720925 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f44c40cf4b0 con 0x7f44d4108470 2024-09-15T22:43:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.090+0000 7f44d3e00640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44b80a34e0 0x7f44b80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.092+0000 7f44d2a00640 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff8a4f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009bf0 tx=0x7f44c00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57cf29686413d260 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.092+0000 7f44c8c00640 1 -- 172.21.15.22:0/2105087153 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0004030 con 0x563cff8a2a60 2024-09-15T22:43:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.092+0000 7f44c8c00640 1 -- 172.21.15.22:0/2105087153 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44c00041d0 con 0x563cff8a2a60 2024-09-15T22:43:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.092+0000 7f44c8c00640 1 -- 172.21.15.22:0/2105087153 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c00126d0 con 0x563cff8a2a60 2024-09-15T22:43:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 -- 172.21.15.22:0/2105087153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 msgr2=0x563cff8a4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff8a4f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009bf0 tx=0x7f44c00117b0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44d3e00640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44b80a34e0 0x7f44b80a59a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f44cc005e30 tx=0x7f44cc031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 -- 172.21.15.22:0/2105087153 shutdown_connections 2024-09-15T22:43:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff8a4f20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d9d0 0x563cff8a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2105087153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff89d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.093+0000 7f44dd49e740 1 -- 172.21.15.22:0/2105087153 >> 172.21.15.22:0/2105087153 conn(0x563cff898700 msgr2=0x563cff898b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.094+0000 7f44dd49e740 1 -- 172.21.15.22:0/2105087153 shutdown_connections 2024-09-15T22:43:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.094+0000 7f44dd49e740 1 -- 172.21.15.22:0/2105087153 wait complete. 2024-09-15T22:43:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.096+0000 7f44dd49e740 1 -- start start 2024-09-15T22:43:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.096+0000 7f44dd49e740 1 Processor -- start 2024-09-15T22:43:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.097+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff8b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.098+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 0x563cff8b8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.098+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff8a2a60 0x563cff8bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.098+0000 7f44dd49e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563cff8b6a40 con 0x563cff8a2a60 2024-09-15T22:43:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.098+0000 7f44dd49e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cff78b090 con 0x563cff89d9d0 2024-09-15T22:43:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.098+0000 7f44dd49e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563cff8b6bc0 con 0x563cff89d090 2024-09-15T22:43:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.098+0000 7f44dd49e740 10 client.0 _ll_register_callbacks cb 0x563cff7dff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.099+0000 7f44d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 0x563cff8b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.099+0000 7f44d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 0x563cff8b8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55506/0 (socket says 172.21.15.22:55506) 2024-09-15T22:43:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.099+0000 7f44d2a00640 1 -- 172.21.15.22:0/2104490096 learned_addr learned my addr 172.21.15.22:0/2104490096 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d3e00640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff8a2a60 0x563cff8bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d3400640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff8b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d2a00640 1 -- 172.21.15.22:0/2104490096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 msgr2=0x563cff8b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d2a00640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff8b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d2a00640 1 -- 172.21.15.22:0/2104490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff8a2a60 msgr2=0x563cff8bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d2a00640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff8a2a60 0x563cff8bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d2a00640 1 -- 172.21.15.22:0/2104490096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cff5e1620 con 0x563cff89d9d0 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.100+0000 7f44d3e00640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff8a2a60 0x563cff8bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.101+0000 7f44d2a00640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 0x563cff8b8790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000c00 tx=0x7f44c0005640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d6110bd09bd18f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.102+0000 7f44bd600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:43:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.102+0000 7f44bd600640 1 -- 172.21.15.22:0/2104490096 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0028020 con 0x563cff89d9d0 2024-09-15T22:43:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.102+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44c00041d0 con 0x563cff89d9d0 2024-09-15T22:43:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.102+0000 7f44bd600640 1 -- 172.21.15.22:0/2104490096 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f44c00037f0 con 0x563cff89d9d0 2024-09-15T22:43:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.102+0000 7f44bd600640 1 -- 172.21.15.22:0/2104490096 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44c001f040 con 0x563cff89d9d0 2024-09-15T22:43:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 10 client.25826 fetch_fsmap learned FSMap version 25 2024-09-15T22:43:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563cff8c2610 con 0x563cff89d9d0 2024-09-15T22:43:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44bd600640 1 -- 172.21.15.22:0/2104490096 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44c00041d0 con 0x563cff89d9d0 2024-09-15T22:43:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44bd600640 1 -- 172.21.15.22:0/2104490096 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f44c0024470 con 0x563cff89d9d0 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 10 client.25826 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 20 client.25826 populate_metadata read hostname 'smithi022' 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff8c3a20 0x563cff8c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 4 client.25826 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.103+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cff80f830 con 0x563cff8c3a20 2024-09-15T22:43:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.104+0000 7f44d3400640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff8c3a20 0x563cff8c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.104+0000 7f44d3400640 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff8c3a20 0x563cff8c5e10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab527000b5275e91 server_cookie=785403d546411fe3 in_seq=0 out_seq=0 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.104+0000 7f44bd600640 10 client.25826 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.105+0000 7f44bd600640 1 -- 172.21.15.22:0/2104490096 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563cff80f830 con 0x563cff8c3a20 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.105+0000 7f44bd600640 10 client.25826 handle_command_reply: tid=0 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.105+0000 7f44dd49e740 1 client.25826 shutdown 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.105+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 msgr2=0x563cff8b8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.105+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 0x563cff8b8790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000c00 tx=0x7f44c0005640 comp rx=0 tx=0).stop 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 shutdown_connections 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff8c3a20 0x563cff8c5e10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff8a2a60 0x563cff8bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff89d9d0 0x563cff8b8790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 --2- 172.21.15.22:0/2104490096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d090 0x563cff8b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44bd600640 0 client.25826 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 >> 172.21.15.22:0/2104490096 conn(0x563cff898700 msgr2=0x563cff899f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 shutdown_connections 2024-09-15T22:43:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.106+0000 7f44dd49e740 1 -- 172.21.15.22:0/2104490096 wait complete. 2024-09-15T22:43:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.107+0000 7f44dd49e740 20 client.25826 trim_cache size 0 max 16384 2024-09-15T22:43:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.135+0000 7f44dd49e740 1 Processor -- start 2024-09-15T22:43:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 -- start start 2024-09-15T22:43:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff898ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff899020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44d41a9620 con 0x563cff89d090 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f44d41a6ef0 con 0x563cff8a2a60 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.136+0000 7f44dd49e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4072780 con 0x563cff89d9d0 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff899020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff899020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:55522/0 (socket says 172.21.15.22:55522) 2024-09-15T22:43:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 -- 172.21.15.22:0/3720897391 learned_addr learned my addr 172.21.15.22:0/3720897391 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 -- 172.21.15.22:0/3720897391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 msgr2=0x563cff8bf790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bf790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 -- 172.21.15.22:0/3720897391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 msgr2=0x563cff898ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff898ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.137+0000 7f44d3e00640 1 -- 172.21.15.22:0/3720897391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cff898520 con 0x563cff8a2a60 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.138+0000 7f44d3e00640 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff899020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009410 tx=0x7f44cc041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96037bbaa55498d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.138+0000 7f44bfe00640 1 -- 172.21.15.22:0/3720897391 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc031830 con 0x563cff8a2a60 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.138+0000 7f44bfe00640 1 -- 172.21.15.22:0/3720897391 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44cc036050 con 0x563cff8a2a60 2024-09-15T22:43:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.138+0000 7f44bfe00640 1 -- 172.21.15.22:0/3720897391 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc02f930 con 0x563cff8a2a60 2024-09-15T22:43:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.141+0000 7f44dd49e740 1 -- 172.21.15.22:0/3720897391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 msgr2=0x563cff899020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff899020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009410 tx=0x7f44cc041000 comp rx=0 tx=0).stop 2024-09-15T22:43:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 -- 172.21.15.22:0/3720897391 shutdown_connections 2024-09-15T22:43:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff899020 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3720897391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff898ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 -- 172.21.15.22:0/3720897391 >> 172.21.15.22:0/3720897391 conn(0x563cff898700 msgr2=0x563cff89ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 -- 172.21.15.22:0/3720897391 shutdown_connections 2024-09-15T22:43:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.142+0000 7f44dd49e740 1 -- 172.21.15.22:0/3720897391 wait complete. 2024-09-15T22:43:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.143+0000 7f44dd49e740 1 -- start start 2024-09-15T22:43:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.143+0000 7f44dd49e740 1 Processor -- start 2024-09-15T22:43:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.144+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff8bc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.145+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.145+0000 7f44dd49e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff92c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.147 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.145+0000 7f44dd49e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4072e10 con 0x563cff89d090 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.145+0000 7f44d3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff8bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.145+0000 7f44d3400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff8bc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45910/0 (socket says 172.21.15.22:45910) 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44dd49e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4074280 con 0x563cff8a2a60 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44dd49e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40734e0 con 0x563cff89d9d0 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff92c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:54772/0 (socket says 172.21.15.22:54772) 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d2a00640 1 -- 172.21.15.22:0/3537192682 learned_addr learned my addr 172.21.15.22:0/3537192682 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44dd49e740 10 client.0 _ll_register_callbacks cb 0x7f44cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:25.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d3e00640 1 -- 172.21.15.22:0/3537192682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 msgr2=0x563cff8bcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d3e00640 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d3e00640 1 -- 172.21.15.22:0/3537192682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 msgr2=0x563cff8bc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:25.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d3e00640 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff8bc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.149 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.146+0000 7f44d3e00640 1 -- 172.21.15.22:0/3537192682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cff92cb10 con 0x563cff8a2a60 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44d3e00640 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff92c5d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44cc02aeb0 tx=0x7f44cc02fe20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b965440e691be30d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44bd600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44bd600640 1 -- 172.21.15.22:0/3537192682 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004040 con 0x563cff8a2a60 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44bd600640 1 -- 172.21.15.22:0/3537192682 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f44cc0041e0 con 0x563cff8a2a60 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc036050 con 0x563cff8a2a60 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44bd600640 1 -- 172.21.15.22:0/3537192682 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44cc0043e0 con 0x563cff8a2a60 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44dd49e740 10 client.25832 fetch_fsmap learned FSMap version 25 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.147+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563cff92dd00 con 0x563cff8a2a60 2024-09-15T22:43:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44bd600640 1 -- 172.21.15.22:0/3537192682 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44cc036050 con 0x563cff8a2a60 2024-09-15T22:43:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44bd600640 1 -- 172.21.15.22:0/3537192682 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f44cc030bc0 con 0x563cff8a2a60 2024-09-15T22:43:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44dd49e740 10 client.25832 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:43:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44dd49e740 10 client.25832 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:43:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44dd49e740 20 client.25832 populate_metadata read hostname 'smithi022' 2024-09-15T22:43:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff92e630 0x563cff930a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44dd49e740 4 client.25832 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:43:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.148+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563cff809b80 con 0x563cff92e630 2024-09-15T22:43:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.149+0000 7f44d3400640 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff92e630 0x563cff930a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.149+0000 7f44d3400640 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff92e630 0x563cff930a50 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0feee0a3d83c6b server_cookie=4c200f92693dcc88 in_seq=0 out_seq=0 2024-09-15T22:43:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.149+0000 7f44bd600640 10 client.25832 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44bd600640 1 -- 172.21.15.22:0/3537192682 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563cff809b80 con 0x563cff92e630 2024-09-15T22:43:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44bd600640 10 client.25832 handle_command_reply: tid=0 2024-09-15T22:43:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44dd49e740 1 client.25832 shutdown 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 msgr2=0x563cff92c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff92c5d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44cc02aeb0 tx=0x7f44cc02fe20 comp rx=0 tx=0).stop 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 shutdown_connections 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.179+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x563cff92e630 0x563cff930a50 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cff89d9d0 0x563cff8bcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cff8a2a60 0x563cff92c5d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 1 --2- 172.21.15.22:0/3537192682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cff89d090 0x563cff8bc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 >> 172.21.15.22:0/3537192682 conn(0x563cff898700 msgr2=0x563cff897060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44bd600640 0 client.25832 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 shutdown_connections 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 1 -- 172.21.15.22:0/3537192682 wait complete. 2024-09-15T22:43:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.180+0000 7f44dd49e740 20 client.25832 trim_cache size 0 max 16384 2024-09-15T22:43:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:43:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:43:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:43:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44b80a34e0 msgr2=0x7f44b80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44b80a34e0 0x7f44b80a59a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f44cc005e30 tx=0x7f44cc031bb0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 msgr2=0x7f44d419e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 0x7f44d419e350 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f44c400d950 tx=0x7f44c400de10 comp rx=0 tx=0).stop 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 shutdown_connections 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d4109d40 0x7f44d41a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f44b80a34e0 0x7f44b80a59a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44d4109380 0x7f44d419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 --2- 172.21.15.22:0/1118720925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44d4108470 0x7f44d419e350 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.181+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 >> 172.21.15.22:0/1118720925 conn(0x7f44d4077490 msgr2=0x7f44d410c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.182+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 shutdown_connections 2024-09-15T22:43:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:25.182+0000 7f44da600640 1 -- 172.21.15.22:0/1118720925 wait complete. 2024-09-15T22:43:25.351 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:25 smithi112 ceph-mon[35032]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 976 op/s 2024-09-15T22:43:25.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:25 smithi110 ceph-mon[35282]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 976 op/s 2024-09-15T22:43:25.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:25 smithi022 ceph-mon[30634]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 270 MiB/s wr, 976 op/s 2024-09-15T22:43:27.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:27 smithi110 ceph-mon[35282]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 959 op/s 2024-09-15T22:43:27.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:27 smithi022 ceph-mon[30634]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 959 op/s 2024-09-15T22:43:27.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:27 smithi112 ceph-mon[35032]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 263 MiB/s wr, 959 op/s 2024-09-15T22:43:29.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:29 smithi110 ceph-mon[35282]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 287 MiB/s wr, 1.05k op/s 2024-09-15T22:43:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:29 smithi022 ceph-mon[30634]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 287 MiB/s wr, 1.05k op/s 2024-09-15T22:43:29.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:29 smithi112 ceph-mon[35032]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 287 MiB/s wr, 1.05k op/s 2024-09-15T22:43:31.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:31 smithi110 ceph-mon[35282]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 268 MiB/s wr, 980 op/s 2024-09-15T22:43:31.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:31 smithi022 ceph-mon[30634]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 268 MiB/s wr, 980 op/s 2024-09-15T22:43:31.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:31 smithi112 ceph-mon[35032]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 268 MiB/s wr, 980 op/s 2024-09-15T22:43:33.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:33 smithi110 ceph-mon[35282]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 272 MiB/s wr, 1k op/s 2024-09-15T22:43:33.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:33 smithi022 ceph-mon[30634]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 272 MiB/s wr, 1k op/s 2024-09-15T22:43:33.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:33 smithi112 ceph-mon[35032]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 272 MiB/s wr, 1k op/s 2024-09-15T22:43:35.456 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:35 smithi110 ceph-mon[35282]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 278 MiB/s wr, 1.02k op/s 2024-09-15T22:43:35.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:35 smithi022 ceph-mon[30634]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 278 MiB/s wr, 1.02k op/s 2024-09-15T22:43:35.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:35 smithi112 ceph-mon[35032]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 278 MiB/s wr, 1.02k op/s 2024-09-15T22:43:37.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:37 smithi110 ceph-mon[35282]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 982 op/s 2024-09-15T22:43:37.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:37 smithi022 ceph-mon[30634]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 982 op/s 2024-09-15T22:43:37.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:37 smithi112 ceph-mon[35032]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 265 MiB/s wr, 982 op/s 2024-09-15T22:43:37.760 INFO:tasks.workunit.client.0.smithi022.stdout:stopping iogen 2024-09-15T22:43:37.760 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'stopping iogen' 2024-09-15T22:43:37.760 INFO:tasks.workunit.client.0.smithi022.stderr:+ ./iogen -k 2024-09-15T22:43:37.765 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo OK 2024-09-15T22:43:37.765 INFO:tasks.workunit.client.0.smithi022.stdout:OK 2024-09-15T22:43:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 -- 172.21.15.22:0/1388633305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 msgr2=0x7f1e4c1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 --2- 172.21.15.22:0/1388633305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 0x7f1e4c1053d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009900 tx=0x7f1e3802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 -- 172.21.15.22:0/1388633305 shutdown_connections 2024-09-15T22:43:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 --2- 172.21.15.22:0/1388633305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 0x7f1e4c1053d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 --2- 172.21.15.22:0/1388633305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 --2- 172.21.15.22:0/1388633305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 0x7f1e4c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 -- 172.21.15.22:0/1388633305 >> 172.21.15.22:0/1388633305 conn(0x7f1e4c0ff4e0 msgr2=0x7f1e4c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 -- 172.21.15.22:0/1388633305 shutdown_connections 2024-09-15T22:43:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.402+0000 7f1e52800640 1 -- 172.21.15.22:0/1388633305 wait complete. 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.403+0000 7f1e52800640 1 Processor -- start 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.403+0000 7f1e52800640 1 -- start start 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e52800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 0x7f1e4c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e52800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 0x7f1e4c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e52800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e52800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10fa30 con 0x7f1e4c103d60 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e52800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10f8b0 con 0x7f1e4c105910 2024-09-15T22:43:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e52800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10fbb0 con 0x7f1e4c104f50 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c1a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59524/0 (socket says 172.21.15.22:59524) 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 0x7f1e4c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 -- 172.21.15.22:0/3368248385 learned_addr learned my addr 172.21.15.22:0/3368248385 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 0x7f1e4c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 -- 172.21.15.22:0/3368248385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 msgr2=0x7f1e4c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 0x7f1e4c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 -- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 msgr2=0x7f1e4c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 0x7f1e4c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4be00640 1 -- 172.21.15.22:0/3368248385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c1a1c10 con 0x7f1e4c105910 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.404+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 0x7f1e4c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.405+0000 7f1e4be00640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c1a15a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400eb10 tx=0x7f1e4400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.405+0000 7f1e43e00640 1 -- 172.21.15.22:0/3368248385 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44004b20 con 0x7f1e4c105910 2024-09-15T22:43:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.405+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1a1f00 con 0x7f1e4c105910 2024-09-15T22:43:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.405+0000 7f1e43e00640 1 -- 172.21.15.22:0/3368248385 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e44004cc0 con 0x7f1e4c105910 2024-09-15T22:43:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.405+0000 7f1e43e00640 1 -- 172.21.15.22:0/3368248385 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44010760 con 0x7f1e4c105910 2024-09-15T22:43:38.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.405+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1a2410 con 0x7f1e4c105910 2024-09-15T22:43:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.409+0000 7f1e43e00640 1 -- 172.21.15.22:0/3368248385 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1e44005020 con 0x7f1e4c105910 2024-09-15T22:43:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.410+0000 7f1e43e00640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1e300a3370 0x7f1e300a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.410+0000 7f1e43e00640 1 -- 172.21.15.22:0/3368248385 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1e440d0070 con 0x7f1e4c105910 2024-09-15T22:43:38.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.411+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1e300a3370 0x7f1e300a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.412+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1e300a3370 0x7f1e300a5830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c104db0 tx=0x7f1e3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.413+0000 7f1e55682740 1 Processor -- start 2024-09-15T22:43:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 -- start start 2024-09-15T22:43:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 0x55f4cc2fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc300490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc302f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f4cc260100 con 0x55f4cc2fb9d0 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4cc2081b0 con 0x55f4cc300a60 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e55682740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f4cc25c0c0 con 0x55f4cc2fb090 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e4b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 0x55f4cc2fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e4aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc300490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e4b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 0x55f4cc2fb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46392/0 (socket says 172.21.15.22:46392) 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e4b400640 1 -- 172.21.15.22:0/906101601 learned_addr learned my addr 172.21.15.22:0/906101601 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.414+0000 7f1e4be00640 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc302f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4b400640 1 -- 172.21.15.22:0/906101601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 msgr2=0x55f4cc302f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4b400640 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc302f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4b400640 1 -- 172.21.15.22:0/906101601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 msgr2=0x55f4cc300490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4b400640 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc300490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4b400640 1 -- 172.21.15.22:0/906101601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cbf73210 con 0x55f4cc2fb090 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4be00640 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc302f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.415+0000 7f1e4b400640 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 0x55f4cc2fb490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c010e50 tx=0x7f1e3c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=433ef8b2a97886ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e40c00640 1 -- 172.21.15.22:0/906101601 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c023070 con 0x55f4cc2fb090 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e40c00640 1 -- 172.21.15.22:0/906101601 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c01f930 con 0x55f4cc2fb090 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e40c00640 1 -- 172.21.15.22:0/906101601 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0119f0 con 0x55f4cc2fb090 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e55682740 1 -- 172.21.15.22:0/906101601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 msgr2=0x55f4cc2fb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e55682740 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 0x55f4cc2fb490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c010e50 tx=0x7f1e3c013000 comp rx=0 tx=0).stop 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e55682740 1 -- 172.21.15.22:0/906101601 shutdown_connections 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.416+0000 7f1e55682740 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc302f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.417+0000 7f1e55682740 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc300490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.417+0000 7f1e55682740 1 --2- 172.21.15.22:0/906101601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb090 0x55f4cc2fb490 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.417+0000 7f1e55682740 1 -- 172.21.15.22:0/906101601 >> 172.21.15.22:0/906101601 conn(0x55f4cc2f6700 msgr2=0x55f4cc2f6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.417+0000 7f1e55682740 1 -- 172.21.15.22:0/906101601 shutdown_connections 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.417+0000 7f1e55682740 1 -- 172.21.15.22:0/906101601 wait complete. 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.417+0000 7f1e55682740 1 -- start start 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 Processor -- start 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb090 0x55f4cc305280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc3057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc30c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f4cc303a30 con 0x55f4cc2fb9d0 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4cc1e9090 con 0x55f4cc2fb090 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f4cc303bb0 con 0x55f4cc300a60 2024-09-15T22:43:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.418+0000 7f1e55682740 10 client.0 _ll_register_callbacks cb 0x55f4cc23df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4aa00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc3057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc30c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc30c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46398/0 (socket says 172.21.15.22:46398) 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 -- 172.21.15.22:0/1404088807 learned_addr learned my addr 172.21.15.22:0/1404088807 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4b400640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb090 0x55f4cc305280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 -- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb090 msgr2=0x55f4cc305280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb090 0x55f4cc305280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 -- 172.21.15.22:0/1404088807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 msgr2=0x55f4cc3057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc3057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 -- 172.21.15.22:0/1404088807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cc03f620 con 0x55f4cc300a60 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4b400640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb090 0x55f4cc305280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4aa00640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc3057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e4be00640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc30c790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e4409c350 tx=0x7f1e4409bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=377b7d82baed0d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e35600640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e35600640 1 -- 172.21.15.22:0/1404088807 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b4070 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.419+0000 7f1e35600640 1 -- 172.21.15.22:0/1404088807 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1e440b0d70 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c01f930 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e35600640 1 -- 172.21.15.22:0/1404088807 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e440a0a00 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 10 client.25870 fetch_fsmap learned FSMap version 25 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f4cc30f5f0 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e35600640 1 -- 172.21.15.22:0/1404088807 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c01f930 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e35600640 1 -- 172.21.15.22:0/1404088807 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1e4409bbc0 con 0x55f4cc300a60 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 10 client.25870 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 10 client.25870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 20 client.25870 populate_metadata read hostname 'smithi022' 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc310d30 0x55f4cc313120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 4 client.25870 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:43:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.420+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4cc26d830 con 0x55f4cc310d30 2024-09-15T22:43:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.421+0000 7f1e4b400640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc310d30 0x55f4cc313120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.421+0000 7f1e4b400640 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc310d30 0x55f4cc313120 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b51505cc1a19207 server_cookie=1e51c3319a856335 in_seq=0 out_seq=0 2024-09-15T22:43:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.421+0000 7f1e35600640 10 client.25870 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e35600640 1 -- 172.21.15.22:0/1404088807 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4cc26d830 con 0x55f4cc310d30 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e35600640 10 client.25870 handle_command_reply: tid=0 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 client.25870 shutdown 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 msgr2=0x55f4cc30c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc30c790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e4409c350 tx=0x7f1e4409bfb0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 shutdown_connections 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc310d30 0x55f4cc313120 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc30c790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc3057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e35600640 0 client.25870 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 --2- 172.21.15.22:0/1404088807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb090 0x55f4cc305280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.422+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 >> 172.21.15.22:0/1404088807 conn(0x55f4cc2f6700 msgr2=0x55f4cc2f7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.423+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 shutdown_connections 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.423+0000 7f1e55682740 1 -- 172.21.15.22:0/1404088807 wait complete. 2024-09-15T22:43:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.423+0000 7f1e55682740 20 client.25870 trim_cache size 0 max 16384 2024-09-15T22:43:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.467+0000 7f1e55682740 1 Processor -- start 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 -- start start 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc2f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc3179b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1adaf0 con 0x55f4cc2fb090 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1ab3c0 con 0x55f4cc2fb9d0 2024-09-15T22:43:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.468+0000 7f1e55682740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1a91f0 con 0x55f4cc300a60 2024-09-15T22:43:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc2f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc3179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc3179b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:46412/0 (socket says 172.21.15.22:46412) 2024-09-15T22:43:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 -- 172.21.15.22:0/1820253538 learned_addr learned my addr 172.21.15.22:0/1820253538 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 -- 172.21.15.22:0/1820253538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb9d0 msgr2=0x55f4cc30c750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:43:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 -- 172.21.15.22:0/1820253538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 msgr2=0x55f4cc2f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc2f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.469+0000 7f1e4be00640 1 -- 172.21.15.22:0/1820253538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cc2fbeb0 con 0x55f4cc300a60 2024-09-15T22:43:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.470+0000 7f1e4be00640 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc3179b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e44000f80 tx=0x7f1e4409c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee9a732c8198d73f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.470+0000 7f1e37e00640 1 -- 172.21.15.22:0/1820253538 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b4070 con 0x55f4cc300a60 2024-09-15T22:43:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.470+0000 7f1e37e00640 1 -- 172.21.15.22:0/1820253538 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4409cd50 con 0x55f4cc300a60 2024-09-15T22:43:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.470+0000 7f1e37e00640 1 -- 172.21.15.22:0/1820253538 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b0d90 con 0x55f4cc300a60 2024-09-15T22:43:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 -- 172.21.15.22:0/1820253538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 msgr2=0x55f4cc3179b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc3179b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e44000f80 tx=0x7f1e4409c7d0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 -- 172.21.15.22:0/1820253538 shutdown_connections 2024-09-15T22:43:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc300a60 0x55f4cc3179b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 --2- 172.21.15.22:0/1820253538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc2f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.471+0000 7f1e55682740 1 -- 172.21.15.22:0/1820253538 >> 172.21.15.22:0/1820253538 conn(0x55f4cc2f6700 msgr2=0x55f4cc2f5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.472+0000 7f1e55682740 1 -- 172.21.15.22:0/1820253538 shutdown_connections 2024-09-15T22:43:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.472+0000 7f1e55682740 1 -- 172.21.15.22:0/1820253538 wait complete. 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.472+0000 7f1e55682740 1 -- start start 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 Processor -- start 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc309dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc30b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1a9880 con 0x55f4cc2fb090 2024-09-15T22:43:38.475 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1aacf0 con 0x55f4cc300a60 2024-09-15T22:43:38.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.473+0000 7f1e55682740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1a9f50 con 0x55f4cc2fb9d0 2024-09-15T22:43:38.476 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.474+0000 7f1e55682740 10 client.0 _ll_register_callbacks cb 0x7f1e440988f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4b400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc309dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc30b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc30b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:59552/0 (socket says 172.21.15.22:59552) 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 -- 172.21.15.22:0/3271706857 learned_addr learned my addr 172.21.15.22:0/3271706857 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4aa00640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 -- 172.21.15.22:0/3271706857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb9d0 msgr2=0x55f4cc30a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 -- 172.21.15.22:0/3271706857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 msgr2=0x55f4cc309dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc309dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4be00640 1 -- 172.21.15.22:0/3271706857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cc30b920 con 0x55f4cc300a60 2024-09-15T22:43:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.475+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc309dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.476+0000 7f1e4be00640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc30b310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1e44099020 tx=0x7f1e4400cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2d234e32208285 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.476+0000 7f1e35600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.476+0000 7f1e35600640 1 -- 172.21.15.22:0/3271706857 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b4050 con 0x55f4cc300a60 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.476+0000 7f1e35600640 1 -- 172.21.15.22:0/3271706857 <== mon.2 v2:172.21.15.110:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f1e4409baa0 con 0x55f4cc300a60 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.477+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4409cd50 con 0x55f4cc300a60 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.477+0000 7f1e35600640 1 -- 172.21.15.22:0/3271706857 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e44005520 con 0x55f4cc300a60 2024-09-15T22:43:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.477+0000 7f1e55682740 10 client.25847 fetch_fsmap learned FSMap version 25 2024-09-15T22:43:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.477+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f4cc37b990 con 0x55f4cc300a60 2024-09-15T22:43:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.477+0000 7f1e35600640 1 -- 172.21.15.22:0/3271706857 <== mon.2 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4409cd50 con 0x55f4cc300a60 2024-09-15T22:43:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.477+0000 7f1e35600640 1 -- 172.21.15.22:0/3271706857 <== mon.2 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1e440b5260 con 0x55f4cc300a60 2024-09-15T22:43:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e55682740 10 client.25847 fetch_fsmap finished waiting for FSMap version 25 2024-09-15T22:43:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e55682740 10 client.25847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e55682740 20 client.25847 populate_metadata read hostname 'smithi022' 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e55682740 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc37c170 0x55f4cc37e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e55682740 4 client.25847 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 --> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4cc267b80 con 0x55f4cc37c170 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.478+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc37c170 0x55f4cc37e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.479+0000 7f1e4b400640 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc37c170 0x55f4cc37e560 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6dbd15817adf851 server_cookie=f276b803567ec65b in_seq=0 out_seq=0 2024-09-15T22:43:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.479+0000 7f1e35600640 10 client.25847 ms_handle_connect on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.517+0000 7f1e35600640 1 -- 172.21.15.22:0/3271706857 <== mds.0 v2:172.21.15.110:6838/1046187875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f4cc267b80 con 0x55f4cc37c170 2024-09-15T22:43:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.517+0000 7f1e35600640 10 client.25847 handle_command_reply: tid=0 2024-09-15T22:43:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.517+0000 7f1e55682740 1 client.25847 shutdown 2024-09-15T22:43:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.517+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 msgr2=0x55f4cc30b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.519 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.517+0000 7f1e55682740 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc30b310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1e44099020 tx=0x7f1e4400cf70 comp rx=0 tx=0).stop 2024-09-15T22:43:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.522+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 shutdown_connections 2024-09-15T22:43:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.522+0000 7f1e55682740 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:6838/1046187875,v1:172.21.15.110:6839/1046187875] conn(0x55f4cc37c170 0x55f4cc37e560 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.522+0000 7f1e55682740 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f4cc2fb9d0 0x55f4cc30a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.522+0000 7f1e55682740 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4cc300a60 0x55f4cc30b310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.522+0000 7f1e55682740 1 --2- 172.21.15.22:0/3271706857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f4cc2fb090 0x55f4cc309dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.522+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 >> 172.21.15.22:0/3271706857 conn(0x55f4cc2f6700 msgr2=0x55f4cc2f7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.523+0000 7f1e35600640 0 client.25847 ms_handle_reset on v2:172.21.15.110:6838/1046187875 2024-09-15T22:43:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.526+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 shutdown_connections 2024-09-15T22:43:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.526+0000 7f1e55682740 1 -- 172.21.15.22:0/3271706857 wait complete. 2024-09-15T22:43:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.526+0000 7f1e55682740 20 client.25847 trim_cache size 0 max 16384 2024-09-15T22:43:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-15T22:43:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-15T22:43:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-15T22:43:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-15T22:43:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.529+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1e300a3370 msgr2=0x7f1e300a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.529+0000 7f1e52800640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1e300a3370 0x7f1e300a5830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c104db0 tx=0x7f1e3c005f90 comp rx=0 tx=0).stop 2024-09-15T22:43:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.529+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 msgr2=0x7f1e4c1a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.529+0000 7f1e52800640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c1a15a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400eb10 tx=0x7f1e4400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 shutdown_connections 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e4c104f50 0x7f1e4c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f1e300a3370 0x7f1e300a5830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e4c105910 0x7f1e4c1a15a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 --2- 172.21.15.22:0/3368248385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e4c103d60 0x7f1e4c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 >> 172.21.15.22:0/3368248385 conn(0x7f1e4c0ff4e0 msgr2=0x7f1e4c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.530+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 shutdown_connections 2024-09-15T22:43:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-15T22:43:38.531+0000 7f1e52800640 1 -- 172.21.15.22:0/3368248385 wait complete. 2024-09-15T22:43:39.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:39 smithi110 ceph-mon[35282]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 288 MiB/s wr, 1.07k op/s 2024-09-15T22:43:39.537 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:39 smithi022 ceph-mon[30634]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 288 MiB/s wr, 1.07k op/s 2024-09-15T22:43:39.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:39 smithi112 ceph-mon[35032]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 288 MiB/s wr, 1.07k op/s 2024-09-15T22:43:39.893 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T22:43:39.893 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T22:43:40.274 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-15T22:43:40.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T22:43:41.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:41 smithi110 ceph-mon[35282]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 262 MiB/s wr, 970 op/s 2024-09-15T22:43:41.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:41 smithi022 ceph-mon[30634]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 262 MiB/s wr, 970 op/s 2024-09-15T22:43:41.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:41 smithi112 ceph-mon[35032]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 262 MiB/s wr, 970 op/s 2024-09-15T22:43:42.073 DEBUG:teuthology.parallel:result is None 2024-09-15T22:43:42.073 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:43:42.168 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:43:42.169 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-15T22:43:42.181 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:43:42.193 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T22:43:42.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:43:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.490+0000 7f2c44e00640 1 -- 172.21.15.22:0/799795589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40103520 msgr2=0x7f2c40109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.490+0000 7f2c44e00640 1 --2- 172.21.15.22:0/799795589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40103520 0x7f2c40109db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009ca0 tx=0x7f2c3802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.493+0000 7f2c44e00640 1 -- 172.21.15.22:0/799795589 shutdown_connections 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.493+0000 7f2c44e00640 1 --2- 172.21.15.22:0/799795589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c40102b60 0x7f2c40102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.493+0000 7f2c44e00640 1 --2- 172.21.15.22:0/799795589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40103520 0x7f2c40109db0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.493+0000 7f2c44e00640 1 --2- 172.21.15.22:0/799795589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c40101970 0x7f2c40101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.493+0000 7f2c44e00640 1 -- 172.21.15.22:0/799795589 >> 172.21.15.22:0/799795589 conn(0x7f2c400fd110 msgr2=0x7f2c400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.493+0000 7f2c44e00640 1 -- 172.21.15.22:0/799795589 shutdown_connections 2024-09-15T22:43:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.494+0000 7f2c44e00640 1 -- 172.21.15.22:0/799795589 wait complete. 2024-09-15T22:43:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.495+0000 7f2c44e00640 1 Processor -- start 2024-09-15T22:43:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.495+0000 7f2c44e00640 1 -- start start 2024-09-15T22:43:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.496+0000 7f2c44e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 0x7f2c40070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.496+0000 7f2c44e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c40102b60 0x7f2c40071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.496+0000 7f2c44e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c40103520 0x7f2c401a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.496+0000 7f2c44e00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4010d6c0 con 0x7f2c40102b60 2024-09-15T22:43:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.496+0000 7f2c44e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4010d540 con 0x7f2c40101970 2024-09-15T22:43:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.496+0000 7f2c44e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4010d840 con 0x7f2c40103520 2024-09-15T22:43:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 0x7f2c40070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 0x7f2c40070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:47574/0 (socket says 172.21.15.22:47574) 2024-09-15T22:43:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 -- 172.21.15.22:0/1538882616 learned_addr learned my addr 172.21.15.22:0/1538882616 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3ea00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c40102b60 0x7f2c40071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3fe00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c40103520 0x7f2c401a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 -- 172.21.15.22:0/1538882616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c40103520 msgr2=0x7f2c401a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c40103520 0x7f2c401a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 -- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c40102b60 msgr2=0x7f2c40071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c40102b60 0x7f2c40071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.497+0000 7f2c3f400640 1 -- 172.21.15.22:0/1538882616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c400741c0 con 0x7f2c40101970 2024-09-15T22:43:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.499+0000 7f2c3f400640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 0x7f2c40070b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b450 tx=0x7f2c3000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.499+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30015020 con 0x7f2c40101970 2024-09-15T22:43:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.499+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c30011d70 con 0x7f2c40101970 2024-09-15T22:43:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.499+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000f340 con 0x7f2c40101970 2024-09-15T22:43:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.500+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c401a83d0 con 0x7f2c40101970 2024-09-15T22:43:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.500+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c401a8920 con 0x7f2c40101970 2024-09-15T22:43:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.503+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c40101d70 con 0x7f2c40101970 2024-09-15T22:43:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.514+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2c30018020 con 0x7f2c40101970 2024-09-15T22:43:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.518+0000 7f2c37e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2c240a32d0 0x7f2c240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.519+0000 7f2c3ea00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2c240a32d0 0x7f2c240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.520+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f2c300cf750 con 0x7f2c40101970 2024-09-15T22:43:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.520+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c3001f020 con 0x7f2c40101970 2024-09-15T22:43:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.520+0000 7f2c3ea00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2c240a32d0 0x7f2c240a5790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2c40072010 tx=0x7f2c2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:42.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.820+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c40108c90 con 0x7f2c40101970 2024-09-15T22:43:42.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.823+0000 7f2c37e00640 1 -- 172.21.15.22:0/1538882616 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22773 (secure 0 0 0) 0x7f2c40108c90 con 0x7f2c40101970 2024-09-15T22:43:42.825 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:43:42.825 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:31:11.024043+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:42.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2c240a32d0 msgr2=0x7f2c240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2c240a32d0 0x7f2c240a5790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2c40072010 tx=0x7f2c2c005f90 comp rx=0 tx=0).stop 2024-09-15T22:43:42.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 msgr2=0x7f2c40070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 0x7f2c40070b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b450 tx=0x7f2c3000b910 comp rx=0 tx=0).stop 2024-09-15T22:43:42.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 shutdown_connections 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c40103520 0x7f2c401a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f2c240a32d0 0x7f2c240a5790 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c40102b60 0x7f2c40071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 --2- 172.21.15.22:0/1538882616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c40101970 0x7f2c40070b00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.825+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 >> 172.21.15.22:0/1538882616 conn(0x7f2c400fd110 msgr2=0x7f2c40105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.826+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 shutdown_connections 2024-09-15T22:43:42.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:42.826+0000 7f2c44e00640 1 -- 172.21.15.22:0/1538882616 wait complete. 2024-09-15T22:43:42.846 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:25:32.084179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:30:20.015948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:30:22.501877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:43:42.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:43:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 -- 172.21.15.22:0/4241294711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b68074bd0 msgr2=0x7f6b68075030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 --2- 172.21.15.22:0/4241294711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b68074bd0 0x7f6b68075030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009900 tx=0x7f6b5402a480 comp rx=0 tx=0).stop 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 -- 172.21.15.22:0/4241294711 shutdown_connections 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 --2- 172.21.15.22:0/4241294711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b681099d0 0x7f6b6810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 --2- 172.21.15.22:0/4241294711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b68074bd0 0x7f6b68075030 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 --2- 172.21.15.22:0/4241294711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b680761b0 0x7f6b68074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 -- 172.21.15.22:0/4241294711 >> 172.21.15.22:0/4241294711 conn(0x7f6b680fd2a0 msgr2=0x7f6b680ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.069+0000 7f6b70600640 1 -- 172.21.15.22:0/4241294711 shutdown_connections 2024-09-15T22:43:43.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.070+0000 7f6b70600640 1 -- 172.21.15.22:0/4241294711 wait complete. 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.070+0000 7f6b70600640 1 Processor -- start 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 -- start start 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 0x7f6b6819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b680761b0 0x7f6b6819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b681099d0 0x7f6b681a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6810f9f0 con 0x7f6b680761b0 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6810f870 con 0x7f6b681099d0 2024-09-15T22:43:43.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b70600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6810fb70 con 0x7f6b68074bd0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 0x7f6b6819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 0x7f6b6819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:40830/0 (socket says 172.21.15.22:40830) 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6dc00640 1 -- 172.21.15.22:0/2829496094 learned_addr learned my addr 172.21.15.22:0/2829496094 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6d200640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b680761b0 0x7f6b6819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6e600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b681099d0 0x7f6b681a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6dc00640 1 -- 172.21.15.22:0/2829496094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b681099d0 msgr2=0x7f6b681a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6dc00640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b681099d0 0x7f6b681a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.071+0000 7f6b6dc00640 1 -- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b680761b0 msgr2=0x7f6b6819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b6dc00640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b680761b0 0x7f6b6819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b6dc00640 1 -- 172.21.15.22:0/2829496094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b681a1cc0 con 0x7f6b68074bd0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b6e600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b681099d0 0x7f6b681a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b6dc00640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 0x7f6b6819a0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e9f0 tx=0x7f6b5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00cd80 con 0x7f6b68074bd0 2024-09-15T22:43:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b5c010910 con 0x7f6b68074bd0 2024-09-15T22:43:43.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b681a1fb0 con 0x7f6b68074bd0 2024-09-15T22:43:43.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0188f0 con 0x7f6b68074bd0 2024-09-15T22:43:43.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.072+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b681a2410 con 0x7f6b68074bd0 2024-09-15T22:43:43.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.073+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b68108790 con 0x7f6b68074bd0 2024-09-15T22:43:43.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.076+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6b5c010ac0 con 0x7f6b68074bd0 2024-09-15T22:43:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.081+0000 7f6b66000640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6b500a3250 0x7f6b500a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.082+0000 7f6b6d200640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6b500a3250 0x7f6b500a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.082+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f6b5c0d0140 con 0x7f6b68074bd0 2024-09-15T22:43:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.082+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b5c0d05c0 con 0x7f6b68074bd0 2024-09-15T22:43:43.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.083+0000 7f6b6d200640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6b500a3250 0x7f6b500a5710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b54031440 tx=0x7f6b540315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:43.185 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:43 smithi022 ceph-mon[30634]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 267 MiB/s wr, 993 op/s 2024-09-15T22:43:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.374+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6b6802da70 con 0x7f6b68074bd0 2024-09-15T22:43:43.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.374+0000 7f6b66000640 1 -- 172.21.15.22:0/2829496094 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f6b5c09ce20 con 0x7f6b68074bd0 2024-09-15T22:43:43.376 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-15T22:43:43.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6b500a3250 msgr2=0x7f6b500a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6b500a3250 0x7f6b500a5710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b54031440 tx=0x7f6b540315b0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 msgr2=0x7f6b6819a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 0x7f6b6819a0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e9f0 tx=0x7f6b5c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 shutdown_connections 2024-09-15T22:43:43.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f6b500a3250 0x7f6b500a5710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b681099d0 0x7f6b681a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b680761b0 0x7f6b6819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 --2- 172.21.15.22:0/2829496094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b68074bd0 0x7f6b6819a0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 >> 172.21.15.22:0/2829496094 conn(0x7f6b680fd2a0 msgr2=0x7f6b68105960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:43.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 shutdown_connections 2024-09-15T22:43:43.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.377+0000 7f6b70600640 1 -- 172.21.15.22:0/2829496094 wait complete. 2024-09-15T22:43:43.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:43:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:43 smithi110 ceph-mon[35282]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 267 MiB/s wr, 993 op/s 2024-09-15T22:43:43.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:43 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1538882616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:43.484 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:43 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1538882616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:43.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:43 smithi112 ceph-mon[35032]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 267 MiB/s wr, 993 op/s 2024-09-15T22:43:43.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:43 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1538882616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:43.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8daa00640 1 -- 172.21.15.22:0/115301610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0319b0 con 0x7fb8dc076230 2024-09-15T22:43:43.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 -- 172.21.15.22:0/115301610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc076230 msgr2=0x7fb8dc074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 --2- 172.21.15.22:0/115301610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc076230 0x7fb8dc074680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009900 tx=0x7fb8cc02a400 comp rx=0 tx=0).stop 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 -- 172.21.15.22:0/115301610 shutdown_connections 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 --2- 172.21.15.22:0/115301610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc109870 0x7fb8dc10bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 --2- 172.21.15.22:0/115301610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc074c50 0x7fb8dc0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 --2- 172.21.15.22:0/115301610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc076230 0x7fb8dc074680 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 -- 172.21.15.22:0/115301610 >> 172.21.15.22:0/115301610 conn(0x7fb8dc0fd180 msgr2=0x7fb8dc0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.665+0000 7fb8e1200640 1 -- 172.21.15.22:0/115301610 shutdown_connections 2024-09-15T22:43:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.666+0000 7fb8e1200640 1 -- 172.21.15.22:0/115301610 wait complete. 2024-09-15T22:43:43.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.666+0000 7fb8e1200640 1 Processor -- start 2024-09-15T22:43:43.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 -- start start 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc074c50 0x7fb8dc199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 0x7fb8dc19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc109870 0x7fb8dc1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc10f850 con 0x7fb8dc109870 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc10f6d0 con 0x7fb8dc076230 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8e1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc10f9d0 con 0x7fb8dc074c50 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 0x7fb8dc19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 0x7fb8dc19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:47606/0 (socket says 172.21.15.22:47606) 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8d3e00640 1 -- 172.21.15.22:0/2216787070 learned_addr learned my addr 172.21.15.22:0/2216787070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8db400640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc074c50 0x7fb8dc199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8dbe00640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc109870 0x7fb8dc1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.667+0000 7fb8d3e00640 1 -- 172.21.15.22:0/2216787070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc074c50 msgr2=0x7fb8dc199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d3e00640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc074c50 0x7fb8dc199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d3e00640 1 -- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc109870 msgr2=0x7fb8dc1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d3e00640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc109870 0x7fb8dc1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d3e00640 1 -- 172.21.15.22:0/2216787070 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc1a1b20 con 0x7fb8dc076230 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8dbe00640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc109870 0x7fb8dc1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d3e00640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 0x7fb8dc19a440 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400d950 tx=0x7fb8c400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:43.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4017070 con 0x7fb8dc076230 2024-09-15T22:43:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8c4009c30 con 0x7fb8dc076230 2024-09-15T22:43:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8dc1a1e10 con 0x7fb8dc076230 2024-09-15T22:43:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400f6b0 con 0x7fb8dc076230 2024-09-15T22:43:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.668+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8dc1a22d0 con 0x7fb8dc076230 2024-09-15T22:43:43.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.670+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8dc1085f0 con 0x7fb8dc076230 2024-09-15T22:43:43.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.673+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb8c40109d0 con 0x7fb8dc076230 2024-09-15T22:43:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.675+0000 7fb8d8c00640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3250 0x7fb8c00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.675+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7fb8c40cf8c0 con 0x7fb8dc076230 2024-09-15T22:43:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.675+0000 7fb8db400640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3250 0x7fb8c00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.676+0000 7fb8db400640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3250 0x7fb8c00a5710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0314e0 tx=0x7fb8cc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:43.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:43.678+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8c4009de0 con 0x7fb8dc076230 2024-09-15T22:43:44.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.079+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb8dc062df0 con 0x7fb8dc076230 2024-09-15T22:43:44.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.079+0000 7fb8d8c00640 1 -- 172.21.15.22:0/2216787070 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7fb8c409c5a0 con 0x7fb8dc076230 2024-09-15T22:43:44.081 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-09-15T22:43:44.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3250 msgr2=0x7fb8c00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3250 0x7fb8c00a5710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0314e0 tx=0x7fb8cc000bc0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 msgr2=0x7fb8dc19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 0x7fb8dc19a440 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400d950 tx=0x7fb8c400de10 comp rx=0 tx=0).stop 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 shutdown_connections 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fb8c00a3250 0x7fb8c00a5710 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8dc109870 0x7fb8dc1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8dc076230 0x7fb8dc19a440 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400d950 tx=0x7fb8c400de10 comp rx=0 tx=0).stop 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 --2- 172.21.15.22:0/2216787070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc074c50 0x7fb8dc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 >> 172.21.15.22:0/2216787070 conn(0x7fb8dc0fd180 msgr2=0x7fb8dc1057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:44.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 shutdown_connections 2024-09-15T22:43:44.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.082+0000 7fb8e1200640 1 -- 172.21.15.22:0/2216787070 wait complete. 2024-09-15T22:43:44.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:43:44.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 -- 172.21.15.22:0/3179064199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1057d0 msgr2=0x7f9f9c10c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 --2- 172.21.15.22:0/3179064199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c10c060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009ca0 tx=0x7f9f9402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 -- 172.21.15.22:0/3179064199 shutdown_connections 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 --2- 172.21.15.22:0/3179064199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c10c060 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 --2- 172.21.15.22:0/3179064199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c104e10 0x7f9f9c105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 --2- 172.21.15.22:0/3179064199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 -- 172.21.15.22:0/3179064199 >> 172.21.15.22:0/3179064199 conn(0x7f9f9c0ff3a0 msgr2=0x7f9f9c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 -- 172.21.15.22:0/3179064199 shutdown_connections 2024-09-15T22:43:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.376+0000 7f9f9b200640 1 -- 172.21.15.22:0/3179064199 wait complete. 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.377+0000 7f9f9b200640 1 Processor -- start 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 -- start start 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c104e10 0x7f9f9c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c1a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c10f8a0 con 0x7f9f9c103c20 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c10f720 con 0x7f9f9c1057d0 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f9b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c10fa20 con 0x7f9f9c104e10 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f93e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c104e10 0x7f9f9c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f99e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f99e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59664/0 (socket says 172.21.15.22:59664) 2024-09-15T22:43:44.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f99e00640 1 -- 172.21.15.22:0/1783395615 learned_addr learned my addr 172.21.15.22:0/1783395615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.378+0000 7f9f93e00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c104e10 0x7f9f9c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:40852/0 (socket says 172.21.15.22:40852) 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f9a800640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c1a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f99e00640 1 -- 172.21.15.22:0/1783395615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c104e10 msgr2=0x7f9f9c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f99e00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c104e10 0x7f9f9c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f99e00640 1 -- 172.21.15.22:0/1783395615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c1057d0 msgr2=0x7f9f9c1a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f99e00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c1a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f99e00640 1 -- 172.21.15.22:0/1783395615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c1a1b10 con 0x7f9f9c103c20 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f9a800640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c1a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:44.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f99e00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c199ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00e9c0 tx=0x7f9f8c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.379+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00cd80 con 0x7f9f9c103c20 2024-09-15T22:43:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.380+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f8c0035f0 con 0x7f9f9c103c20 2024-09-15T22:43:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.380+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c1a1e00 con 0x7f9f9c103c20 2024-09-15T22:43:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.380+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c1a2260 con 0x7f9f9c103c20 2024-09-15T22:43:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.380+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c010690 con 0x7f9f9c103c20 2024-09-15T22:43:44.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.381+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c104020 con 0x7f9f9c103c20 2024-09-15T22:43:44.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.383+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9f8c0037a0 con 0x7f9f9c103c20 2024-09-15T22:43:44.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.384+0000 7f9f92a00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9f800a3250 0x7f9f800a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:44.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.384+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f9f8c0cfde0 con 0x7f9f9c103c20 2024-09-15T22:43:44.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.385+0000 7f9f93e00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9f800a3250 0x7f9f800a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:44.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.385+0000 7f9f93e00640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9f800a3250 0x7f9f800a5710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c19b400 tx=0x7f9f84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.394+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f8c09cac0 con 0x7f9f9c103c20 2024-09-15T22:43:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:44 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2829496094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:43:44.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:44 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/2216787070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:43:44.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:44 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2829496094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:43:44.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:44 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/2216787070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:43:44.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:44 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2829496094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:43:44.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:44 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/2216787070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:43:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.778+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f9c062e20 con 0x7f9f9c103c20 2024-09-15T22:43:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.779+0000 7f9f92a00640 1 -- 172.21.15.22:0/1783395615 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f9f8c09c3c0 con 0x7f9f9c103c20 2024-09-15T22:43:44.780 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-09-15T22:43:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9f800a3250 msgr2=0x7f9f800a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9f800a3250 0x7f9f800a5710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c19b400 tx=0x7f9f84005f90 comp rx=0 tx=0).stop 2024-09-15T22:43:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 msgr2=0x7f9f9c199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c199ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00e9c0 tx=0x7f9f8c00ee80 comp rx=0 tx=0).stop 2024-09-15T22:43:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 shutdown_connections 2024-09-15T22:43:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c104e10 0x7f9f9c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f9f800a3250 0x7f9f800a5710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f9c1057d0 0x7f9f9c1a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 --2- 172.21.15.22:0/1783395615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f9c103c20 0x7f9f9c199ef0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 >> 172.21.15.22:0/1783395615 conn(0x7f9f9c0ff3a0 msgr2=0x7f9f9c108160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 shutdown_connections 2024-09-15T22:43:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:44.781+0000 7f9f9b200640 1 -- 172.21.15.22:0/1783395615 wait complete. 2024-09-15T22:43:44.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T22:43:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.091+0000 7f70a7200640 1 -- 172.21.15.22:0/542029030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 msgr2=0x7f70a8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.091+0000 7f70a7200640 1 --2- 172.21.15.22:0/542029030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8103f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7098009900 tx=0x7f709802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 -- 172.21.15.22:0/542029030 shutdown_connections 2024-09-15T22:43:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 --2- 172.21.15.22:0/542029030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8104d60 0x7f70a81051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 --2- 172.21.15.22:0/542029030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8105720 0x7f70a810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 --2- 172.21.15.22:0/542029030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8103f70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 -- 172.21.15.22:0/542029030 >> 172.21.15.22:0/542029030 conn(0x7f70a80ff2f0 msgr2=0x7f70a8101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:45.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 -- 172.21.15.22:0/542029030 shutdown_connections 2024-09-15T22:43:45.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.093+0000 7f70a7200640 1 -- 172.21.15.22:0/542029030 wait complete. 2024-09-15T22:43:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.095+0000 7f70a7200640 1 Processor -- start 2024-09-15T22:43:45.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.095+0000 7f70a7200640 1 -- start start 2024-09-15T22:43:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a7200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 0x7f70a819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8105720 0x7f70a81a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a7200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70a810f850 con 0x7f70a8103b70 2024-09-15T22:43:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f70a810f6d0 con 0x7f70a8104d60 2024-09-15T22:43:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70a810f9d0 con 0x7f70a8105720 2024-09-15T22:43:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.096+0000 7f70a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.097+0000 7f70a5e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59694/0 (socket says 172.21.15.22:59694) 2024-09-15T22:43:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.097+0000 7f70a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 0x7f70a819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.097+0000 7f70a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 0x7f70a819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:47632/0 (socket says 172.21.15.22:47632) 2024-09-15T22:43:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.097+0000 7f70a5400640 1 -- 172.21.15.22:0/684144061 learned_addr learned my addr 172.21.15.22:0/684144061 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:43:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.097+0000 7f70a6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8105720 0x7f70a81a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.098+0000 7f70a5e00640 1 -- 172.21.15.22:0/684144061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8105720 msgr2=0x7f70a81a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.098+0000 7f70a5e00640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8105720 0x7f70a81a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.098+0000 7f70a5e00640 1 -- 172.21.15.22:0/684144061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 msgr2=0x7f70a819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.098+0000 7f70a5e00640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 0x7f70a819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.098+0000 7f70a5e00640 1 -- 172.21.15.22:0/684144061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a81a1b60 con 0x7f70a8103b70 2024-09-15T22:43:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.099+0000 7f70a5400640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 0x7f70a819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.099+0000 7f70a6800640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8105720 0x7f70a81a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:45.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.099+0000 7f70a5e00640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8199f40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7098009230 tx=0x7f70980043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:45.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.100+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709803f070 con 0x7f70a8103b70 2024-09-15T22:43:45.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.100+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f709803b460 con 0x7f70a8103b70 2024-09-15T22:43:45.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.100+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098035070 con 0x7f70a8103b70 2024-09-15T22:43:45.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.101+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a81a1df0 con 0x7f70a8103b70 2024-09-15T22:43:45.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.101+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81a21a0 con 0x7f70a8103b70 2024-09-15T22:43:45.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.103+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a810af80 con 0x7f70a8103b70 2024-09-15T22:43:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.105+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f709803b910 con 0x7f70a8103b70 2024-09-15T22:43:45.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.107+0000 7f709ea00640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f708c0a33a0 0x7f708c0a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.108+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f70980ef620 con 0x7f70a8103b70 2024-09-15T22:43:45.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.108+0000 7f70a5400640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f708c0a33a0 0x7f708c0a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.110+0000 7f70a5400640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f708c0a33a0 0x7f708c0a5860 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f70a819b450 tx=0x7f7094008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:45.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.113+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70980bc340 con 0x7f70a8103b70 2024-09-15T22:43:45.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:45 smithi022 ceph-mon[30634]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 267 MiB/s wr, 990 op/s 2024-09-15T22:43:45.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:45 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1783395615' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:43:45.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.530+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f70a8062df0 con 0x7f70a8103b70 2024-09-15T22:43:45.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.544+0000 7f709ea00640 1 -- 172.21.15.22:0/684144061 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+742336 (secure 0 0 0) 0x7f70980bbc40 con 0x7f70a8103b70 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 20, 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "active_gid": 14150, 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "active_name": "x", 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addrs": { 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-15T22:43:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6800", 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 191438634 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 191438634 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addr": "172.21.15.22:6801/191438634", 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "active_change": "2024-09-15T22:23:09.459836+0000", 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "available": true, 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "standbys": [ 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24109, 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "z", 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-15T22:43:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-15T22:43:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-15T22:43:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-15T22:43:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-15T22:43:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:43:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-15T22:43:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-15T22:43:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-15T22:43:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-15T22:43:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-15T22:43:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-15T22:43:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.610 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.614 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:43:45.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.618 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-15T22:43:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.624 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-15T22:43:45.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.626 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.628 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-15T22:43:45.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-15T22:43:45.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.639 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.641 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:43:45.642 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.643 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.644 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.645 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.647 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.649 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-15T22:43:45.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.655 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:43:45.657 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.660 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-15T22:43:45.662 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.663 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.679 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:43:45.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:43:45.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.695 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.704 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.706 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.708 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:43:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:43:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:43:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:43:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-15T22:43:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-15T22:43:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-15T22:43:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-15T22:43:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-15T22:43:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-15T22:43:45.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.776 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.779 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.783 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.784 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-15T22:43:45.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-15T22:43:45.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.798 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.800 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-15T22:43:45.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.806 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.808 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:43:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-15T22:43:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-15T22:43:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-15T22:43:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-15T22:43:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-15T22:43:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-15T22:43:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:43:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-15T22:43:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-15T22:43:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-15T22:43:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-15T22:43:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-15T22:43:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:43:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-15T22:43:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-15T22:43:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-15T22:43:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24113, 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "y", 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-15T22:43:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:43:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:43:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-15T22:43:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-15T22:43:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-15T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-15T22:43:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-15T22:43:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-15T22:43:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-15T22:43:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-15T22:43:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-15T22:43:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:43:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:43:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-15T22:43:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:43:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:43:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-15T22:43:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-15T22:43:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-15T22:43:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:43:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-15T22:43:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:43:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:43:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:43:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:43:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:43:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:43:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-15T22:43:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:43:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:43:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:43:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-15T22:43:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-15T22:43:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-15T22:43:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-15T22:43:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-15T22:43:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:43:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-15T22:43:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:43:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-15T22:43:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-15T22:43:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-15T22:43:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:43:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-15T22:43:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-15T22:43:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-15T22:43:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:43:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-15T22:43:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-15T22:43:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-15T22:43:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-15T22:43:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-15T22:43:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-15T22:43:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-15T22:43:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:43:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-15T22:43:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-15T22:43:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "modules": [ 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard", 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "iostat", 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "nfs", 2024-09-15T22:43:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "restful" 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-15T22:43:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-15T22:43:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-15T22:43:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:43:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-15T22:43:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-15T22:43:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-15T22:43:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-15T22:43:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:43:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-15T22:43:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-15T22:43:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-15T22:43:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:43:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:43:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:43:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:43:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:43:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:43:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-15T22:43:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:43:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:43:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:43:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:43:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:43:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:43:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:43:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-15T22:43:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:43:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-15T22:43:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-15T22:43:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-15T22:43:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-15T22:43:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-15T22:43:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-15T22:43:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-15T22:43:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:43:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-15T22:43:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-15T22:43:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-15T22:43:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-15T22:43:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-15T22:43:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-15T22:43:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-15T22:43:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-15T22:43:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-15T22:43:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:43:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-15T22:43:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-15T22:43:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-15T22:43:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-15T22:43:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-15T22:43:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-15T22:43:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-15T22:43:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:43:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-15T22:43:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-15T22:43:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-15T22:43:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:43:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-15T22:43:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-15T22:43:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-15T22:43:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-15T22:43:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-15T22:43:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "services": { 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard": "https://172.21.15.22:8443/" 2024-09-15T22:43:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "always_on_modules": { 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "octopus": [ 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-15T22:43:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "pacific": [ 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "quincy": [ 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "reef": [ 2024-09-15T22:43:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "squid": [ 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-15T22:43:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "last_failure_osd_epoch": 3, 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "active_clients": [ 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 700744220 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "libcephsqlite", 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-15T22:43:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 202900109 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1518469017 2024-09-15T22:43:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2656745080 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-15T22:43:46.987 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:43:46.988 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:45 smithi110 ceph-mon[35282]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 267 MiB/s wr, 990 op/s 2024-09-15T22:43:46.988 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:45 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1783395615' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:43:46.988 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:46 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/684144061' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:43:46.988 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:45 smithi112 ceph-mon[35032]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 267 MiB/s wr, 990 op/s 2024-09-15T22:43:46.989 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:45 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1783395615' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:43:46.989 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:46 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/684144061' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:43:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.553+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f708c0a33a0 msgr2=0x7f708c0a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.553+0000 7f70a7200640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f708c0a33a0 0x7f708c0a5860 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f70a819b450 tx=0x7f7094008040 comp rx=0 tx=0).stop 2024-09-15T22:43:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.553+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 msgr2=0x7f70a8199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.553+0000 7f70a7200640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8199f40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7098009230 tx=0x7f70980043b0 comp rx=0 tx=0).stop 2024-09-15T22:43:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 shutdown_connections 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70a8105720 0x7f70a81a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f708c0a33a0 0x7f708c0a5860 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a8104d60 0x7f70a819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 --2- 172.21.15.22:0/684144061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a8103b70 0x7f70a8199f40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 >> 172.21.15.22:0/684144061 conn(0x7f70a80ff2f0 msgr2=0x7f70a8108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 shutdown_connections 2024-09-15T22:43:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:43:45.554+0000 7f70a7200640 1 -- 172.21.15.22:0/684144061 wait complete. 2024-09-15T22:43:46.996 DEBUG:tasks.check_counter:Getting stats from a 2024-09-15T22:43:46.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-15T22:43:46.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:46 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/684144061' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:43:47.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:47 smithi022 ceph-mon[30634]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 256 MiB/s wr, 973 op/s 2024-09-15T22:43:47.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:47 smithi112 ceph-mon[35032]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 256 MiB/s wr, 973 op/s 2024-09-15T22:43:47.645 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:47.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:47 smithi110 ceph-mon[35282]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 256 MiB/s wr, 973 op/s 2024-09-15T22:43:48.520 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:43:48.520 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:48.520 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-15T22:43:48.520 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003740609, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000544245, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:48.521 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.522 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 168, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 108160, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.021830463, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.017820093, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001409577, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 166, 2024-09-15T22:43:48.523 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.060132726, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000362245 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 108160 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 230, 2024-09-15T22:43:48.524 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 223, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 761376, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 136192, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.066553827, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.031111057, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.041783498, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 223, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.045575755, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000204375 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 761376, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 136192 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:48.526 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:48.527 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:48.528 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 149001, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 31, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-15T22:43:48.529 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-15T22:43:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 227, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 726355, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 227, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-15T22:43:48.531 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 227, 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 726355, 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:43:49.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:49 smithi022 ceph-mon[30634]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 277 MiB/s wr, 1.10k op/s 2024-09-15T22:43:49.545 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-15T22:43:49.545 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-15T22:43:49.546 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-15T22:43:49.546 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-15T22:43:49.546 DEBUG:tasks.check_counter:Getting stats from d 2024-09-15T22:43:49.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-15T22:43:49.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:49 smithi112 ceph-mon[35032]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 277 MiB/s wr, 1.10k op/s 2024-09-15T22:43:49.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:49 smithi110 ceph-mon[35282]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 277 MiB/s wr, 1.10k op/s 2024-09-15T22:43:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:43:50.537 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:50.537 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 231, 2024-09-15T22:43:50.537 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 226, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 759664, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 138944, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.068030987, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.031824671, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.040417814, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 225, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.085898448, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000381770 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.538 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 759664, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 138944 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 172, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:43:50.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 108864, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.029841991, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.025936940, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001507354, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 170, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.059877183, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000352218 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:50.540 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 108864 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3072, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 448, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-15T22:43:50.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003601917, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000049203, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.003479575, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.006583578, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002194526 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:50.542 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:50.543 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:50.544 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:50.545 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148967, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 29, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:50.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:50.547 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 232, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 727005, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 232, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 232, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 727005, 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:50.548 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:50.549 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:50.549 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:50.549 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:50.549 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:43:51.369 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-15T22:43:51.369 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-15T22:43:51.369 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-15T22:43:51.369 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-15T22:43:51.369 DEBUG:tasks.check_counter:Getting stats from g 2024-09-15T22:43:51.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-15T22:43:51.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:51 smithi022 ceph-mon[30634]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 247 MiB/s wr, 1.03k op/s 2024-09-15T22:43:51.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:51 smithi112 ceph-mon[35032]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 247 MiB/s wr, 1.03k op/s 2024-09-15T22:43:51.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:51 smithi110 ceph-mon[35282]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 247 MiB/s wr, 1.03k op/s 2024-09-15T22:43:51.753 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 34, 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 38, 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 8503, 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 63949, 2024-09-15T22:43:52.321 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 13, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 6, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.013441485, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.001508082, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.006610923, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.001041872, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 34, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.041722044, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001227118 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 19, 2024-09-15T22:43:52.322 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000002484, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000130 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 2176, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 3328 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2391, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 1340, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1309776, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 491514, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 6, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-15T22:43:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.238684463, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.082953987, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.321326117, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.007487728, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1341, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.517349711, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000385793 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2893, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001626835, 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000562 2024-09-15T22:43:52.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 795616, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 143008 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 25, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 191, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 9047, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 386508, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 7, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 5, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.059529981, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.044764728, 2024-09-15T22:43:52.325 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.011479156, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000328050, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 190, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.065639935, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000345473 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 10, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000008920, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000892 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.326 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 375008 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 42, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.002616237, 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000062291 2024-09-15T22:43:52.327 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000019443, 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000009721 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 5, 2024-09-15T22:43:52.328 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 4, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001747891, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000436972 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 1, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 11, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-15T22:43:52.329 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 16, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 16, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 13, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 8, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 1, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 1, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 3, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 15, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 11, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 4, 2024-09-15T22:43:52.330 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 4, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 234, 2024-09-15T22:43:52.331 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:43:52.332 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 14, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 9, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 10, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-15T22:43:52.333 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:43:52.334 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 5, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-15T22:43:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 5, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 2, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 2, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 4195737, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 0, 2024-09-15T22:43:52.336 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.007429961, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001857490 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 0 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 20, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 24, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 4, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 19, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 25, 2024-09-15T22:43:52.337 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 6, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 16, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 24, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 8, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 1, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 4, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 3, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 48544, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 223520 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 8, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-15T22:43:52.338 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 5, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 13, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 1, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001315744, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001315744 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.339 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000343264, 2024-09-15T22:43:52.340 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000171632 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000088883, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000088883 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-15T22:43:52.341 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-15T22:43:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.344 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.345 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.346 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.347 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.348 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-15T22:43:52.349 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 2, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 1, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-15T22:43:52.351 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 3, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 1, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 676, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:52.352 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:52.353 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-15T22:43:52.354 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 239413, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 84, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 88, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 1, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:52.355 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 7592, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 156, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 81381, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 335, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.356 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 42, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 11960, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 33, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 42, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 42, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.279996352, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.006666579 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-15T22:43:52.357 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 42, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 66 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 42, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 0, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 42, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 0, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 10, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 0, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 4, 2024-09-15T22:43:52.358 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 7, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 6, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 20, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-15T22:43:52.359 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-15T22:43:52.360 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 81, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 2, 2024-09-15T22:43:52.361 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 9, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 9, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 17, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 0, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 2 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 1, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.362 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:52.363 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 2446, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1090143, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 2446, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 2446, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1090143, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.364 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 42, 2024-09-15T22:43:52.365 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 11960, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 42, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 11960, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-15T22:43:52.366 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 42, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 42, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 42, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 42, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:43:52.367 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.368 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x558e099d6960": { 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 5, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1433, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 5, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-15T22:43:52.369 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 4, 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1433, 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:52.370 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:43:53.138 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-15T22:43:53.138 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-15T22:43:53.138 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-15T22:43:53.138 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=14 2024-09-15T22:43:53.138 DEBUG:tasks.check_counter:Getting stats from j 2024-09-15T22:43:53.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-15T22:43:53.516 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:53.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:53 smithi022 ceph-mon[30634]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 225 MiB/s wr, 983 op/s 2024-09-15T22:43:53.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:53 smithi112 ceph-mon[35032]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 225 MiB/s wr, 983 op/s 2024-09-15T22:43:53.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:53 smithi110 ceph-mon[35282]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 225 MiB/s wr, 983 op/s 2024-09-15T22:43:54.094 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-15T22:43:54.094 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:54.094 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-15T22:43:54.094 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-15T22:43:54.094 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003640411, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001057192, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:54.095 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:43:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 237, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 230, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 763280, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 140672, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.066740372, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.031140377, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.043482220, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:54.097 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 230, 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.057575568, 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000250328 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.098 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 763280, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 140672 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 174, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 109216, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.025426429, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.020883785, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001906425, 2024-09-15T22:43:54.099 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:54.100 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:54.100 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 172, 2024-09-15T22:43:54.100 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.044067641, 2024-09-15T22:43:54.100 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000256207 2024-09-15T22:43:54.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.100 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 109216 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-15T22:43:54.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:54.102 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:54.103 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:54.104 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 149998, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:54.105 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-15T22:43:54.106 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-15T22:43:54.107 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-15T22:43:54.107 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:54.107 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-15T22:43:54.107 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:54.107 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 234, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 727265, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 234, 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 234, 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 727265, 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-15T22:43:54.110 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-15T22:43:54.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:54.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-15T22:43:54.110 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-15T22:43:54.986 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-15T22:43:54.986 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-15T22:43:54.986 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-15T22:43:54.986 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-15T22:43:54.986 DEBUG:tasks.check_counter:Getting stats from b 2024-09-15T22:43:54.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-15T22:43:55.274 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:43:55.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:55 smithi112 ceph-mon[35032]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 194 MiB/s wr, 886 op/s 2024-09-15T22:43:55.613 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:55 smithi110 ceph-mon[35282]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 194 MiB/s wr, 886 op/s 2024-09-15T22:43:55.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:55 smithi022 ceph-mon[30634]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 194 MiB/s wr, 886 op/s 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 2042, 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 3011, 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 1336208, 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 4535611, 2024-09-15T22:43:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 100, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 3, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.197168350, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.066002056, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.119963651, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.016739543, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 3010, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.120064068, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000039888 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:55.872 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 3151, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000705388, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000223 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 833024, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 143664 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 2643, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 2244, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 932301, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 1406659, 2024-09-15T22:43:55.873 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 22, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 5, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.223068058, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.062560603, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.129932371, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.047895448, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2243, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.109797296, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000048951 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1252, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000529051, 2024-09-15T22:43:55.874 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000422 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 59536, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 412048 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 2334, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 3380, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 676052, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 5532438, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 10, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 6, 2024-09-15T22:43:55.875 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.176772874, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.070312039, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.078399891, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.033899715, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 3378, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.254684294, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000075394 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2437, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000572038, 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000234 2024-09-15T22:43:55.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 1, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "finisher-MDSRank": { 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "queue_len": 0, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "complete_latency": { 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2232, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.844830546, 2024-09-15T22:43:55.877 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000378508 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "finisher-PurgeQueue": { 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "queue_len": 0, 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "complete_latency": { 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 40, 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.001706231, 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000042655 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "request": 87, 2024-09-15T22:43:55.878 INFO:teuthology.orchestra.run.smithi110.stdout: "reply": 87, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "reply_latency": { 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 87, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.196802641, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.002262099 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "slow_reply": 0, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "forward": 0, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_fetch_complete": 0, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_fetch_keys": 0, 2024-09-15T22:43:55.879 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_commit": 399, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_split": 0, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_merge": 0, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes": 33, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_top": 7, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_bottom": 26, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_pin_tail": 0, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_pinned": 23, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_expired": 0, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_with_caps": 6, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": 6, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "subtrees": 2, 2024-09-15T22:43:55.880 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse": 106, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_hit": 95, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_forward": 0, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_discover": 0, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_remote_ino": 0, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_lock": 0, 2024-09-15T22:43:55.881 INFO:teuthology.orchestra.run.smithi110.stdout: "load_cent": 0, 2024-09-15T22:43:55.884 INFO:teuthology.orchestra.run.smithi110.stdout: "q": 0, 2024-09-15T22:43:55.884 INFO:teuthology.orchestra.run.smithi110.stdout: "exported": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "exported_inodes": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "imported": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "imported_inodes": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_dir_fetch": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_peer_discover": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rfiles": 4, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rbytes": 234, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rsnaps": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_set_tag": 0, 2024-09-15T22:43:55.885 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_file_inodes": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_revoke": 17, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_grant": 173, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_caps": 1352, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_caps_dirty": 1317, 2024-09-15T22:43:55.886 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_cap_release": 2, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "process_request_cap_release": 46 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_cache": { 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_update": 9, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_update_receipt": 0, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_try_discover": 0, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_send_discover": 0, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_handle_discover": 20, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays": 7, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays_delayed": 0, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_created": 22, 2024-09-15T22:43:55.887 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_enqueued": 15, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_reintegrated": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_migrated": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_processing": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "recovery_started": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "recovery_completed": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:43:55.888 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_exportdir": 0, 2024-09-15T22:43:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_flush": 0, 2024-09-15T22:43:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:43:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_fragstats": 0, 2024-09-15T22:43:55.889 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_inodestats": 0 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_log": { 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "evlrg": 0, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "evadd": 2089, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "evex": 2013, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "evtrm": 2013, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "ev": 76, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "evexg": 0, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "evexd": 40, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "segadd": 53, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "segex": 52, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "segtrm": 52, 2024-09-15T22:43:55.890 INFO:teuthology.orchestra.run.smithi110.stdout: "seg": 1, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "segmjr": 1, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "segexg": 0, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "segexd": 1, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "expos": 10776612, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "wrpos": 10940043, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "rdpos": 0, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "jlat": { 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 922, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 5.511531531, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.005977799 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.891 INFO:teuthology.orchestra.run.smithi110.stdout: "replayed": 0 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_mem": { 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "ino": 30, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "ino+": 45, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "ino-": 15, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "dir": 20, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "dir+": 22, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "dir-": 2, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "dn": 33, 2024-09-15T22:43:55.892 INFO:teuthology.orchestra.run.smithi110.stdout: "dn+": 67, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "dn-": 34, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "cap": 6, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "cap+": 35, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "cap-": 29, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "rss": 55720, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "heap": 231712 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_server": { 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "dispatch_client_request": 126, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "dispatch_server_request": 1, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_request": 87, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_session": 19, 2024-09-15T22:43:55.893 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_peer_request": 2, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "req_create_latency": { 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 22, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.016636844, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000756220 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getattr_latency": { 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 16, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.003414135, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000213383 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getfilelock_latency": { 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.894 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "req_link_latency": { 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookup_latency": { 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookuphash_latency": { 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.895 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupino_latency": { 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupname_latency": { 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.896 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupparent_latency": { 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupsnap_latency": { 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lssnap_latency": { 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mkdir_latency": { 2024-09-15T22:43:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 10, 2024-09-15T22:43:55.898 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.013656027, 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001365602 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mknod_latency": { 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mksnap_latency": { 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.899 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "req_open_latency": { 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1, 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000251257, 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000251257 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "req_readdir_latency": { 2024-09-15T22:43:55.900 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 5, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.008934126, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001786825 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rename_latency": { 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.002064526, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001032263 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "req_renamesnap_latency": { 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.901 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "req_snapdiff_latency": { 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmdir_latency": { 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 4, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.107977175, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.026994293 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmsnap_latency": { 2024-09-15T22:43:55.902 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmxattr_latency": { 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setattr_latency": { 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000866293, 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000866293 2024-09-15T22:43:55.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setdirlayout_latency": { 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setfilelock_latency": { 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setlayout_latency": { 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.904 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setxattr_latency": { 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 8, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.021728915, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.002716114 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "req_symlink_latency": { 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.905 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "req_unlink_latency": { 2024-09-15T22:43:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 18, 2024-09-15T22:43:55.906 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.021273343, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001181852 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getvxattr_latency": { 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_sessions": { 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "session_count": 1, 2024-09-15T22:43:55.907 INFO:teuthology.orchestra.run.smithi110.stdout: "session_add": 3, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "session_remove": 2, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "sessions_open": 1, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "sessions_stale": 0, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "total_load": 25, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "average_load": 25, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "avg_session_uptime": 685, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "mdthresh_evicted": 0 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:55.908 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:55.909 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:55.910 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 307322, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 125, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-15T22:43:55.911 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 7592, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 156, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 123785, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 1576, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:55.912 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "objecter": { 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_active": 0, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_laggy": 0, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_send": 2186, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_send_bytes": 7325154, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_resend": 32, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_reply": 2186, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "op_latency": { 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2186, 2024-09-15T22:43:55.913 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 28.548481848, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.013059689 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "op_inflight": 0, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "oplen_avg": { 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2186, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 3065 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "op": 2186, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "op_r": 2, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "op_w": 2184, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "op_rmw": 0, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "op_pg": 0, 2024-09-15T22:43:55.914 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_stat": 377, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_create": 44, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_read": 2, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_write": 924, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_writefull": 168, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_writesame": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_append": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_zero": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_truncate": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_delete": 529, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_mapext": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_sparse_read": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_clonerange": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_getxattr": 0, 2024-09-15T22:43:55.915 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_setxattr": 88, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_rmxattr": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_call": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_watch": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_notify": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_pgls": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_other": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_active": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_send": 0, 2024-09-15T22:43:55.916 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_resend": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_ping": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_active": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_send": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_resend": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_active": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_send": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_resend": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_active": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_send": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_resend": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "command_active": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "command_send": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "command_resend": 0, 2024-09-15T22:43:55.917 INFO:teuthology.orchestra.run.smithi110.stdout: "map_epoch": 81, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "map_full": 0, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "map_inc": 2, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_sessions": 12, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_session_open": 12, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_session_close": 0, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_laggy": 0, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_wr": 919, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_rd": 0, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_del": 14 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "oft": { 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_objs": 1, 2024-09-15T22:43:55.918 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_updates": 0, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_removes": 0 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "osd-slow-ops": { 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "slow_ops_count": 0 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "purge_queue": { 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_ops": 0, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_ops_high_water": 10, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing": 0, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_high_water": 10, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executed_ops": 15, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executed": 15, 2024-09-15T22:43:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_item_in_journal": 0 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 7015, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 2320217, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 7015, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 7015, 2024-09-15T22:43:55.920 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 2320217, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-objecter_bytes": { 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-15T22:43:55.921 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 2186, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 7326669, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 2186, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 7326669, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-objecter_ops": { 2024-09-15T22:43:55.922 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 1024, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 2186, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 2186, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 2186, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 2186, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.923 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 3758096384, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 15, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 1515, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 15, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:55.924 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 2, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 1515, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-write_buf_throttle-0x559b1d9da960": { 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 3758096384, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 2089, 2024-09-15T22:43:55.925 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 6745739, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 2089, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 922, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 6745739, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:55.926 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-15T22:43:56.807 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-15T22:43:56.808 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-15T22:43:56.808 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=9 2024-09-15T22:43:56.808 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-15T22:43:56.808 DEBUG:tasks.check_counter:Getting stats from e 2024-09-15T22:43:56.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-15T22:43:57.117 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:43:57.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:57 smithi112 ceph-mon[35032]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 158 MiB/s wr, 763 op/s 2024-09-15T22:43:57.618 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:57 smithi110 ceph-mon[35282]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 158 MiB/s wr, 763 op/s 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 236, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 229, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 763008, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 140032, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 4, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 0, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.033024186, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.012642493, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.027104699, 2024-09-15T22:43:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 229, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.013457278, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000058765 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 763008, 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 140032 2024-09-15T22:43:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 1, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 173, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 109040, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 3, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 2, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.008686618, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.006501804, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000690353, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 171, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.008084489, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000047277 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 109040 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 0, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 2, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 0, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 2, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 1, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.000274680, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000205513, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 0, 2024-09-15T22:43:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 149007, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 30, 2024-09-15T22:43:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 928, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 2, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 233, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 727135, 2024-09-15T22:43:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 233, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 233, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 727135, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:57.631 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-15T22:43:57.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:57 smithi022 ceph-mon[30634]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 158 MiB/s wr, 763 op/s 2024-09-15T22:43:58.274 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-15T22:43:58.274 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-15T22:43:58.274 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-15T22:43:58.274 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-15T22:43:58.274 DEBUG:tasks.check_counter:Getting stats from h 2024-09-15T22:43:58.274 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-15T22:43:58.520 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:43:59.025 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-15T22:43:59.025 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 1487, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 1488, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 4654785, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 472558, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 6, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 2, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.117656868, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.042649318, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.030929129, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.033715459, 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:59.026 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1486, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.041653717, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000028030 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:43:59.027 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 252, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 423, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 62578, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 456588, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 5, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 4, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.025682484, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.010733384, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.005093422, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.007045044, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 421, 2024-09-15T22:43:59.028 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.015115956, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000035904 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 376704 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 1102, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 1093, 2024-09-15T22:43:59.029 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 3551992, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 413263, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 3, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 2, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.092511393, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.029849294, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.043658077, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.021397068, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1093, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.032890800, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000030092 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.030 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 785696, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 140736 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 1, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: "finisher-MDSRank": { 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "queue_len": 0, 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "complete_latency": { 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 4361, 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.095855547, 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000021980 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "finisher-PurgeQueue": { 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "queue_len": 0, 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "complete_latency": { 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.032 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "request": 0, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "reply": 0, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "reply_latency": { 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "slow_reply": 0, 2024-09-15T22:43:59.033 INFO:teuthology.orchestra.run.smithi110.stdout: "forward": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_fetch_complete": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_fetch_keys": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_commit": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_split": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_merge": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes": 54, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_top": 4, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_bottom": 50, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_pin_tail": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_pinned": 47, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_expired": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_with_caps": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": 0, 2024-09-15T22:43:59.034 INFO:teuthology.orchestra.run.smithi110.stdout: "subtrees": 2, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_hit": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_forward": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_discover": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_remote_ino": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_lock": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "load_cent": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "q": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "exported": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "exported_inodes": 0, 2024-09-15T22:43:59.035 INFO:teuthology.orchestra.run.smithi110.stdout: "imported": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "imported_inodes": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_dir_fetch": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_peer_discover": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rfiles": 4, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rbytes": 234, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rsnaps": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_set_tag": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:43:59.036 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_file_inodes": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_caps": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_cap_release": 0, 2024-09-15T22:43:59.037 INFO:teuthology.orchestra.run.smithi110.stdout: "process_request_cap_release": 0 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_cache": { 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_update": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_update_receipt": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_try_discover": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_send_discover": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_handle_discover": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays_delayed": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_created": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_enqueued": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_reintegrated": 0, 2024-09-15T22:43:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_migrated": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_processing": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "recovery_started": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "recovery_completed": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_exportdir": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_flush": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:43:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_fragstats": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_inodestats": 0 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_log": { 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "evlrg": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "evadd": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "evex": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "evtrm": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "ev": 2089, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "evexg": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "evexd": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "segadd": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "segex": 0, 2024-09-15T22:43:59.040 INFO:teuthology.orchestra.run.smithi110.stdout: "segtrm": 0, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "seg": 2, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "segmjr": 52, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "segexg": 0, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "segexd": 0, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "expos": 10776612, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "wrpos": 10940043, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "rdpos": 10938022, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "jlat": { 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "replayed": 2089 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_mem": { 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "ino": 21, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "ino+": 36, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "ino-": 15, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "dir": 11, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "dir+": 13, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "dir-": 2, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "dn": 54, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "dn+": 57, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "dn-": 3, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "cap": 0, 2024-09-15T22:43:59.042 INFO:teuthology.orchestra.run.smithi110.stdout: "cap+": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "cap-": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "rss": 49224, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "heap": 215328 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_server": { 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "dispatch_client_request": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "dispatch_server_request": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_request": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_session": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_peer_request": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "req_create_latency": { 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.043 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getattr_latency": { 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getfilelock_latency": { 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "req_link_latency": { 2024-09-15T22:43:59.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookup_latency": { 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookuphash_latency": { 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupino_latency": { 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupname_latency": { 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupparent_latency": { 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.046 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupsnap_latency": { 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lssnap_latency": { 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mkdir_latency": { 2024-09-15T22:43:59.047 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mknod_latency": { 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mksnap_latency": { 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "req_open_latency": { 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "req_readdir_latency": { 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rename_latency": { 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.049 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "req_renamesnap_latency": { 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "req_snapdiff_latency": { 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.050 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmdir_latency": { 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmsnap_latency": { 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmxattr_latency": { 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.051 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setattr_latency": { 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setdirlayout_latency": { 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setfilelock_latency": { 2024-09-15T22:43:59.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setlayout_latency": { 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setxattr_latency": { 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "req_symlink_latency": { 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "req_unlink_latency": { 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getvxattr_latency": { 2024-09-15T22:43:59.054 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_sessions": { 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "session_count": 1, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "session_add": 3, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "session_remove": 2, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "sessions_open": 2, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "sessions_stale": 0, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "total_load": 0, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "average_load": 0, 2024-09-15T22:43:59.055 INFO:teuthology.orchestra.run.smithi110.stdout: "avg_session_uptime": 3369, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "mdthresh_evicted": 0 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:43:59.056 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:43:59.057 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:43:59.058 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 189659, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 58, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 7592, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 156, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:43:59.059 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 100625, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 1200, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "objecter": { 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "op_active": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "op_laggy": 0, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "op_send": 2594, 2024-09-15T22:43:59.060 INFO:teuthology.orchestra.run.smithi110.stdout: "op_send_bytes": 26, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "op_resend": 4, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "op_reply": 2594, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "op_latency": { 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2594, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 1.535972204, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000592124 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "op_inflight": 0, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "oplen_avg": { 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2594, 2024-09-15T22:43:59.061 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 2595 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "op": 2594, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "op_r": 2594, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "op_w": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "op_rmw": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "op_pg": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_stat": 1594, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_create": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_read": 997, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_write": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_writefull": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_writesame": 0, 2024-09-15T22:43:59.062 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_append": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_zero": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_truncate": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_delete": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_mapext": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_sparse_read": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_clonerange": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_getxattr": 2, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_setxattr": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_rmxattr": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_call": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_watch": 0, 2024-09-15T22:43:59.063 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_notify": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_pgls": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_other": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_active": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_send": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_resend": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_ping": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_active": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_send": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_resend": 0, 2024-09-15T22:43:59.064 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_active": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_send": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_resend": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_active": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_send": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_resend": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "command_active": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "command_send": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "command_resend": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "map_epoch": 81, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "map_full": 0, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "map_inc": 2, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_sessions": 5, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_session_open": 5, 2024-09-15T22:43:59.065 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_session_close": 0, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_laggy": 0, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_wr": 0, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_rd": 2, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_del": 0 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "oft": { 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_objs": 0, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_updates": 0, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_removes": 0 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "osd-slow-ops": { 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: "slow_ops_count": 0 2024-09-15T22:43:59.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "purge_queue": { 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_ops": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_high_water": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executed_ops": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executed": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_item_in_journal": 0 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-15T22:43:59.067 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 2837, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 7998541, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 2837, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 2837, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 7998541, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-objecter_bytes": { 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 2594, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 6758779, 2024-09-15T22:43:59.069 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 2594, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 6758779, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-objecter_ops": { 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 1024, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-15T22:43:59.070 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 2594, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 2594, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 2594, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 2594, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:43:59.071 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 3758096384, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 0, 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-write_buf_throttle-0x55fa47496b40": { 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 3758096384, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:43:59.073 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 0, 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 0, 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:43:59.074 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-15T22:43:59.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:43:59 smithi112 ceph-mon[35032]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 154 MiB/s wr, 806 op/s 2024-09-15T22:43:59.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:43:59 smithi110 ceph-mon[35282]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 154 MiB/s wr, 806 op/s 2024-09-15T22:43:59.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:43:59 smithi022 ceph-mon[30634]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 154 MiB/s wr, 806 op/s 2024-09-15T22:43:59.791 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-15T22:43:59.791 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-15T22:43:59.791 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-15T22:43:59.791 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-15T22:43:59.792 DEBUG:tasks.check_counter:Getting stats from k 2024-09-15T22:43:59.792 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-15T22:44:00.035 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:44:00.618 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 0, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 2, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 0, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 4, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 0, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.000888634, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000098550, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:44:00.619 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:44:00.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 240, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 233, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 764096, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 142592, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 2, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 1, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.031569420, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.012892495, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.025487247, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:00.621 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 233, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.014089894, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000060471 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 764096, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 142592 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:44:00.622 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 1, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 176, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 109568, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 3, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 2, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.009031125, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.006911906, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000538622, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 174, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.007586913, 2024-09-15T22:44:00.623 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000043602 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 109568 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 0, 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-15T22:44:00.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:44:00.625 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:44:00.626 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 148945, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 29, 2024-09-15T22:44:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-15T22:44:00.628 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 928, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 2, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 237, 2024-09-15T22:44:00.629 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 727655, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 237, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 237, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 727655, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-15T22:44:00.630 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-15T22:44:01.325 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-15T22:44:01.326 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-15T22:44:01.326 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-15T22:44:01.326 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-15T22:44:01.326 DEBUG:tasks.check_counter:Getting stats from c 2024-09-15T22:44:01.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-15T22:44:01.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:01 smithi110 ceph-mon[35282]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 117 MiB/s wr, 665 op/s 2024-09-15T22:44:01.586 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:44:01.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:01 smithi112 ceph-mon[35032]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 117 MiB/s wr, 665 op/s 2024-09-15T22:44:01.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:01 smithi022 ceph-mon[30634]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 117 MiB/s wr, 665 op/s 2024-09-15T22:44:02.027 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T22:44:02.027 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:44:02.027 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 2302, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 2304, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 653572, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 732043, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 6, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.160464117, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.051208946, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.041370563, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.056091856, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2302, 2024-09-15T22:44:02.028 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.057847444, 2024-09-15T22:44:02.029 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000025129 2024-09-15T22:44:02.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.032 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:02.032 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.032 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 7, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 177, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3788, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 379642, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2024-09-15T22:44:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.011190848, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.006588897, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.003164013, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000057179, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 176, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.012280368, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000069774 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.034 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 378944 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 242, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 235, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 783004, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 141086, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 3, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-15T22:44:02.035 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.031666499, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.013296921, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.024492616, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000026419, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 234, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.010669424, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000045595 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 782736, 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 140768 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T22:44:02.037 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3913, 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.088177209, 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000022534 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T22:44:02.038 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 0, 2024-09-15T22:44:02.040 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 1, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-09-15T22:44:02.041 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:44:02.042 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2024-09-15T22:44:02.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-09-15T22:44:02.044 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-09-15T22:44:02.045 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 5, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-09-15T22:44:02.046 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 2, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 2, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 4195737, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 4195596, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 5 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.047 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 3, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 3, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 1, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 1, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2024-09-15T22:44:02.048 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 48112, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 215328 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.049 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.050 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.051 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.052 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-09-15T22:44:02.053 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.054 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-09-15T22:44:02.055 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.057 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.058 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-09-15T22:44:02.060 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-09-15T22:44:02.061 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 2, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 1, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 2, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 3347, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:44:02.062 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:44:02.063 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:44:02.064 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 181343, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 47, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T22:44:02.065 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7592, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 156, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 8512, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 13, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T22:44:02.066 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2305, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 21, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 3, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2305, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2305, 2024-09-15T22:44:02.067 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.061972691, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000460725 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2305, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2306 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2305, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2305, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-09-15T22:44:02.068 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1493, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 810, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 1, 2024-09-15T22:44:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-09-15T22:44:02.070 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 81, 2024-09-15T22:44:02.071 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 4, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 4, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2024-09-15T22:44:02.072 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2024-09-15T22:44:02.073 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2547, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1195644, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2547, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2547, 2024-09-15T22:44:02.074 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1195644, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:02.075 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2305, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 1438, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2305, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1438, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-09-15T22:44:02.076 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2305, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2305, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2305, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2305, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-09-15T22:44:02.078 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x562938602b40": { 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:02.079 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:02.080 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T22:44:02.912 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-15T22:44:02.912 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-15T22:44:02.912 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-15T22:44:02.912 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-15T22:44:02.912 DEBUG:tasks.check_counter:Getting stats from f 2024-09-15T22:44:02.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-15T22:44:03.176 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:44:03.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:03 smithi112 ceph-mon[35032]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 96 MiB/s wr, 571 op/s 2024-09-15T22:44:03.656 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 815, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 815, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 217562, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 258410, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 6, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.058075667, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.018585459, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.016505363, 2024-09-15T22:44:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.016560020, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 814, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.026777922, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000032896 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.658 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 956, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 949, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 958674, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 368465, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.082961510, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.026945360, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.036403225, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.021658023, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 948, 2024-09-15T22:44:03.659 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.026512851, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000027967 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 783008, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 141408 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:44:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 805, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 978, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 270304, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 634344, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.086038228, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.030532347, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.021359532, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.025776652, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 976, 2024-09-15T22:44:03.661 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.036409357, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000037304 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 378672 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-09-15T22:44:03.662 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3897, 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.095347766, 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000024466 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T22:44:03.663 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.664 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 0, 2024-09-15T22:44:03.665 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 1, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-09-15T22:44:03.666 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:44:03.667 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2024-09-15T22:44:03.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-09-15T22:44:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-09-15T22:44:03.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 5, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 2, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 2, 2024-09-15T22:44:03.671 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 4195737, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 4195426, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 5 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 3, 2024-09-15T22:44:03.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 3, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 1, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 1, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 48636, 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 215328 2024-09-15T22:44:03.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.674 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-09-15T22:44:03.675 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.676 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.677 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-09-15T22:44:03.678 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.679 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.680 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-09-15T22:44:03.681 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.683 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.684 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.685 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 2, 2024-09-15T22:44:03.686 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 1, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 2020, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:44:03.687 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:44:03.688 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T22:44:03.689 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 189383, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 50, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:44:03.690 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7592, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 156, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 8512, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 13, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T22:44:03.691 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2329, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 21, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 3, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2329, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2329, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.853926521, 2024-09-15T22:44:03.692 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001225387 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2329, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2330 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2329, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2329, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1516, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2024-09-15T22:44:03.693 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 811, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 1, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2024-09-15T22:44:03.694 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-09-15T22:44:03.695 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 81, 2024-09-15T22:44:03.696 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 5, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 5, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-09-15T22:44:03.697 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 0, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.698 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2572, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1199518, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2572, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2572, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1199518, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.699 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2329, 2024-09-15T22:44:03.700 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 1438, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2329, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1438, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:03.701 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2329, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2329, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2329, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2329, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.702 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:03.703 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x563f1ae0eb40": { 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:03.704 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:03.705 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T22:44:03.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:03 smithi110 ceph-mon[35282]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 96 MiB/s wr, 571 op/s 2024-09-15T22:44:03.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:03 smithi022 ceph-mon[30634]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 96 MiB/s wr, 571 op/s 2024-09-15T22:44:04.470 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-15T22:44:04.470 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-15T22:44:04.470 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-15T22:44:04.470 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-15T22:44:04.471 DEBUG:tasks.check_counter:Getting stats from i 2024-09-15T22:44:04.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-15T22:44:04.725 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:44:05.329 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T22:44:05.329 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:44:05.329 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 2426, 2024-09-15T22:44:05.329 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1359, 2024-09-15T22:44:05.329 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 1317128, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 508686, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 7, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.119880633, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.045471933, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.088600801, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.004411807, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1361, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.052168613, 2024-09-15T22:44:05.330 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000038331 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3045, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000574314, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000188 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 795920, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 146496 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 18, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 189, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 4528, 2024-09-15T22:44:05.331 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 415683, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 8, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.010963060, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.006556650, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.002579518, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000370342, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 187, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.018399265, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000098391 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:05.332 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000142, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000071 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 378320 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 31, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 35, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 8468, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 33688, 2024-09-15T22:44:05.333 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 10, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 8, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.008928495, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.002197868, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.005962966, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000305134, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 31, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.011163179, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000360102 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 24, 2024-09-15T22:44:05.334 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000010312, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000429 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T22:44:05.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 48, 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.001413017, 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000029437 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000008569, 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000004284 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 3, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 2, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000323725, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000161862 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 1, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-09-15T22:44:05.337 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 11, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 16, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 0, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 16, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-09-15T22:44:05.338 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 13, 2024-09-15T22:44:05.339 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 8, 2024-09-15T22:44:05.339 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 1, 2024-09-15T22:44:05.339 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 1, 2024-09-15T22:44:05.339 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 3, 2024-09-15T22:44:05.339 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 12, 2024-09-15T22:44:05.339 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 6, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 5, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-09-15T22:44:05.340 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 234, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:44:05.341 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2024-09-15T22:44:05.342 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 1 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 12, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 8, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 10, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2024-09-15T22:44:05.343 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-09-15T22:44:05.344 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 5, 2024-09-15T22:44:05.345 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 5, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 2, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 2, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 2, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-09-15T22:44:05.346 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 4195737, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 0, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.007603295, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001900823 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 0 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-09-15T22:44:05.347 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 20, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 24, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 4, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 19, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 24, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 5, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 16, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 24, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 8, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 1, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 2, 2024-09-15T22:44:05.348 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 1, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 52424, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 223520 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 4, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 3, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 14, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-09-15T22:44:05.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000182730, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000182730 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000140995, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000140995 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.353 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-09-15T22:44:05.354 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.357 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-09-15T22:44:05.358 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.359 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.362 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 2, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 1, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 1, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 1, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 692, 2024-09-15T22:44:05.364 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:44:05.365 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:44:05.366 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T22:44:05.367 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 239013, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 79, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T22:44:05.368 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T22:44:05.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T22:44:05.369 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 7592, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 156, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 81317, 2024-09-15T22:44:05.370 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 327, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 41, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 11946, 2024-09-15T22:44:05.371 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 32, 2024-09-15T22:44:05.372 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 41, 2024-09-15T22:44:05.372 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-09-15T22:44:05.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 41, 2024-09-15T22:44:05.372 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.221994272, 2024-09-15T22:44:05.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.005414494 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 41, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 64 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 41, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 0, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 41, 2024-09-15T22:44:05.373 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 10, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 4, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 7, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2024-09-15T22:44:05.374 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 6, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 20, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-09-15T22:44:05.375 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-09-15T22:44:05.376 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-09-15T22:44:05.377 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 81, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 2, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 8, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 8, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-09-15T22:44:05.378 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 16, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 1 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 1, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-09-15T22:44:05.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 0, 2024-09-15T22:44:05.380 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2471, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1090679, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2471, 2024-09-15T22:44:05.381 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2471, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1090679, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:05.382 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 41, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 11946, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 41, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 11946, 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:05.383 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:05.384 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 41, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 41, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 41, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 41, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x56374e96a960": { 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T22:44:05.387 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 5, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1433, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 5, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 4, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1433, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:05.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:05.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:05.389 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 78 MiB/s wr, 473 op/s 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:05 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 78 MiB/s wr, 473 op/s 2024-09-15T22:44:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:44:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.706 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:05 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 78 MiB/s wr, 473 op/s 2024-09-15T22:44:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:44:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:05.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:05 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:06.139 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-15T22:44:06.139 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-15T22:44:06.139 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-15T22:44:06.140 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=12 2024-09-15T22:44:06.140 DEBUG:tasks.check_counter:Getting stats from l 2024-09-15T22:44:06.140 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-15T22:44:06.359 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:44:06.359 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:44:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:44:06.661 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:06 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:06.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:44:06.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:44:06.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:06 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:06.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:44:06.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:44:06.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:06 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 0, 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 2, 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 0, 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-15T22:44:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.001036373, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000240187, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 5, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 180, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3232, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 110368, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 3, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-15T22:44:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.011377470, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.007158689, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.002560758, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 179, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.011421498, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000063807 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-15T22:44:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 110368 2024-09-15T22:44:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 238, 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 233, 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 761568, 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 143424, 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-15T22:44:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.030960127, 2024-09-15T22:44:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.012701742, 2024-09-15T22:44:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.024594473, 2024-09-15T22:44:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:44:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:44:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 232, 2024-09-15T22:44:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.009035400, 2024-09-15T22:44:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000038945 2024-09-15T22:44:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:44:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 761568, 2024-09-15T22:44:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 143424 2024-09-15T22:44:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T22:44:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-15T22:44:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T22:44:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T22:44:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:44:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T22:44:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:44:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:44:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:44:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:44:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:44:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:44:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:44:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:44:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:44:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:44:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:44:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:44:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:44:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T22:44:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:44:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T22:44:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:44:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:44:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:44:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:44:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:44:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:44:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:44:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T22:44:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:44:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:44:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:44:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T22:44:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T22:44:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T22:44:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:44:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:44:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:44:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:44:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148967, 2024-09-15T22:44:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 29, 2024-09-15T22:44:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:44:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T22:44:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-15T22:44:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-15T22:44:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:44:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:44:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T22:44:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T22:44:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 928, 2024-09-15T22:44:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-15T22:44:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T22:44:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T22:44:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T22:44:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T22:44:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T22:44:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:44:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T22:44:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T22:44:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T22:44:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 239, 2024-09-15T22:44:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 727915, 2024-09-15T22:44:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T22:44:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 239, 2024-09-15T22:44:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T22:44:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T22:44:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 239, 2024-09-15T22:44:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 727915, 2024-09-15T22:44:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T22:44:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T22:44:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T22:44:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T22:44:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T22:44:06.905 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T22:44:07.455 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:07 smithi110 ceph-mon[35282]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 66 MiB/s wr, 412 op/s 2024-09-15T22:44:07.506 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:07 smithi112 ceph-mon[35032]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 66 MiB/s wr, 412 op/s 2024-09-15T22:44:07.531 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-15T22:44:07.531 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-15T22:44:07.531 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-15T22:44:07.531 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-15T22:44:07.531 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T22:44:07.542 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T22:44:07.543 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:44:07.543 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:07.586 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-15T22:44:07.586 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:44:07.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:44:07.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:07 smithi022 ceph-mon[30634]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 66 MiB/s wr, 412 op/s 2024-09-15T22:44:08.088 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:08.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.670+0000 7f32a3c00640 1 -- 172.21.15.22:0/2625024866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 msgr2=0x7f329c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.670+0000 7f32a3c00640 1 --2- 172.21.15.22:0/2625024866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c076b00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3290009ca0 tx=0x7f329002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 -- 172.21.15.22:0/2625024866 shutdown_connections 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 --2- 172.21.15.22:0/2625024866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c077040 0x7f329c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 --2- 172.21.15.22:0/2625024866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c112a30 0x7f329c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 --2- 172.21.15.22:0/2625024866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c076b00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 -- 172.21.15.22:0/2625024866 >> 172.21.15.22:0/2625024866 conn(0x7f329c0ffa90 msgr2=0x7f329c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 -- 172.21.15.22:0/2625024866 shutdown_connections 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.671+0000 7f32a3c00640 1 -- 172.21.15.22:0/2625024866 wait complete. 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 Processor -- start 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 -- start start 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c077040 0x7f329c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c112a30 0x7f329c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f329c118610 con 0x7f329c076720 2024-09-15T22:44:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f329c118490 con 0x7f329c077040 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f329c118790 con 0x7f329c112a30 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c112a30 0x7f329c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a1200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c1a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43396/0 (socket says 172.21.15.22:43396) 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f32a1200640 1 -- 172.21.15.22:0/665342177 learned_addr learned my addr 172.21.15.22:0/665342177 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.672+0000 7f329be00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c077040 0x7f329c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a1c00640 1 -- 172.21.15.22:0/665342177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c077040 msgr2=0x7f329c1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a1c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c077040 0x7f329c1a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a1c00640 1 -- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 msgr2=0x7f329c1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a1c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c1a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a1c00640 1 -- 172.21.15.22:0/665342177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c19eff0 con 0x7f329c112a30 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a1c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c112a30 0x7f329c19e8c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f329c06b460 tx=0x7f329400db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294017070 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3294009cd0 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.673+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c19f2e0 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.674+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294003d60 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.674+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c1ab5d0 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.675+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329c076b00 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.676+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f32940097f0 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.678+0000 7f3299600640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32840a3240 0x7f32840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.678+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f32940cf150 con 0x7f329c112a30 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.678+0000 7f32a1200640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32840a3240 0x7f32840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.679+0000 7f32a1200640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32840a3240 0x7f32840a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3290000f80 tx=0x7f3290005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.682+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f329409b7e0 con 0x7f329c112a30 2024-09-15T22:44:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.882+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f329c02d7c0 con 0x7f329c112a30 2024-09-15T22:44:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.883+0000 7f3299600640 1 -- 172.21.15.22:0/665342177 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+592 (secure 0 0 0) 0x7f329409fae0 con 0x7f329c112a30 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3305817552 2024-09-16T22:23:09.459721+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3624200134 2024-09-16T22:23:09.459721+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1725043068 2024-09-16T22:23:09.459721+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3305817552 2024-09-16T22:23:09.459721+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/2616449464 2024-09-16T22:22:40.678920+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/2616449464 2024-09-16T22:22:40.678920+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3382105738 2024-09-16T22:22:40.678920+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3049867263 2024-09-16T22:23:09.459721+0000 2024-09-15T22:44:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3523117683 2024-09-16T22:22:40.678920+0000 2024-09-15T22:44:08.885 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1271758657 2024-09-16T22:22:40.678920+0000 2024-09-15T22:44:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:listed 10 entries 2024-09-15T22:44:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32840a3240 msgr2=0x7f32840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32840a3240 0x7f32840a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3290000f80 tx=0x7f3290005d80 comp rx=0 tx=0).stop 2024-09-15T22:44:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c112a30 msgr2=0x7f329c19e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c112a30 0x7f329c19e8c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f329c06b460 tx=0x7f329400db40 comp rx=0 tx=0).stop 2024-09-15T22:44:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 shutdown_connections 2024-09-15T22:44:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f329c112a30 0x7f329c19e8c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f32840a3240 0x7f32840a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f329c077040 0x7f329c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 --2- 172.21.15.22:0/665342177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f329c076720 0x7f329c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 >> 172.21.15.22:0/665342177 conn(0x7f329c0ffa90 msgr2=0x7f329c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.885+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 shutdown_connections 2024-09-15T22:44:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:08.886+0000 7f32a3c00640 1 -- 172.21.15.22:0/665342177 wait complete. 2024-09-15T22:44:09.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:09 smithi022 ceph-mon[30634]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 60 MiB/s wr, 377 op/s 2024-09-15T22:44:09.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:09 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/665342177' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:44:09.601 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:44:09.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:09.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:44:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:09 smithi110 ceph-mon[35282]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 60 MiB/s wr, 377 op/s 2024-09-15T22:44:09.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:09 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/665342177' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:44:09.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:09 smithi112 ceph-mon[35032]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 60 MiB/s wr, 377 op/s 2024-09-15T22:44:09.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:09 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/665342177' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:44:11.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:11 smithi110 ceph-mon[35282]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 28 MiB/s wr, 181 op/s 2024-09-15T22:44:11.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:11 smithi022 ceph-mon[30634]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 28 MiB/s wr, 181 op/s 2024-09-15T22:44:11.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:11 smithi112 ceph-mon[35032]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 28 MiB/s wr, 181 op/s 2024-09-15T22:44:13.705 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:13 smithi110 ceph-mon[35282]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 20 MiB/s wr, 167 op/s 2024-09-15T22:44:13.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:13 smithi022 ceph-mon[30634]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 20 MiB/s wr, 167 op/s 2024-09-15T22:44:13.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:13 smithi112 ceph-mon[35032]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 20 MiB/s wr, 167 op/s 2024-09-15T22:44:15.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:15 smithi022 ceph-mon[30634]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 36 MiB/s wr, 337 op/s 2024-09-15T22:44:15.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:15 smithi112 ceph-mon[35032]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 36 MiB/s wr, 337 op/s 2024-09-15T22:44:15.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:15 smithi110 ceph-mon[35282]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 36 MiB/s wr, 337 op/s 2024-09-15T22:44:17.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:17 smithi022 ceph-mon[30634]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 MiB/s wr, 692 op/s 2024-09-15T22:44:17.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:17 smithi112 ceph-mon[35032]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 MiB/s wr, 692 op/s 2024-09-15T22:44:17.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:17 smithi110 ceph-mon[35282]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 MiB/s wr, 692 op/s 2024-09-15T22:44:18.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:44:18.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:18.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:44:18.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:18.377 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-15T22:44:18.440 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:44:18.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:18.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:44:18.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:44:18.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-15T22:44:18.818 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T22:44:18.829 INFO:tasks.cephadm:Teardown begin 2024-09-15T22:44:18.829 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:44:18.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:44:19.550 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:19.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:19 smithi022 ceph-mon[30634]: pgmap v705: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 130 MiB/s wr, 1.22k op/s 2024-09-15T22:44:19.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:19 smithi112 ceph-mon[35032]: pgmap v705: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 130 MiB/s wr, 1.22k op/s 2024-09-15T22:44:19.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:19 smithi110 ceph-mon[35282]: pgmap v705: 97 pgs: 97 active+clean; 9.7 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 130 MiB/s wr, 1.22k op/s 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 -- 172.21.15.22:0/3707353021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8103e30 msgr2=0x7f8dc8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 --2- 172.21.15.22:0/3707353021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8103e30 0x7f8dc8104210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009900 tx=0x7f8db802a410 comp rx=0 tx=0).stop 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 -- 172.21.15.22:0/3707353021 shutdown_connections 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 --2- 172.21.15.22:0/3707353021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8108f60 0x7f8dc8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 --2- 172.21.15.22:0/3707353021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81047e0 0x7f8dc8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 --2- 172.21.15.22:0/3707353021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8103e30 0x7f8dc8104210 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 -- 172.21.15.22:0/3707353021 >> 172.21.15.22:0/3707353021 conn(0x7f8dc80ff910 msgr2=0x7f8dc8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 -- 172.21.15.22:0/3707353021 shutdown_connections 2024-09-15T22:44:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.381+0000 7f8dce000640 1 -- 172.21.15.22:0/3707353021 wait complete. 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.382+0000 7f8dce000640 1 Processor -- start 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 -- start start 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 0x7f8dc819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81047e0 0x7f8dc819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8108f60 0x7f8dc819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8114010 con 0x7f8dc8103e30 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8113e90 con 0x7f8dc81047e0 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dce000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8114190 con 0x7f8dc8108f60 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dccc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 0x7f8dc819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dccc00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 0x7f8dc819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34700/0 (socket says 172.21.15.22:34700) 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dccc00640 1 -- 172.21.15.22:0/1838613055 learned_addr learned my addr 172.21.15.22:0/1838613055 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.383+0000 7f8dcd600640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8108f60 0x7f8dc819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dbfe00640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81047e0 0x7f8dc819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dccc00640 1 -- 172.21.15.22:0/1838613055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8108f60 msgr2=0x7f8dc819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dccc00640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8108f60 0x7f8dc819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dccc00640 1 -- 172.21.15.22:0/1838613055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81047e0 msgr2=0x7f8dc819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dccc00640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81047e0 0x7f8dc819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dccc00640 1 -- 172.21.15.22:0/1838613055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc819f4a0 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dccc00640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 0x7f8dc819a4f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8db8004770 tx=0x7f8db8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db803f070 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db8031ca0 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc819f730 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.384+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8035030 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.385+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc81a7070 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.386+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc8105310 con 0x7f8dc8103e30 2024-09-15T22:44:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.388+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8db8042070 con 0x7f8dc8103e30 2024-09-15T22:44:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.389+0000 7f8dc6000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8dac0a3240 0x7f8dac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.389+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f8db80eff30 con 0x7f8dc8103e30 2024-09-15T22:44:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.389+0000 7f8dbfe00640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8dac0a3240 0x7f8dac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.390+0000 7f8dbfe00640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8dac0a3240 0x7f8dac0a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80ffd50 tx=0x7f8db0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.393+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8db80bc680 con 0x7f8dc8103e30 2024-09-15T22:44:20.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.615+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dc810c140 con 0x7f8dc8103e30 2024-09-15T22:44:20.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.616+0000 7f8dc6000640 1 -- 172.21.15.22:0/1838613055 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11920 (secure 0 0 0) 0x7f8db80c0980 con 0x7f8dc8103e30 2024-09-15T22:44:20.618 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:44:20.618 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"btime":"2024-09-15T22:32:31:453328+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:32:30.482731+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24548,24530,24529]},"id":1}]} 2024-09-15T22:44:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2024-09-15T22:44:20.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8dac0a3240 msgr2=0x7f8dac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8dac0a3240 0x7f8dac0a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80ffd50 tx=0x7f8db0005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:20.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 msgr2=0x7f8dc819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 0x7f8dc819a4f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8db8004770 tx=0x7f8db8003c10 comp rx=0 tx=0).stop 2024-09-15T22:44:20.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 shutdown_connections 2024-09-15T22:44:20.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dc8108f60 0x7f8dc819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f8dac0a3240 0x7f8dac0a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81047e0 0x7f8dc819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 --2- 172.21.15.22:0/1838613055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8dc8103e30 0x7f8dc819a4f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 >> 172.21.15.22:0/1838613055 conn(0x7f8dc80ff910 msgr2=0x7f8dc8100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:20.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 shutdown_connections 2024-09-15T22:44:20.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:20.619+0000 7f8dce000640 1 -- 172.21.15.22:0/1838613055 wait complete. 2024-09-15T22:44:21.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:44:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:21 smithi022 ceph-mon[30634]: pgmap v706: 97 pgs: 97 active+clean; 7.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 154 MiB/s wr, 1.49k op/s 2024-09-15T22:44:21.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:21 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1838613055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:21.837 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:21 smithi112 ceph-mon[35032]: pgmap v706: 97 pgs: 97 active+clean; 7.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 154 MiB/s wr, 1.49k op/s 2024-09-15T22:44:21.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:21 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1838613055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:21.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:21 smithi110 ceph-mon[35282]: pgmap v706: 97 pgs: 97 active+clean; 7.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 154 MiB/s wr, 1.49k op/s 2024-09-15T22:44:21.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:21 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1838613055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:22.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 -- 172.21.15.22:0/818415343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 msgr2=0x7f18d4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 --2- 172.21.15.22:0/818415343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d4110cc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009ca0 tx=0x7f18cc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 -- 172.21.15.22:0/818415343 shutdown_connections 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 --2- 172.21.15.22:0/818415343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d4110cc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 --2- 172.21.15.22:0/818415343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d41049c0 0x7f18d4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 --2- 172.21.15.22:0/818415343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d4104010 0x7f18d41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 -- 172.21.15.22:0/818415343 >> 172.21.15.22:0/818415343 conn(0x7f18d40ffa50 msgr2=0x7f18d4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 -- 172.21.15.22:0/818415343 shutdown_connections 2024-09-15T22:44:22.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.429+0000 7f18da400640 1 -- 172.21.15.22:0/818415343 wait complete. 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.430+0000 7f18da400640 1 Processor -- start 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.430+0000 7f18da400640 1 -- start start 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18da400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d4104010 0x7f18d419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18da400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d41049c0 0x7f18d419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18da400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18da400640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41141c0 con 0x7f18d4109140 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18da400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18d4114040 con 0x7f18d4104010 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18da400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18d4114340 con 0x7f18d41049c0 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18d3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d4104010 0x7f18d419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18d3e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d419ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34732/0 (socket says 172.21.15.22:34732) 2024-09-15T22:44:22.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18d3e00640 1 -- 172.21.15.22:0/3061587962 learned_addr learned my addr 172.21.15.22:0/3061587962 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.431+0000 7f18caa00640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d41049c0 0x7f18d419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3400640 1 -- 172.21.15.22:0/3061587962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d41049c0 msgr2=0x7f18d419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d41049c0 0x7f18d419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3400640 1 -- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 msgr2=0x7f18d419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3400640 1 -- 172.21.15.22:0/3061587962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d419f670 con 0x7f18d4104010 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18caa00640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d41049c0 0x7f18d419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3e00640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d3400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d4104010 0x7f18d419a6c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18c400e9f0 tx=0x7f18c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c400ccc0 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d419f960 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.432+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d41a7240 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.433+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18c4005020 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.433+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c40049e0 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.433+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b0005290 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.436+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f18c4004ca0 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.437+0000 7f18d0c00640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f18b80a32c0 0x7f18b80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.437+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f18c40cf7c0 con 0x7f18d4104010 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.437+0000 7f18caa00640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f18b80a32c0 0x7f18b80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:22.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.438+0000 7f18caa00640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f18b80a32c0 0x7f18b80a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f18d410aab0 tx=0x7f18bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:22.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.439+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18c409c530 con 0x7f18d4104010 2024-09-15T22:44:22.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.663+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18b0005580 con 0x7f18d4104010 2024-09-15T22:44:22.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.664+0000 7f18d0c00640 1 -- 172.21.15.22:0/3061587962 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11920 (secure 0 0 0) 0x7f18c409be30 con 0x7f18d4104010 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"btime":"2024-09-15T22:32:31:453328+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2103622454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2103622454},{"type":"v1","addr":"172.21.15.22:6835","nonce":2103622454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3608871420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3608871420},{"type":"v1","addr":"172.21.15.22:6837","nonce":3608871420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2894630573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2894630573},{"type":"v1","addr":"172.21.15.22:6841","nonce":2894630573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/1172139023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1172139023},{"type":"v1","addr":"172.21.15.110:6833","nonce":1172139023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4122441633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4122441633},{"type":"v1","addr":"172.21.15.112:6833","nonce":4122441633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/4194953231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4194953231},{"type":"v1","addr":"172.21.15.110:6835","nonce":4194953231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:30:24.572684+0000","modified":"2024-09-15T22:32:30.482731+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24548,"mds_1":24530,"mds_2":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/3072966464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3072966464},{"type":"v1","addr":"172.21.15.112:6835","nonce":3072966464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6837/35956348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":35956348},{"type":"v1","addr":"172.21.15.112:6837","nonce":35956348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6837/1376752055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1376752055},{"type":"v1","addr":"172.21.15.110:6837","nonce":1376752055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.112:6839/1853253510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1853253510},{"type":"v1","addr":"172.21.15.112:6839","nonce":1853253510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6839/3141077377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":3141077377},{"type":"v1","addr":"172.21.15.22:6839","nonce":3141077377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.110:6839/1046187875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":1046187875},{"type":"v1","addr":"172.21.15.110:6839","nonce":1046187875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24548,24530,24529]},"id":1}]} 2024-09-15T22:44:22.666 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f18b80a32c0 msgr2=0x7f18b80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f18b80a32c0 0x7f18b80a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f18d410aab0 tx=0x7f18bc00b410 comp rx=0 tx=0).stop 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d4104010 msgr2=0x7f18d419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:22.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d4104010 0x7f18d419a6c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18c400e9f0 tx=0x7f18c400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 shutdown_connections 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d41049c0 0x7f18d419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f18b80a32c0 0x7f18b80a5780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d4109140 0x7f18d419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 --2- 172.21.15.22:0/3061587962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18d4104010 0x7f18d419a6c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 >> 172.21.15.22:0/3061587962 conn(0x7f18d40ffa50 msgr2=0x7f18d4100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 shutdown_connections 2024-09-15T22:44:22.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:22.666+0000 7f18da400640 1 -- 172.21.15.22:0/3061587962 wait complete. 2024-09-15T22:44:23.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:44:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:23 smithi022 ceph-mon[30634]: pgmap v707: 97 pgs: 97 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 165 MiB/s wr, 1.68k op/s 2024-09-15T22:44:23.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:23 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3061587962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:23.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:23 smithi112 ceph-mon[35032]: pgmap v707: 97 pgs: 97 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 165 MiB/s wr, 1.68k op/s 2024-09-15T22:44:23.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:23 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3061587962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:23.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:23 smithi110 ceph-mon[35282]: pgmap v707: 97 pgs: 97 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 165 MiB/s wr, 1.68k op/s 2024-09-15T22:44:23.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:23 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3061587962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 -- 172.21.15.22:0/1477823062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c100620 msgr2=0x7f3e4c10ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 --2- 172.21.15.22:0/1477823062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c100620 0x7f3e4c10ea40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009c40 tx=0x7f3e4402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 -- 172.21.15.22:0/1477823062 shutdown_connections 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 --2- 172.21.15.22:0/1477823062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c100620 0x7f3e4c10ea40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 --2- 172.21.15.22:0/1477823062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 --2- 172.21.15.22:0/1477823062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c106be0 0x7f3e4c106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 -- 172.21.15.22:0/1477823062 >> 172.21.15.22:0/1477823062 conn(0x7f3e4c0fba90 msgr2=0x7f3e4c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 -- 172.21.15.22:0/1477823062 shutdown_connections 2024-09-15T22:44:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.472+0000 7f3e52000640 1 -- 172.21.15.22:0/1477823062 wait complete. 2024-09-15T22:44:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.473+0000 7f3e52000640 1 Processor -- start 2024-09-15T22:44:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.473+0000 7f3e52000640 1 -- start start 2024-09-15T22:44:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e52000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e52000640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e4c100620 0x7f3e4c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e52000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c106be0 0x7f3e4c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e52000640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c111f20 con 0x7f3e4c100620 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e52000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c111da0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e52000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c1120a0 con 0x7f3e4c106be0 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c106be0 0x7f3e4c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e43e00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e4c100620 0x7f3e4c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:45110/0 (socket says 172.21.15.22:45110) 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c106be0 0x7f3e4c19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:51178/0 (socket says 172.21.15.22:51178) 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 -- 172.21.15.22:0/1236264964 learned_addr learned my addr 172.21.15.22:0/1236264964 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 -- 172.21.15.22:0/1236264964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c106be0 msgr2=0x7f3e4c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c106be0 0x7f3e4c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 -- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e4c100620 msgr2=0x7f3e4c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e4c100620 0x7f3e4c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.474+0000 7f3e4b400640 1 -- 172.21.15.22:0/1236264964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c19f5d0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.475+0000 7f3e4b400640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c19a620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00e9f0 tx=0x7f3e3c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.475+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00cd80 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.475+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e3c010910 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.475+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c19f8c0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.475+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c018990 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.475+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c1a71a0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.476+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c1000e0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.478+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3e3c010ac0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.479+0000 7f3e48c00640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3e300a3240 0x7f3e300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.480+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f3e3c0cfff0 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.480+0000 7f3e43e00640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3e300a3240 0x7f3e300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.480+0000 7f3e43e00640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3e300a3240 0x7f3e300a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c1086f0 tx=0x7f3e34009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.481+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e3c09c680 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.669+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e4c19b980 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.671+0000 7f3e48c00640 1 -- 172.21.15.22:0/1236264964 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22773 (secure 0 0 0) 0x7f3e3c0a0980 con 0x7f3e4c0ffc60 2024-09-15T22:44:24.673 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-15T22:44:24.673 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"d3c50556-73b0-11ef-bceb-c7b262605968","created":"2024-09-15T22:22:15.226622+0000","modified":"2024-09-15T22:31:11.024043+0000","last_up_change":"2024-09-15T22:29:26.321286+0000","last_in_change":"2024-09-15T22:29:02.487462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:25:32.084179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:30:20.015948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:30:22.501877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa244aa0-6f2d-4a42-9b2a-09f860eb8225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6803","nonce":1552898806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6805","nonce":1552898806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6809","nonce":1552898806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1552898806},{"type":"v1","addr":"172.21.15.22:6807","nonce":1552898806}]},"public_addr":"172.21.15.22:6803/1552898806","cluster_addr":"172.21.15.22:6805/1552898806","heartbeat_back_addr":"172.21.15.22:6809/1552898806","heartbeat_front_addr":"172.21.15.22:6807/1552898806","state":["exists","up"]},{"osd":1,"uuid":"ce9db823-3025-4c1c-ad9f-30f700ded503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6801","nonce":2485792273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6803","nonce":2485792273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6807","nonce":2485792273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2485792273},{"type":"v1","addr":"172.21.15.110:6805","nonce":2485792273}]},"public_addr":"172.21.15.110:6801/2485792273","cluster_addr":"172.21.15.110:6803/2485792273","heartbeat_back_addr":"172.21.15.110:6807/2485792273","heartbeat_front_addr":"172.21.15.110:6805/2485792273","state":["exists","up"]},{"osd":2,"uuid":"15d10045-c544-42a2-b986-99217d81c454","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6801","nonce":1634459120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6803","nonce":1634459120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6807","nonce":1634459120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":1634459120},{"type":"v1","addr":"172.21.15.112:6805","nonce":1634459120}]},"public_addr":"172.21.15.112:6801/1634459120","cluster_addr":"172.21.15.112:6803/1634459120","heartbeat_back_addr":"172.21.15.112:6807/1634459120","heartbeat_front_addr":"172.21.15.112:6805/1634459120","state":["exists","up"]},{"osd":3,"uuid":"22c855e6-5548-457e-8a07-3f65c3c9189c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6811","nonce":2418580016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6813","nonce":2418580016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6817","nonce":2418580016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2418580016},{"type":"v1","addr":"172.21.15.22:6815","nonce":2418580016}]},"public_addr":"172.21.15.22:6811/2418580016","cluster_addr":"172.21.15.22:6813/2418580016","heartbeat_back_addr":"172.21.15.22:6817/2418580016","heartbeat_front_addr":"172.21.15.22:6815/2418580016","state":["exists","up"]},{"osd":4,"uuid":"2b2c8bcb-5000-4dc8-aa69-67617f69c5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6809","nonce":2813378643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6811","nonce":2813378643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6815","nonce":2813378643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2813378643},{"type":"v1","addr":"172.21.15.110:6813","nonce":2813378643}]},"public_addr":"172.21.15.110:6809/2813378643","cluster_addr":"172.21.15.110:6811/2813378643","heartbeat_back_addr":"172.21.15.110:6815/2813378643","heartbeat_front_addr":"172.21.15.110:6813/2813378643","state":["exists","up"]},{"osd":5,"uuid":"5c23e30e-e3fb-472d-9fb8-8ca3f9742c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6809","nonce":1940652320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6811","nonce":1940652320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6815","nonce":1940652320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1940652320},{"type":"v1","addr":"172.21.15.112:6813","nonce":1940652320}]},"public_addr":"172.21.15.112:6809/1940652320","cluster_addr":"172.21.15.112:6811/1940652320","heartbeat_back_addr":"172.21.15.112:6815/1940652320","heartbeat_front_addr":"172.21.15.112:6813/1940652320","state":["exists","up"]},{"osd":6,"uuid":"55a5401c-0205-407d-bf6b-bd98309df058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6819","nonce":4293876036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6821","nonce":4293876036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6825","nonce":4293876036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":4293876036},{"type":"v1","addr":"172.21.15.22:6823","nonce":4293876036}]},"public_addr":"172.21.15.22:6819/4293876036","cluster_addr":"172.21.15.22:6821/4293876036","heartbeat_back_addr":"172.21.15.22:6825/4293876036","heartbeat_front_addr":"172.21.15.22:6823/4293876036","state":["exists","up"]},{"osd":7,"uuid":"b1c41c5d-3218-4783-9c59-e49c4a97c43a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6817","nonce":152931890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6819","nonce":152931890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6823","nonce":152931890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":152931890},{"type":"v1","addr":"172.21.15.110:6821","nonce":152931890}]},"public_addr":"172.21.15.110:6817/152931890","cluster_addr":"172.21.15.110:6819/152931890","heartbeat_back_addr":"172.21.15.110:6823/152931890","heartbeat_front_addr":"172.21.15.110:6821/152931890","state":["exists","up"]},{"osd":8,"uuid":"db438831-af66-49ce-933e-327537a59442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6817","nonce":126632637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6819","nonce":126632637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6823","nonce":126632637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":126632637},{"type":"v1","addr":"172.21.15.112:6821","nonce":126632637}]},"public_addr":"172.21.15.112:6817/126632637","cluster_addr":"172.21.15.112:6819/126632637","heartbeat_back_addr":"172.21.15.112:6823/126632637","heartbeat_front_addr":"172.21.15.112:6821/126632637","state":["exists","up"]},{"osd":9,"uuid":"db7ade71-4c38-48a7-9ea0-520da038202c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6827","nonce":2222374873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6829","nonce":2222374873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6833","nonce":2222374873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":2222374873},{"type":"v1","addr":"172.21.15.22:6831","nonce":2222374873}]},"public_addr":"172.21.15.22:6827/2222374873","cluster_addr":"172.21.15.22:6829/2222374873","heartbeat_back_addr":"172.21.15.22:6833/2222374873","heartbeat_front_addr":"172.21.15.22:6831/2222374873","state":["exists","up"]},{"osd":10,"uuid":"e09a7b8c-22d5-48fe-9d5e-7b0d2919bc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6825","nonce":1916851446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6827","nonce":1916851446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6831","nonce":1916851446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1916851446},{"type":"v1","addr":"172.21.15.110:6829","nonce":1916851446}]},"public_addr":"172.21.15.110:6825/1916851446","cluster_addr":"172.21.15.110:6827/1916851446","heartbeat_back_addr":"172.21.15.110:6831/1916851446","heartbeat_front_addr":"172.21.15.110:6829/1916851446","state":["exists","up"]},{"osd":11,"uuid":"82f9f6ab-86fe-40e5-879a-0c6230700163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6825","nonce":362844051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6827","nonce":362844051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6831","nonce":362844051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":362844051},{"type":"v1","addr":"172.21.15.112:6829","nonce":362844051}]},"public_addr":"172.21.15.112:6825/362844051","cluster_addr":"172.21.15.112:6827/362844051","heartbeat_back_addr":"172.21.15.112:6831/362844051","heartbeat_front_addr":"172.21.15.112:6829/362844051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:24:39.610639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:05.015930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:28.581154+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:25:58.720321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:23.812913+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:26:48.221841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:16.732533+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:27:41.549106+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:06.567324+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:35.593082+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:28:59.710162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:29:23.984458+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6800/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3624200134":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/1725043068":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/3305817552":"2024-09-16T22:23:09.459721+0000","172.21.15.22:6801/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:6800/2616449464":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3382105738":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/3049867263":"2024-09-16T22:23:09.459721+0000","172.21.15.22:0/3523117683":"2024-09-16T22:22:40.678920+0000","172.21.15.22:0/1271758657":"2024-09-16T22:22:40.678920+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3e300a3240 msgr2=0x7f3e300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3e300a3240 0x7f3e300a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c1086f0 tx=0x7f3e34009260 comp rx=0 tx=0).stop 2024-09-15T22:44:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 msgr2=0x7f3e4c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c19a620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00e9f0 tx=0x7f3e3c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 shutdown_connections 2024-09-15T22:44:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e4c106be0 0x7f3e4c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f3e300a3240 0x7f3e300a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e4c100620 0x7f3e4c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 --2- 172.21.15.22:0/1236264964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e4c0ffc60 0x7f3e4c19a620 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 >> 172.21.15.22:0/1236264964 conn(0x7f3e4c0fba90 msgr2=0x7f3e4c10d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 shutdown_connections 2024-09-15T22:44:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:24.673+0000 7f3e52000640 1 -- 172.21.15.22:0/1236264964 wait complete. 2024-09-15T22:44:25.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T22:44:25.773 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:25 smithi110 ceph-mon[35282]: pgmap v708: 97 pgs: 97 active+clean; 83 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 154 MiB/s wr, 1.65k op/s 2024-09-15T22:44:25.774 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:25 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/1236264964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:25 smithi022 ceph-mon[30634]: pgmap v708: 97 pgs: 97 active+clean; 83 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 154 MiB/s wr, 1.65k op/s 2024-09-15T22:44:25.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:25 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/1236264964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:25 smithi112 ceph-mon[35032]: pgmap v708: 97 pgs: 97 active+clean; 83 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 154 MiB/s wr, 1.65k op/s 2024-09-15T22:44:25.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:25 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/1236264964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 -- 172.21.15.22:0/265954785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81079c0 msgr2=0x7f01f8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 --2- 172.21.15.22:0/265954785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81079c0 0x7f01f8107da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009930 tx=0x7f01ec02a440 comp rx=0 tx=0).stop 2024-09-15T22:44:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 -- 172.21.15.22:0/265954785 shutdown_connections 2024-09-15T22:44:26.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 --2- 172.21.15.22:0/265954785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f8102360 0x7f01f810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 --2- 172.21.15.22:0/265954785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f81019c0 0x7f01f8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 --2- 172.21.15.22:0/265954785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81079c0 0x7f01f8107da0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 -- 172.21.15.22:0/265954785 >> 172.21.15.22:0/265954785 conn(0x7f01f80fd740 msgr2=0x7f01f80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 -- 172.21.15.22:0/265954785 shutdown_connections 2024-09-15T22:44:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.355+0000 7f01fea00640 1 -- 172.21.15.22:0/265954785 wait complete. 2024-09-15T22:44:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.356+0000 7f01fea00640 1 Processor -- start 2024-09-15T22:44:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.356+0000 7f01fea00640 1 -- start start 2024-09-15T22:44:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fea00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 0x7f01f819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f8102360 0x7f01f819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f81079c0 0x7f01f819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fea00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8111e10 con 0x7f01f81019c0 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8111c90 con 0x7f01f81079c0 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8111f90 con 0x7f01f8102360 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fd600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 0x7f01f819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fd600640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 0x7f01f819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34766/0 (socket says 172.21.15.22:34766) 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fd600640 1 -- 172.21.15.22:0/3216984507 learned_addr learned my addr 172.21.15.22:0/3216984507 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fcc00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f8102360 0x7f01f819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.357+0000 7f01fe000640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f81079c0 0x7f01f819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fd600640 1 -- 172.21.15.22:0/3216984507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f8102360 msgr2=0x7f01f819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fd600640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f8102360 0x7f01f819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fd600640 1 -- 172.21.15.22:0/3216984507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f81079c0 msgr2=0x7f01f819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fd600640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f81079c0 0x7f01f819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fd600640 1 -- 172.21.15.22:0/3216984507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f819f450 con 0x7f01f81019c0 2024-09-15T22:44:26.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fd600640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 0x7f01f819a4a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01ec02a960 tx=0x7f01ec003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec03f070 con 0x7f01f81019c0 2024-09-15T22:44:26.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec031c90 con 0x7f01f81019c0 2024-09-15T22:44:26.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec035030 con 0x7f01f81019c0 2024-09-15T22:44:26.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f819f6e0 con 0x7f01f81019c0 2024-09-15T22:44:26.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.358+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f819fb70 con 0x7f01f81019c0 2024-09-15T22:44:26.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.360+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f8101e20 con 0x7f01f81019c0 2024-09-15T22:44:26.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.361+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f01ec042070 con 0x7f01f81019c0 2024-09-15T22:44:26.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.363+0000 7f01f6000640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01e00a32c0 0x7f01e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:26.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.363+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f01ec0efb40 con 0x7f01f81019c0 2024-09-15T22:44:26.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.363+0000 7f01fcc00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01e00a32c0 0x7f01e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:26.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.364+0000 7f01fcc00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01e00a32c0 0x7f01e00a5780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f01f810ec90 tx=0x7f01e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:26.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.367+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01ec0bc1d0 con 0x7f01f81019c0 2024-09-15T22:44:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.590+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f01f81a7260 con 0x7f01f81019c0 2024-09-15T22:44:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.592+0000 7f01f6000640 1 -- 172.21.15.22:0/3216984507 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f01ec0c04d0 con 0x7f01f81019c0 2024-09-15T22:44:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.596+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01e00a32c0 msgr2=0x7f01e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.596+0000 7f01fea00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01e00a32c0 0x7f01e00a5780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f01f810ec90 tx=0x7f01e4005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.596+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 msgr2=0x7f01f819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.596+0000 7f01fea00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 0x7f01f819a4a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01ec02a960 tx=0x7f01ec003b20 comp rx=0 tx=0).stop 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 shutdown_connections 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01f8102360 0x7f01f819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f01e00a32c0 0x7f01e00a5780 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f81079c0 0x7f01f819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 --2- 172.21.15.22:0/3216984507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f81019c0 0x7f01f819a4a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 >> 172.21.15.22:0/3216984507 conn(0x7f01f80fd740 msgr2=0x7f01f80fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 shutdown_connections 2024-09-15T22:44:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:26.597+0000 7f01fea00640 1 -- 172.21.15.22:0/3216984507 wait complete. 2024-09-15T22:44:26.955 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: ignoring --setuser ceph since I am not root 2024-09-15T22:44:26.955 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: ignoring --setgroup ceph since I am not root 2024-09-15T22:44:26.955 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-mds[64901]: -- 172.21.15.110:0/561675035 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556dbe4b3860 con 0x556dbe491400 2024-09-15T22:44:26.955 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: starting mds.b at 2024-09-15T22:44:26.956 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h[64591]: ignoring --setuser ceph since I am not root 2024-09-15T22:44:26.956 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h[64591]: ignoring --setgroup ceph since I am not root 2024-09-15T22:44:26.956 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-mds[64595]: -- 172.21.15.110:0/680203476 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ede3dff860 con 0x55ede3ddd000 2024-09-15T22:44:26.956 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:44:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h[64591]: starting mds.h at 2024-09-15T22:44:26.981 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a[30630]: 2024-09-15T22:44:26.591+0000 7f233e200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:44:26.981 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:44:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g[71234]: ignoring --setuser ceph since I am not root 2024-09-15T22:44:26.981 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:44:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g[71234]: ignoring --setgroup ceph since I am not root 2024-09-15T22:44:26.981 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:44:26 smithi022 ceph-mds[71238]: -- 172.21.15.22:0/106746116 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623508d7860 con 0x5623508b4800 2024-09-15T22:44:26.981 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:44:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g[71234]: starting mds.g at 2024-09-15T22:44:27.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c[65982]: ignoring --setuser ceph since I am not root 2024-09-15T22:44:27.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c[65982]: ignoring --setgroup ceph since I am not root 2024-09-15T22:44:27.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-mds[65986]: -- 172.21.15.112:0/4237660887 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563664b7860 con 0x556366495000 2024-09-15T22:44:27.102 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c[65982]: starting mds.c at 2024-09-15T22:44:27.102 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f[65672]: ignoring --setuser ceph since I am not root 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f[65672]: ignoring --setgroup ceph since I am not root 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-mds[65676]: -- 172.21.15.112:0/327401684 <== mon.2 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a9fa71860 con 0x556a9fa4f000 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f[65672]: starting mds.f at 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i[66280]: ignoring --setuser ceph since I am not root 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i[66280]: ignoring --setgroup ceph since I am not root 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-mds[66284]: -- 172.21.15.112:0/3947920583 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556759999860 con 0x556759976800 2024-09-15T22:44:27.103 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:44:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i[66280]: starting mds.i at 2024-09-15T22:44:27.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:44:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: pgmap v709: 97 pgs: 97 active+clean; 3.0 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 130 MiB/s wr, 1.43k op/s 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3216984507' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3216984507' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:44:27.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:27 smithi022 ceph-mon[30634]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: pgmap v709: 97 pgs: 97 active+clean; 3.0 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 130 MiB/s wr, 1.43k op/s 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3216984507' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3216984507' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:44:27.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:27 smithi112 ceph-mon[35032]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-15T22:44:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: pgmap v709: 97 pgs: 97 active+clean; 3.0 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 130 MiB/s wr, 1.43k op/s 2024-09-15T22:44:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3216984507' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:44:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:44:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:44:27.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3216984507' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:44:27.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:44:27.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:27 smithi110 ceph-mon[35282]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-15T22:44:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 -- 172.21.15.22:0/2187059481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c077040 msgr2=0x7f684c112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 --2- 172.21.15.22:0/2187059481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c077040 0x7f684c112330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f683c009900 tx=0x7f683c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 -- 172.21.15.22:0/2187059481 shutdown_connections 2024-09-15T22:44:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 --2- 172.21.15.22:0/2187059481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c112870 0x7f684c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 --2- 172.21.15.22:0/2187059481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c077040 0x7f684c112330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 --2- 172.21.15.22:0/2187059481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c076720 0x7f684c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 -- 172.21.15.22:0/2187059481 >> 172.21.15.22:0/2187059481 conn(0x7f684c0ff8d0 msgr2=0x7f684c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 -- 172.21.15.22:0/2187059481 shutdown_connections 2024-09-15T22:44:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.340+0000 7f6853200640 1 -- 172.21.15.22:0/2187059481 wait complete. 2024-09-15T22:44:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 Processor -- start 2024-09-15T22:44:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 -- start start 2024-09-15T22:44:28.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c076720 0x7f684c1a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 0x7f684c1a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c112870 0x7f684c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f684c1183e0 con 0x7f684c076720 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f684c118260 con 0x7f684c112870 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.341+0000 7f6853200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f684c118560 con 0x7f684c077040 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 0x7f684c1a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 0x7f684c1a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.22:51220/0 (socket says 172.21.15.22:51220) 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 -- 172.21.15.22:0/3149558192 learned_addr learned my addr 172.21.15.22:0/3149558192 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851e00640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c076720 0x7f684c1a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6852800640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c112870 0x7f684c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 -- 172.21.15.22:0/3149558192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c112870 msgr2=0x7f684c19e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:28.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c112870 0x7f684c19e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 -- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c076720 msgr2=0x7f684c1a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c076720 0x7f684c1a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 -- 172.21.15.22:0/3149558192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c19ef80 con 0x7f684c077040 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6852800640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c112870 0x7f684c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.342+0000 7f6851400640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 0x7f684c1a4b80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f683c006010 tx=0x7f683c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.343+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c03f030 con 0x7f684c077040 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.343+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f683c004440 con 0x7f684c077040 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.343+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684c19f210 con 0x7f684c077040 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.343+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c035070 con 0x7f684c077040 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.343+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684c1ab3f0 con 0x7f684c077040 2024-09-15T22:44:28.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.344+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f684c077e60 con 0x7f684c077040 2024-09-15T22:44:28.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.346+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f683c042030 con 0x7f684c077040 2024-09-15T22:44:28.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.347+0000 7f6846a00640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68340a3240 0x7f68340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:28.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.347+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8498+0+0 (secure 0 0 0) 0x7f683c0efad0 con 0x7f684c077040 2024-09-15T22:44:28.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.347+0000 7f6851e00640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68340a3240 0x7f68340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:28.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.348+0000 7f6851e00640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68340a3240 0x7f68340a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6840009bd0 tx=0x7f6840005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:28.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.351+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f683c0bc680 con 0x7f684c077040 2024-09-15T22:44:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.574+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f684c02d7c0 con 0x7f684c077040 2024-09-15T22:44:28.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.609+0000 7f6846a00640 1 -- 172.21.15.22:0/3149558192 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f683c0bbf80 con 0x7f684c077040 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68340a3240 msgr2=0x7f68340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68340a3240 0x7f68340a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6840009bd0 tx=0x7f6840005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 msgr2=0x7f684c1a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 0x7f684c1a4b80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f683c006010 tx=0x7f683c004040 comp rx=0 tx=0).stop 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 shutdown_connections 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f684c077040 0x7f684c1a4b80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f68340a3240 0x7f68340a5700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f684c112870 0x7f684c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 --2- 172.21.15.22:0/3149558192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684c076720 0x7f684c1a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:28.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 >> 172.21.15.22:0/3149558192 conn(0x7f684c0ff8d0 msgr2=0x7f684c101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:28.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 shutdown_connections 2024-09-15T22:44:28.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:28.612+0000 7f6853200640 1 -- 172.21.15.22:0/3149558192 wait complete. 2024-09-15T22:44:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6837/4049201179,v1:172.21.15.110:6839/4049201179] up:boot 2024-09-15T22:44:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.110:6836/2746354399,v1:172.21.15.110:6838/2746354399] up:boot 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6834/2304842326,v1:172.21.15.112:6835/2304842326] up:boot 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6837/890788709,v1:172.21.15.112:6839/890788709] up:boot 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.112:6836/4155209083,v1:172.21.15.112:6838/4155209083] up:boot 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: mds.? [v2:172.21.15.22:6838/1851211975,v1:172.21.15.22:6839/1851211975] up:boot 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3149558192' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:44:28.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:28 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:44:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6837/4049201179,v1:172.21.15.110:6839/4049201179] up:boot 2024-09-15T22:44:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.110:6836/2746354399,v1:172.21.15.110:6838/2746354399] up:boot 2024-09-15T22:44:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6834/2304842326,v1:172.21.15.112:6835/2304842326] up:boot 2024-09-15T22:44:28.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6837/890788709,v1:172.21.15.112:6839/890788709] up:boot 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.112:6836/4155209083,v1:172.21.15.112:6838/4155209083] up:boot 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: mds.? [v2:172.21.15.22:6838/1851211975,v1:172.21.15.22:6839/1851211975] up:boot 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:44:28.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:44:28.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:44:28.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3149558192' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:44:28.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:28 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6837/4049201179,v1:172.21.15.110:6839/4049201179] up:boot 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.110:6836/2746354399,v1:172.21.15.110:6838/2746354399] up:boot 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6834/2304842326,v1:172.21.15.112:6835/2304842326] up:boot 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6837/890788709,v1:172.21.15.112:6839/890788709] up:boot 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.112:6836/4155209083,v1:172.21.15.112:6838/4155209083] up:boot 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: mds.? [v2:172.21.15.22:6838/1851211975,v1:172.21.15.22:6839/1851211975] up:boot 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:44:29.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:44:29.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:44:29.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:44:29.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:44:29.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='mgr.14150 172.21.15.22:0/3369753962' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:44:29.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3149558192' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:44:29.103 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:28 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:44:29.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:44:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:29 smithi022 ceph-mon[30634]: pgmap v711: 97 pgs: 97 active+clean; 3.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 43 MiB/s wr, 656 op/s 2024-09-15T22:44:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:29 smithi022 ceph-mon[30634]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:44:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:29 smithi022 ceph-mon[30634]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:44:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:29 smithi022 ceph-mon[30634]: Cluster is now healthy 2024-09-15T22:44:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:29 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:44:29.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:29 smithi022 ceph-mon[30634]: fsmap 12 up:standby 2024-09-15T22:44:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:29 smithi110 ceph-mon[35282]: pgmap v711: 97 pgs: 97 active+clean; 3.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 43 MiB/s wr, 656 op/s 2024-09-15T22:44:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:29 smithi110 ceph-mon[35282]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:44:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:29 smithi110 ceph-mon[35282]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:44:29.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:29 smithi110 ceph-mon[35282]: Cluster is now healthy 2024-09-15T22:44:29.956 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:29 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:44:29.957 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:29 smithi110 ceph-mon[35282]: fsmap 12 up:standby 2024-09-15T22:44:30.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:29 smithi112 ceph-mon[35032]: pgmap v711: 97 pgs: 97 active+clean; 3.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 43 MiB/s wr, 656 op/s 2024-09-15T22:44:30.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:29 smithi112 ceph-mon[35032]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:44:30.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:29 smithi112 ceph-mon[35032]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:44:30.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:29 smithi112 ceph-mon[35032]: Cluster is now healthy 2024-09-15T22:44:30.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:29 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:44:30.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:29 smithi112 ceph-mon[35032]: fsmap 12 up:standby 2024-09-15T22:44:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 -- 172.21.15.22:0/2320137447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 msgr2=0x7fe9f81124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 --2- 172.21.15.22:0/2320137447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 0x7fe9f81124f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009900 tx=0x7fe9e002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 -- 172.21.15.22:0/2320137447 shutdown_connections 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 --2- 172.21.15.22:0/2320137447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 0x7fe9f81124f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 --2- 172.21.15.22:0/2320137447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f8112a30 0x7fe9f8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 --2- 172.21.15.22:0/2320137447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 -- 172.21.15.22:0/2320137447 >> 172.21.15.22:0/2320137447 conn(0x7fe9f80ffa90 msgr2=0x7fe9f8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 -- 172.21.15.22:0/2320137447 shutdown_connections 2024-09-15T22:44:30.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.342+0000 7fe9ff800640 1 -- 172.21.15.22:0/2320137447 wait complete. 2024-09-15T22:44:30.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.343+0000 7fe9ff800640 1 Processor -- start 2024-09-15T22:44:30.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.343+0000 7fe9ff800640 1 -- start start 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9ff800640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9ff800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 0x7fe9f819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9ff800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f8112a30 0x7fe9f81a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9ff800640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8118600 con 0x7fe9f8076720 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9ff800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8118480 con 0x7fe9f8112a30 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9ff800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8118780 con 0x7fe9f8077040 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9fce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9fce00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f819eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55910/0 (socket says 172.21.15.22:55910) 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9fce00640 1 -- 172.21.15.22:0/3433230039 learned_addr learned my addr 172.21.15.22:0/3433230039 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9fd800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f8112a30 0x7fe9f81a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.344+0000 7fe9efe00640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 0x7fe9f819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9fce00640 1 -- 172.21.15.22:0/3433230039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 msgr2=0x7fe9f819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9fce00640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 0x7fe9f819f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9fce00640 1 -- 172.21.15.22:0/3433230039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f8112a30 msgr2=0x7fe9f81a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9fce00640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f8112a30 0x7fe9f81a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9fce00640 1 -- 172.21.15.22:0/3433230039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f81a3bc0 con 0x7fe9f8076720 2024-09-15T22:44:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9fce00640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f819eb90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800e9f0 tx=0x7fe9e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800cd80 con 0x7fe9f8076720 2024-09-15T22:44:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f81a3eb0 con 0x7fe9f8076720 2024-09-15T22:44:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9e8010910 con 0x7fe9f8076720 2024-09-15T22:44:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80188f0 con 0x7fe9f8076720 2024-09-15T22:44:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.345+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f81ab740 con 0x7fe9f8076720 2024-09-15T22:44:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.346+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f8076b00 con 0x7fe9f8076720 2024-09-15T22:44:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.348+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe9e8010ac0 con 0x7fe9f8076720 2024-09-15T22:44:30.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.350+0000 7fe9f6000640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9dc0a3240 0x7fe9dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.350+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8498+0+0 (secure 0 0 0) 0x7fe9e80cfe10 con 0x7fe9f8076720 2024-09-15T22:44:30.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.350+0000 7fe9efe00640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9dc0a3240 0x7fe9dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.351+0000 7fe9efe00640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9dc0a3240 0x7fe9dc0a5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.354+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9e80d3030 con 0x7fe9f8076720 2024-09-15T22:44:30.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.539+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe9f810dbc0 con 0x7fe9f8076720 2024-09-15T22:44:30.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.611+0000 7fe9f6000640 1 -- 172.21.15.22:0/3433230039 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7fe9e809c370 con 0x7fe9f8076720 2024-09-15T22:44:30.613 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:44:30.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9dc0a3240 msgr2=0x7fe9dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9dc0a3240 0x7fe9dc0a5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e0005b50 comp rx=0 tx=0).stop 2024-09-15T22:44:30.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 msgr2=0x7fe9f819eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f819eb90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800e9f0 tx=0x7fe9e800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 shutdown_connections 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9f8077040 0x7fe9f819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7fe9dc0a3240 0x7fe9dc0a5700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f8112a30 0x7fe9f81a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 --2- 172.21.15.22:0/3433230039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9f8076720 0x7fe9f819eb90 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800e9f0 tx=0x7fe9e800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.614+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 >> 172.21.15.22:0/3433230039 conn(0x7fe9f80ffa90 msgr2=0x7fe9f8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.615+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 shutdown_connections 2024-09-15T22:44:30.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:30.615+0000 7fe9ff800640 1 -- 172.21.15.22:0/3433230039 wait complete. 2024-09-15T22:44:30.939 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:30 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3433230039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:30.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:30 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3433230039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:31.101 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:30 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3433230039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:31.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d3c50556-73b0-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:44:31.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:31 smithi022 ceph-mon[30634]: pgmap v712: 97 pgs: 97 active+clean; 3.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 14 MiB/s wr, 329 op/s 2024-09-15T22:44:31.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:31 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3433230039' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:44:31.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:31 smithi022 ceph-mon[30634]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:44:31.867 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:31.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:31 smithi110 ceph-mon[35282]: pgmap v712: 97 pgs: 97 active+clean; 3.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 14 MiB/s wr, 329 op/s 2024-09-15T22:44:31.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:31 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3433230039' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:44:31.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:31 smithi110 ceph-mon[35282]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:44:32.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:31 smithi112 ceph-mon[35032]: pgmap v712: 97 pgs: 97 active+clean; 3.0 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 14 MiB/s wr, 329 op/s 2024-09-15T22:44:32.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:31 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3433230039' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:44:32.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:31 smithi112 ceph-mon[35032]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:44:32.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 -- 172.21.15.22:0/4110412951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c01049a0 msgr2=0x7f10c01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 --2- 172.21.15.22:0/4110412951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c01049a0 0x7f10c01089f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009900 tx=0x7f10a802a410 comp rx=0 tx=0).stop 2024-09-15T22:44:32.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 -- 172.21.15.22:0/4110412951 shutdown_connections 2024-09-15T22:44:32.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 --2- 172.21.15.22:0/4110412951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c0109120 0x7f10c0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 --2- 172.21.15.22:0/4110412951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c01049a0 0x7f10c01089f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 --2- 172.21.15.22:0/4110412951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0103ff0 0x7f10c01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 -- 172.21.15.22:0/4110412951 >> 172.21.15.22:0/4110412951 conn(0x7f10c00ffa90 msgr2=0x7f10c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:32.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 -- 172.21.15.22:0/4110412951 shutdown_connections 2024-09-15T22:44:32.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.416+0000 7f10c6c00640 1 -- 172.21.15.22:0/4110412951 wait complete. 2024-09-15T22:44:32.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.417+0000 7f10c6c00640 1 Processor -- start 2024-09-15T22:44:32.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 -- start start 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c0103ff0 0x7f10c019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 0x7f10c019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0109120 0x7f10c019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10c0114120 con 0x7f10c0103ff0 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f10c0113fa0 con 0x7f10c01049a0 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c6c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10c01142a0 con 0x7f10c0109120 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10bfe00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c0103ff0 0x7f10c019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10b7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 0x7f10c019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10c4c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0109120 0x7f10c019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10b7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 0x7f10c019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.22:46096/0 (socket says 172.21.15.22:46096) 2024-09-15T22:44:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.418+0000 7f10b7400640 1 -- 172.21.15.22:0/3996279160 learned_addr learned my addr 172.21.15.22:0/3996279160 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-15T22:44:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10b7400640 1 -- 172.21.15.22:0/3996279160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0109120 msgr2=0x7f10c019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10b7400640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0109120 0x7f10c019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10b7400640 1 -- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c0103ff0 msgr2=0x7f10c019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10b7400640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c0103ff0 0x7f10c019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10b7400640 1 -- 172.21.15.22:0/3996279160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c019f5d0 con 0x7f10c01049a0 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10c4c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0109120 0x7f10c019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10bfe00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c0103ff0 0x7f10c019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10b7400640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 0x7f10c019ab60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a803f030 con 0x7f10c01049a0 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.419+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c019f860 con 0x7f10c01049a0 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.420+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c01a71a0 con 0x7f10c01049a0 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.420+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8003ce0 con 0x7f10c01049a0 2024-09-15T22:44:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.420+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8049060 con 0x7f10c01049a0 2024-09-15T22:44:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.421+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c005290 con 0x7f10c01049a0 2024-09-15T22:44:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.423+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f10a8042030 con 0x7f10c01049a0 2024-09-15T22:44:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.424+0000 7f10bd600640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10a40a3240 0x7f10a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.424+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7944+0+0 (secure 0 0 0) 0x7f10a80efd70 con 0x7f10c01049a0 2024-09-15T22:44:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.424+0000 7f10bfe00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10a40a3240 0x7f10a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.425+0000 7f10bfe00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10a40a3240 0x7f10a40a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009fc0 tx=0x7f10b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.426+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10a803b460 con 0x7f10c01049a0 2024-09-15T22:44:32.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:32.613+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f109c005580 con 0x7f10c01049a0 2024-09-15T22:44:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.631+0000 7f10bd600640 1 -- 172.21.15.22:0/3996279160 <== mon.2 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f10a80bc510 con 0x7f10c01049a0 2024-09-15T22:44:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-09-15T22:44:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.635+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10a40a3240 msgr2=0x7f10a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.635+0000 7f10c6c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10a40a3240 0x7f10a40a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009fc0 tx=0x7f10b0005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.635+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 msgr2=0x7f10c019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.635+0000 7f10c6c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 0x7f10c019ab60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.636+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 shutdown_connections 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.636+0000 7f10c6c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0109120 0x7f10c019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.636+0000 7f10c6c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:6800/191438634,v1:172.21.15.22:6801/191438634] conn(0x7f10a40a3240 0x7f10a40a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.636+0000 7f10c6c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10c01049a0 0x7f10c019ab60 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.636+0000 7f10c6c00640 1 --2- 172.21.15.22:0/3996279160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10c0103ff0 0x7f10c019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.636+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 >> 172.21.15.22:0/3996279160 conn(0x7f10c00ffa90 msgr2=0x7f10c0100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.637+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 shutdown_connections 2024-09-15T22:44:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-15T22:44:33.637+0000 7f10c6c00640 1 -- 172.21.15.22:0/3996279160 wait complete. 2024-09-15T22:44:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:33 smithi110 ceph-mon[35282]: pgmap v714: 65 pgs: 65 active+clean; 577 KiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:44:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:33 smithi110 ceph-mon[35282]: from='client.? 172.21.15.22:0/3996279160' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:33.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:33 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:34.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:33 smithi022 ceph-mon[30634]: pgmap v714: 65 pgs: 65 active+clean; 577 KiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:44:34.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:33 smithi022 ceph-mon[30634]: from='client.? 172.21.15.22:0/3996279160' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:34.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:33 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:34.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:33 smithi112 ceph-mon[35032]: pgmap v714: 65 pgs: 65 active+clean; 577 KiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:44:34.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:33 smithi112 ceph-mon[35032]: from='client.? 172.21.15.22:0/3996279160' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:34.102 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:33 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:44:34.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:44:34.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:44:34.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:44:34.601 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T22:44:34.602 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:44:34.637 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:44:34.654 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:44:34.670 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T22:44:34.670 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T22:44:34.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:44:34.725 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:34 smithi022 ceph-mon[30634]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:44:34.725 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:34 smithi022 ceph-mon[30634]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:44:34.851 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:34 smithi112 ceph-mon[35032]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:44:34.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:34 smithi112 ceph-mon[35032]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:44:34.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:34 smithi110 ceph-mon[35282]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:44:34.955 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:34 smithi110 ceph-mon[35282]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:44:35.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:34 smithi022 systemd[1]: Stopping Ceph mon.a for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:35.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a[30630]: 2024-09-15T22:44:35.127+0000 7f2345000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:44:35.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a[30630]: 2024-09-15T22:44:35.127+0000 7f2345000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T22:44:35.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:35 smithi022 podman[88681]: 2024-09-15 22:44:35.190547592 +0000 UTC m=+0.211131879 container died 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T22:44:35.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:35 smithi022 podman[88681]: 2024-09-15 22:44:35.608068136 +0000 UTC m=+0.628652415 container cleanup 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T22:44:35.783 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:35 smithi022 bash[88681]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:44:36.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 15 22:44:35 smithi022 podman[88694]: 2024-09-15 22:44:35.851350354 +0000 UTC m=+0.650998584 container remove 71f0c89bb81bbdbe0f7c9aade0868a1a9f300cbfede028575968e911548fe1f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-15T22:44:36.172 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T22:44:36.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:36.250 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T22:44:36.250 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T22:44:36.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.b 2024-09-15T22:44:36.593 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:36 smithi110 systemd[1]: Stopping Ceph mon.b for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:36.952 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b[35277]: 2024-09-15T22:44:36.590+0000 7f2e4060d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:44:36.952 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b[35277]: 2024-09-15T22:44:36.590+0000 7f2e4060d640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:44:36.952 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:36 smithi110 podman[69336]: 2024-09-15 22:44:36.65258951 +0000 UTC m=+0.202215711 container died c31de8c6da4b884b05291181f6d0de889cd6ab86eed6f0492c637ef6b1d47e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:44:37.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:37 smithi110 podman[69336]: 2024-09-15 22:44:37.05803051 +0000 UTC m=+0.607656702 container cleanup c31de8c6da4b884b05291181f6d0de889cd6ab86eed6f0492c637ef6b1d47e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:44:37.205 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 15 22:44:37 smithi110 bash[69336]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-b 2024-09-15T22:44:37.481 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T22:44:37.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:37.525 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T22:44:37.525 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T22:44:37.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.c 2024-09-15T22:44:37.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:37 smithi112 systemd[1]: Stopping Ceph mon.c for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:38.149 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-c[35028]: 2024-09-15T22:44:37.882+0000 7fa72b003640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:44:38.149 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-c[35028]: 2024-09-15T22:44:37.882+0000 7fa72b003640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:44:38.459 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:38 smithi112 podman[70649]: 2024-09-15 22:44:38.148231184 +0000 UTC m=+0.414190894 container died 28db664a0ea5d5ab161888f7c7f6c645f94d6fb3929bfe2c85e63f91d2c9c4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:44:38.784 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:38 smithi112 podman[70649]: 2024-09-15 22:44:38.556878062 +0000 UTC m=+0.822837770 container cleanup 28db664a0ea5d5ab161888f7c7f6c645f94d6fb3929bfe2c85e63f91d2c9c4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-15T22:44:38.784 INFO:journalctl@ceph.mon.c.smithi112.stdout:Sep 15 22:44:38 smithi112 bash[70649]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mon-c 2024-09-15T22:44:38.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T22:44:38.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:38.994 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T22:44:38.995 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T22:44:38.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:44:39.434 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:44:39 smithi022 systemd[1]: Stopping Ceph mgr.x for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:39.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:44:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:44:39.431+0000 7f5009e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:44:39.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:44:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x[30862]: 2024-09-15T22:44:39.431+0000 7f5009e00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-15T22:44:39.782 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:44:39 smithi022 podman[88801]: 2024-09-15 22:44:39.516329477 +0000 UTC m=+0.225271539 container died ec0bebdab7b32ba0ca0faa03c49897d19b2ba13d10f100081935a27b1b06128c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-15T22:44:40.282 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:44:40 smithi022 podman[88801]: 2024-09-15 22:44:40.022043885 +0000 UTC m=+0.730985946 container cleanup ec0bebdab7b32ba0ca0faa03c49897d19b2ba13d10f100081935a27b1b06128c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-15T22:44:40.282 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 15 22:44:40 smithi022 bash[88801]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-x 2024-09-15T22:44:40.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T22:44:40.598 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:40.599 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T22:44:40.599 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T22:44:40.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.y 2024-09-15T22:44:40.917 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:44:40 smithi110 systemd[1]: Stopping Ceph mgr.y for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:41.205 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:44:40 smithi110 podman[69459]: 2024-09-15 22:44:40.916541564 +0000 UTC m=+0.126689424 container died b8ab4bbf1cf1e52c65d7b73c8f133ffa754fbe99a967304363632d4944813888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:44:41.705 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:44:41 smithi110 podman[69459]: 2024-09-15 22:44:41.312821 +0000 UTC m=+0.522968869 container cleanup b8ab4bbf1cf1e52c65d7b73c8f133ffa754fbe99a967304363632d4944813888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T22:44:41.705 INFO:journalctl@ceph.mgr.y.smithi110.stdout:Sep 15 22:44:41 smithi110 bash[69459]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-y 2024-09-15T22:44:41.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T22:44:42.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:42.022 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T22:44:42.022 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T22:44:42.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.z 2024-09-15T22:44:42.352 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:44:42 smithi112 systemd[1]: Stopping Ceph mgr.z for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:42.739 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:44:42 smithi112 podman[70774]: 2024-09-15 22:44:42.432979279 +0000 UTC m=+0.216705227 container died cef4b2736c69cfa09b2726ad5dd6e5befd675df03550b85911761f936a23b887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-15T22:44:43.047 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:44:42 smithi112 podman[70774]: 2024-09-15 22:44:42.820790119 +0000 UTC m=+0.604516072 container cleanup cef4b2736c69cfa09b2726ad5dd6e5befd675df03550b85911761f936a23b887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:44:43.048 INFO:journalctl@ceph.mgr.z.smithi112.stdout:Sep 15 22:44:42 smithi112 bash[70774]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mgr-z 2024-09-15T22:44:43.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T22:44:43.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:43.211 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T22:44:43.211 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T22:44:43.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.0 2024-09-15T22:44:43.532 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:43 smithi022 systemd[1]: Stopping Ceph osd.0 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:44.032 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0[44625]: 2024-09-15T22:44:43.684+0000 7f5a26600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:44:44.032 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0[44625]: 2024-09-15T22:44:43.684+0000 7f5a26600640 -1 osd.0 84 *** Got signal Terminated *** 2024-09-15T22:44:44.032 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0[44625]: 2024-09-15T22:44:43.684+0000 7f5a26600640 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:44:49.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:49 smithi022 podman[88923]: 2024-09-15 22:44:49.142184423 +0000 UTC m=+5.642493802 container died ce1fb3cc05dd19a8925d1eb6cb34217fe55ce9a9deff4e0d94607b069aa5b8a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:44:49.737 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:49 smithi022 podman[88923]: 2024-09-15 22:44:49.526652601 +0000 UTC m=+6.026961980 container cleanup ce1fb3cc05dd19a8925d1eb6cb34217fe55ce9a9deff4e0d94607b069aa5b8a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:44:49.738 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:49 smithi022 bash[88923]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0 2024-09-15T22:44:50.032 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:49 smithi022 podman[88943]: 2024-09-15 22:44:49.736565179 +0000 UTC m=+0.582456137 container remove ce1fb3cc05dd19a8925d1eb6cb34217fe55ce9a9deff4e0d94607b069aa5b8a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:44:50.566 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:50 smithi022 podman[89029]: 2024-09-15 22:44:50.204717667 +0000 UTC m=+0.027553328 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:44:50.566 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:50 smithi022 podman[89029]: 2024-09-15 22:44:50.312857932 +0000 UTC m=+0.135693585 container create e1c3dd16b6196b32bd619f90d1605750d69ba365ae64525b474dd52468f9b266 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-15T22:44:50.566 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:50 smithi022 podman[89029]: 2024-09-15 22:44:50.565426465 +0000 UTC m=+0.388262127 container init e1c3dd16b6196b32bd619f90d1605750d69ba365ae64525b474dd52468f9b266 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:44:50.830 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:50 smithi022 podman[89029]: 2024-09-15 22:44:50.572842979 +0000 UTC m=+0.395678630 container start e1c3dd16b6196b32bd619f90d1605750d69ba365ae64525b474dd52468f9b266 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:44:50.830 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:50 smithi022 podman[89029]: 2024-09-15 22:44:50.648356022 +0000 UTC m=+0.471191687 container attach e1c3dd16b6196b32bd619f90d1605750d69ba365ae64525b474dd52468f9b266 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-15T22:44:51.211 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 15 22:44:50 smithi022 podman[89029]: 2024-09-15 22:44:50.829970185 +0000 UTC m=+0.652805847 container died e1c3dd16b6196b32bd619f90d1605750d69ba365ae64525b474dd52468f9b266 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:44:51.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T22:44:51.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:51.679 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T22:44:51.680 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T22:44:51.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.1 2024-09-15T22:44:51.968 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:51 smithi110 systemd[1]: Stopping Ceph osd.1 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:44:52.455 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1[39776]: 2024-09-15T22:44:51.966+0000 7f1ba652f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:44:52.455 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1[39776]: 2024-09-15T22:44:51.966+0000 7f1ba652f640 -1 osd.1 84 *** Got signal Terminated *** 2024-09-15T22:44:52.455 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1[39776]: 2024-09-15T22:44:51.966+0000 7f1ba652f640 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:44:57.643 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:57 smithi110 podman[69587]: 2024-09-15 22:44:57.37356429 +0000 UTC m=+5.503756139 container died d253685afb6d871871b1c0d5865447c9bb64603843c0cb62f646dbbc625bf4ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:44:57.955 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:57 smithi110 podman[69587]: 2024-09-15 22:44:57.741909973 +0000 UTC m=+5.872101822 container cleanup d253685afb6d871871b1c0d5865447c9bb64603843c0cb62f646dbbc625bf4ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T22:44:57.955 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:57 smithi110 bash[69587]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1 2024-09-15T22:44:58.343 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69605]: 2024-09-15 22:44:58.035059854 +0000 UTC m=+0.656046387 container remove d253685afb6d871871b1c0d5865447c9bb64603843c0cb62f646dbbc625bf4ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:44:58.631 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69694]: 2024-09-15 22:44:58.245628497 +0000 UTC m=+0.015642717 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:44:58.631 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69694]: 2024-09-15 22:44:58.369300945 +0000 UTC m=+0.139315202 container create 294bfa8142b33fd5d09153f3326691b2ef4d27d3b53db693ca6eac6dbc0e1a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T22:44:58.955 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69694]: 2024-09-15 22:44:58.630288314 +0000 UTC m=+0.400302543 container init 294bfa8142b33fd5d09153f3326691b2ef4d27d3b53db693ca6eac6dbc0e1a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:44:58.955 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69694]: 2024-09-15 22:44:58.634221026 +0000 UTC m=+0.404235247 container start 294bfa8142b33fd5d09153f3326691b2ef4d27d3b53db693ca6eac6dbc0e1a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:44:58.956 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69694]: 2024-09-15 22:44:58.713268111 +0000 UTC m=+0.483282331 container attach 294bfa8142b33fd5d09153f3326691b2ef4d27d3b53db693ca6eac6dbc0e1a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-15T22:44:58.956 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:58 smithi110 podman[69694]: 2024-09-15 22:44:58.834375781 +0000 UTC m=+0.604389999 container died 294bfa8142b33fd5d09153f3326691b2ef4d27d3b53db693ca6eac6dbc0e1a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:44:59.444 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 15 22:44:59 smithi110 podman[69717]: 2024-09-15 22:44:59.441675707 +0000 UTC m=+0.597652142 container remove 294bfa8142b33fd5d09153f3326691b2ef4d27d3b53db693ca6eac6dbc0e1a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T22:44:59.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T22:44:59.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:44:59.503 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T22:44:59.503 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T22:44:59.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.2 2024-09-15T22:44:59.801 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:44:59 smithi112 systemd[1]: Stopping Ceph osd.2 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:00.058 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:44:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2[40002]: 2024-09-15T22:44:59.799+0000 7fdd2dbfb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:00.058 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:44:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2[40002]: 2024-09-15T22:44:59.799+0000 7fdd2dbfb640 -1 osd.2 84 *** Got signal Terminated *** 2024-09-15T22:45:00.058 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:44:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2[40002]: 2024-09-15T22:44:59.799+0000 7fdd2dbfb640 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:05.603 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:05 smithi112 podman[70899]: 2024-09-15 22:45:05.344953836 +0000 UTC m=+5.643854341 container died fc19aa63b4519c8410f784989669cc947203595e1e4d4b6e53e796f64efd7405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-15T22:45:06.102 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:05 smithi112 podman[70899]: 2024-09-15 22:45:05.816732431 +0000 UTC m=+6.115632940 container cleanup fc19aa63b4519c8410f784989669cc947203595e1e4d4b6e53e796f64efd7405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-15T22:45:06.102 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:05 smithi112 bash[70899]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2 2024-09-15T22:45:06.461 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[70926]: 2024-09-15 22:45:06.134923425 +0000 UTC m=+0.782564647 container remove fc19aa63b4519c8410f784989669cc947203595e1e4d4b6e53e796f64efd7405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:45:06.798 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[71012]: 2024-09-15 22:45:06.460791331 +0000 UTC m=+0.092146720 container create c2400f22f048b8f612b5a8d29a79452b89190ee1fb9174041e21b4f7ca00f440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T22:45:06.798 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[71012]: 2024-09-15 22:45:06.384668012 +0000 UTC m=+0.016023368 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:06.798 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[71012]: 2024-09-15 22:45:06.696789759 +0000 UTC m=+0.328145103 container init c2400f22f048b8f612b5a8d29a79452b89190ee1fb9174041e21b4f7ca00f440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-15T22:45:06.798 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[71012]: 2024-09-15 22:45:06.700251918 +0000 UTC m=+0.331607272 container start c2400f22f048b8f612b5a8d29a79452b89190ee1fb9174041e21b4f7ca00f440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:45:06.798 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[71012]: 2024-09-15 22:45:06.796964076 +0000 UTC m=+0.428319422 container attach c2400f22f048b8f612b5a8d29a79452b89190ee1fb9174041e21b4f7ca00f440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:07.102 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 15 22:45:06 smithi112 podman[71012]: 2024-09-15 22:45:06.8918816 +0000 UTC m=+0.523236954 container died c2400f22f048b8f612b5a8d29a79452b89190ee1fb9174041e21b4f7ca00f440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-15T22:45:07.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T22:45:07.517 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:07.517 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T22:45:07.517 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T22:45:07.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.3 2024-09-15T22:45:07.934 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:07 smithi022 systemd[1]: Stopping Ceph osd.3 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:08.282 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:45:07.932+0000 7fbf51400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:08.282 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:45:07.932+0000 7fbf51400640 -1 osd.3 84 *** Got signal Terminated *** 2024-09-15T22:45:08.282 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:07 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:45:07.932+0000 7fbf51400640 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:10.532 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:10 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:45:10.231+0000 7fbf47e00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.512282+0000 front 2024-09-15T22:44:46.512102+0000 (oldest deadline 2024-09-15T22:45:09.417983+0000) 2024-09-15T22:45:11.532 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:45:11.198+0000 7fbf47e00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.512282+0000 front 2024-09-15T22:44:46.512102+0000 (oldest deadline 2024-09-15T22:45:09.417983+0000) 2024-09-15T22:45:11.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:11.419+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:12.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:11 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:11.614+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:12.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:11 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:11.866+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:12.532 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:12 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3[51574]: 2024-09-15T22:45:12.237+0000 7fbf47e00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.512282+0000 front 2024-09-15T22:44:46.512102+0000 (oldest deadline 2024-09-15T22:45:09.417983+0000) 2024-09-15T22:45:12.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:12.409+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:12.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:12.418+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:13.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:12 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:12.571+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:13.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:12 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:12.820+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:13.731 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:13 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:13.532+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:13.731 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:13 smithi022 podman[89143]: 2024-09-15 22:45:13.43776739 +0000 UTC m=+5.626054613 container died 8b6df4948707611697343f2a82e0d95f19884e26fe9ce75444b60c28bc9c5d06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:13.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:13.383+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:13.411+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:13.998 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:13 smithi022 podman[89143]: 2024-09-15 22:45:13.829182342 +0000 UTC m=+6.017469565 container cleanup 8b6df4948707611697343f2a82e0d95f19884e26fe9ce75444b60c28bc9c5d06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:45:13.998 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:13 smithi022 bash[89143]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3 2024-09-15T22:45:14.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:13 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:13.843+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:14.282 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:13 smithi022 podman[89159]: 2024-09-15 22:45:13.997282725 +0000 UTC m=+0.551108881 container remove 8b6df4948707611697343f2a82e0d95f19884e26fe9ce75444b60c28bc9c5d06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T22:45:14.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:14.339+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:14.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:14.367+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:14.782 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:14 smithi022 podman[89239]: 2024-09-15 22:45:14.432443544 +0000 UTC m=+0.027322238 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:14.782 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:14 smithi022 podman[89239]: 2024-09-15 22:45:14.565115665 +0000 UTC m=+0.159994345 container create bccdf4cb67f2738c21811b7b4cec9bbd394587f6511d790113e1326773cb5ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T22:45:14.783 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:14 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:14.555+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:14.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:14 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:14.543+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:15.078 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:14 smithi022 podman[89239]: 2024-09-15 22:45:14.801094759 +0000 UTC m=+0.395973440 container init bccdf4cb67f2738c21811b7b4cec9bbd394587f6511d790113e1326773cb5ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T22:45:15.078 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:14 smithi022 podman[89239]: 2024-09-15 22:45:14.808698644 +0000 UTC m=+0.403577329 container start bccdf4cb67f2738c21811b7b4cec9bbd394587f6511d790113e1326773cb5ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-15T22:45:15.078 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:14 smithi022 podman[89239]: 2024-09-15 22:45:14.909283121 +0000 UTC m=+0.504161830 container attach bccdf4cb67f2738c21811b7b4cec9bbd394587f6511d790113e1326773cb5ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:15.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:14 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:14.829+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:15.346 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 15 22:45:15 smithi022 podman[89239]: 2024-09-15 22:45:15.077763501 +0000 UTC m=+0.672642181 container died bccdf4cb67f2738c21811b7b4cec9bbd394587f6511d790113e1326773cb5ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:45:15.601 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:15.342+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:15.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:15.325+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:15.658 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:15 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:15.571+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:15.659 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:15 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:15.586+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:15.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T22:45:15.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:15.811 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T22:45:15.811 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T22:45:15.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.4 2024-09-15T22:45:16.112 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:15 smithi110 systemd[1]: Stopping Ceph osd.4 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:16.113 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:15 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:15.877+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:16.455 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:16.110+0000 7f04d9eb8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:16.455 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:16.110+0000 7f04d9eb8640 -1 osd.4 84 *** Got signal Terminated *** 2024-09-15T22:45:16.455 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:16.110+0000 7f04d9eb8640 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:16.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:16.326+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:16.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:16.373+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:17.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:16 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:16.602+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:17.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:16 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:16.538+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:17.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:16 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:16.875+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:17.601 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:17 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:17.401+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:17.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:17 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:17.337+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:18.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:17 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:17.558+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:18.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:17 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:17.570+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:18.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:17.947+0000 7f04d64bd640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.917772+0000 front 2024-09-15T22:44:51.917814+0000 (oldest deadline 2024-09-15T22:45:17.818019+0000) 2024-09-15T22:45:18.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:17 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:17.837+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:18.301 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:18 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:18.012+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:18.601 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:18 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:18.299+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:18.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:18 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:18.382+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:18.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:18 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:18.382+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:19.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:18 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:18.580+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:19.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:18 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:18.589+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:19.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:18 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:18.589+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:19.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:18 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:18.993+0000 7f04d64bd640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.917772+0000 front 2024-09-15T22:44:51.917814+0000 (oldest deadline 2024-09-15T22:45:17.818019+0000) 2024-09-15T22:45:19.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:18 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:18.837+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:19.280 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:18 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:18.988+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:19.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:19 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:19.279+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:19.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:19 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:19.400+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:19.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:19 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:19.400+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:19.933 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:19 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:19.592+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:19.933 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:19 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:19.556+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:19.933 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:19 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:19.556+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:20.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:20 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:20.041+0000 7f04d64bd640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.917772+0000 front 2024-09-15T22:44:51.917814+0000 (oldest deadline 2024-09-15T22:45:17.818019+0000) 2024-09-15T22:45:20.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:19 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:19.852+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:20.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:19 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:19.852+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:20.275 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:19 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:19.978+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:20.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:20 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:20.352+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:20.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:20 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:20.352+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:20.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:20 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:20.273+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:20.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:20 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:20.273+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:20.608 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:20 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:20.531+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:20.608 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:20 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:20.532+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:20.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:20 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:20.300+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:21.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:20 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:20.617+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:21.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:20 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:20.617+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:21.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:21 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4[46266]: 2024-09-15T22:45:21.026+0000 7f04d64bd640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.917772+0000 front 2024-09-15T22:44:51.917814+0000 (oldest deadline 2024-09-15T22:45:17.818019+0000) 2024-09-15T22:45:21.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:20 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:20.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:21.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:20 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:20.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:21.241 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:20 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:20.970+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:21.595 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:21 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:21.329+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:21.601 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:21 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:21.240+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:21.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:21 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:21.240+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:21.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:21 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:21.392+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:21.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:21 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:21.392+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:21.782 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:21 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:21.579+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:21.782 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:21 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:21.579+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:21.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:21 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:21.655+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:21.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:21 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:21.655+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:21.875 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:21 smithi110 podman[69809]: 2024-09-15 22:45:21.594549844 +0000 UTC m=+5.586489155 container died a9f24a845bbee98418052e1efb2c793c9a16e42f2b6471cb6f94266d9bbaf1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T22:45:22.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:21 smithi110 podman[69809]: 2024-09-15 22:45:21.94400762 +0000 UTC m=+5.935946977 container cleanup a9f24a845bbee98418052e1efb2c793c9a16e42f2b6471cb6f94266d9bbaf1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:22.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:21 smithi110 bash[69809]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4 2024-09-15T22:45:22.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:21 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:21.873+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:22.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:21 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:21.873+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:22.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:22 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:22.001+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:22.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:22 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:22.241+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:22.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:22 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:22.241+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:22.612 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:22 smithi110 podman[69824]: 2024-09-15 22:45:22.256196363 +0000 UTC m=+0.659035349 container remove a9f24a845bbee98418052e1efb2c793c9a16e42f2b6471cb6f94266d9bbaf1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T22:45:22.613 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:22 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:22.370+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:22.851 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:22 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:22.412+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:22.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:22 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:22.412+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:22.907 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:22 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:22.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:22.907 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:22 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:22.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:22.907 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:22 smithi110 podman[69912]: 2024-09-15 22:45:22.514607919 +0000 UTC m=+0.015775536 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:22.907 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:22 smithi110 podman[69912]: 2024-09-15 22:45:22.620709256 +0000 UTC m=+0.121876858 container create 34217e76c030a23287d3035102e0bf01ce159539985ab20ea2d6fb3510abd3ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-15T22:45:22.907 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:22 smithi110 podman[69912]: 2024-09-15 22:45:22.906352554 +0000 UTC m=+0.407520163 container init 34217e76c030a23287d3035102e0bf01ce159539985ab20ea2d6fb3510abd3ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T22:45:23.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:22 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:22.587+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:23.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:22 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:22.587+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:23.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:22 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:22.639+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:23.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:22 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:22.639+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:23.205 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:22 smithi110 podman[69912]: 2024-09-15 22:45:22.90980174 +0000 UTC m=+0.410969343 container start 34217e76c030a23287d3035102e0bf01ce159539985ab20ea2d6fb3510abd3ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:45:23.206 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:23 smithi110 podman[69912]: 2024-09-15 22:45:23.01510264 +0000 UTC m=+0.516270243 container attach 34217e76c030a23287d3035102e0bf01ce159539985ab20ea2d6fb3510abd3ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:23.206 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:23 smithi110 podman[69912]: 2024-09-15 22:45:23.100014456 +0000 UTC m=+0.601182059 container died 34217e76c030a23287d3035102e0bf01ce159539985ab20ea2d6fb3510abd3ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T22:45:23.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:23.016+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:23.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:23.226+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:23.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:23.226+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:23.599 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 15 22:45:23 smithi110 podman[69935]: 2024-09-15 22:45:23.576558379 +0000 UTC m=+0.471398533 container remove 34217e76c030a23287d3035102e0bf01ce159539985ab20ea2d6fb3510abd3ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-15T22:45:23.599 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:23 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:23.404+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:23.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T22:45:23.641 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:23.641 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T22:45:23.642 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T22:45:23.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.5 2024-09-15T22:45:23.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:23.457+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:23.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:23.457+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:23.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:23 smithi112 systemd[1]: Stopping Ceph osd.5 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:23.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:23 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:23.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:23.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:23 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:23.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:24.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:23.628+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:24.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:23.628+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:24.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:23.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:24.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:23 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:23.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:24.275 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:24 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:24.026+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:24.276 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:23.936+0000 7f30f7b2c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:24.276 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:23.936+0000 7f30f7b2c640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-15T22:45:24.276 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:23 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:23.936+0000 7f30f7b2c640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:24.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:24 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:24.424+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:24.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:24 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:24.424+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:24.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:24 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:24.274+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:24.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:24 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:24.274+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:24.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:24 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:24.400+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:25.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:24.654+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:25.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:24.654+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:25.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:24.660+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:25.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:24 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:24.660+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:25.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:24 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:24.871+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:25.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:24 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:24.871+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:25.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:25.035+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:25.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:25.252+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:25.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:25.252+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:25.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:25 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:25.445+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:25.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:25.468+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:25.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:25.468+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:25.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:25 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:25.468+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:04.399794+0000 front 2024-09-15T22:45:04.399772+0000 (oldest deadline 2024-09-15T22:45:25.400560+0000) 2024-09-15T22:45:26.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:25 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:25.694+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:26.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:25 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:25.694+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:26.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:25 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:25.686+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:26.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:25 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:25.686+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:26.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:25 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:25.893+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:26.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:25 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:25.893+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:26.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:25 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:25.893+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:26.351 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:26.022+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:26.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:26.263+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:26.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:26.263+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:26.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:26.419+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:26.851 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:26.456+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:26.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:26.456+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:26.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:26.456+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:04.399794+0000 front 2024-09-15T22:45:04.399772+0000 (oldest deadline 2024-09-15T22:45:25.400560+0000) 2024-09-15T22:45:27.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:26.645+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:27.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:26.645+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:27.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:26.688+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:27.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:26 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:26.688+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:27.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:26.907+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:27.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:26.907+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:27.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:26 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:26.907+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:27.275 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:26 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:26.975+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:27.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:27.469+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:27.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:27.469+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:27.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:27.469+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:04.399794+0000 front 2024-09-15T22:45:04.399772+0000 (oldest deadline 2024-09-15T22:45:25.400560+0000) 2024-09-15T22:45:27.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:27.274+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:27.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:27.274+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:27.603 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:27.274+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:27.900 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:27 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:27.466+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:28.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:27.604+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:28.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:27.604+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:28.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:27.677+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:28.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:27 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:27.677+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:28.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:27 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:27.898+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:28.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:27 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:27.898+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:28.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:27 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:27.898+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:28.301 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:27.954+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:28.301 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:27 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:27.954+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:28.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:28.487+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.897468+0000 front 2024-09-15T22:44:46.897308+0000 (oldest deadline 2024-09-15T22:45:11.597491+0000) 2024-09-15T22:45:28.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:28.487+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.698641+0000 front 2024-09-15T22:44:55.698722+0000 (oldest deadline 2024-09-15T22:45:17.998458+0000) 2024-09-15T22:45:28.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5[46926]: 2024-09-15T22:45:28.487+0000 7f30f0129640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:04.399794+0000 front 2024-09-15T22:45:04.399772+0000 (oldest deadline 2024-09-15T22:45:25.400560+0000) 2024-09-15T22:45:28.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:28.299+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:28.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:28.299+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:28.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:28.299+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:28.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:28 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:28.471+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:28.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:28 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:28.471+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:29.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:28.725+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:29.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:28.725+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:29.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:28.612+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:29.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:28.612+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:29.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:28.612+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:29.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:28 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:28.870+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:29.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:28 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:28.870+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:29.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:28 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:28.870+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:29.334 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:28.950+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:29.334 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:28 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:28.950+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:29.602 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:29 smithi112 podman[71115]: 2024-09-15 22:45:29.337234922 +0000 UTC m=+5.496439517 container died 3e508f64dec8bc07357c1732ddc4427faeebe8bb871e1a20fed256e8ef42fc51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:45:29.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:29 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:29.332+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:29.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:29 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:29.332+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:29.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:29 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:29.332+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:29.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:29 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:29.450+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:29.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:29 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:29.450+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:29.961 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:29 smithi112 podman[71115]: 2024-09-15 22:45:29.686808816 +0000 UTC m=+5.846013410 container cleanup 3e508f64dec8bc07357c1732ddc4427faeebe8bb871e1a20fed256e8ef42fc51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:45:29.961 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:29 smithi112 bash[71115]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5 2024-09-15T22:45:30.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:29.615+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:30.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:29.615+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:30.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:29.615+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:30.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:29.684+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:30.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:29.684+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:30.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:29 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:29.684+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:30.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:29 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:29.825+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:30.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:29 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:29.825+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:30.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:29 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:29.825+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:30.305 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71130]: 2024-09-15 22:45:30.005109221 +0000 UTC m=+0.668399756 container remove 3e508f64dec8bc07357c1732ddc4427faeebe8bb871e1a20fed256e8ef42fc51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T22:45:30.306 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:29 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:29.960+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:30.306 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:29 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:29.960+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:30.600 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:30.303+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:30.600 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:30.303+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:30.600 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:30.303+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:30.601 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71227]: 2024-09-15 22:45:30.264078151 +0000 UTC m=+0.017865432 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:30.601 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71227]: 2024-09-15 22:45:30.389243323 +0000 UTC m=+0.143030595 container create 2f4524c8ea94c2c6633d9d3ffbd23d5ef7216975e94516bf1119ffdaf6668a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:45:30.601 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71227]: 2024-09-15 22:45:30.599903879 +0000 UTC m=+0.353691157 container init 2f4524c8ea94c2c6633d9d3ffbd23d5ef7216975e94516bf1119ffdaf6668a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e) 2024-09-15T22:45:30.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:30 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:30.427+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:30.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:30 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:30.427+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:30.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71227]: 2024-09-15 22:45:30.603404893 +0000 UTC m=+0.357192166 container start 2f4524c8ea94c2c6633d9d3ffbd23d5ef7216975e94516bf1119ffdaf6668a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-15T22:45:30.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71227]: 2024-09-15 22:45:30.691689312 +0000 UTC m=+0.445476594 container attach 2f4524c8ea94c2c6633d9d3ffbd23d5ef7216975e94516bf1119ffdaf6668a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T22:45:30.852 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 15 22:45:30 smithi112 podman[71227]: 2024-09-15 22:45:30.799792001 +0000 UTC m=+0.553579274 container died 2f4524c8ea94c2c6633d9d3ffbd23d5ef7216975e94516bf1119ffdaf6668a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T22:45:30.943 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:30 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:30.673+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:30.943 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:30 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:30.673+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:30.943 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:30 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:30.673+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:30.943 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:30 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:30.657+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:30.943 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:30 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:30.657+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:30.943 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:30 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:30.657+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:31.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:30 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:30.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:31.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:30 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:30.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:31.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:30 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:30.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:31.316 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:30.983+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:31.316 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:30 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:30.983+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:31.352 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T22:45:31.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:31.391 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T22:45:31.391 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T22:45:31.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.6 2024-09-15T22:45:31.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:31 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:31.314+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:31.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:31 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:31.314+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:31.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:31 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:31.314+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:31.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:31 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:31.387+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:31.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:31 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:31.387+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:31.782 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 systemd[1]: Stopping Ceph osd.6 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:31.783 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:31.690+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:31.783 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:31.690+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:31.783 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:31.690+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:31.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:31.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:31.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:31.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:31.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:31.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:32.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:31 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:31.861+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:32.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:31 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:31.861+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:32.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:31 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:31.861+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:32.282 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:31.871+0000 7fb1fba00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:32.282 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:31.871+0000 7fb1fba00640 -1 osd.6 84 *** Got signal Terminated *** 2024-09-15T22:45:32.282 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:31 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:31.871+0000 7fb1fba00640 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:32.289 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:31 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:31.956+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:32.290 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:31 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:31.956+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:32.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:32 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:32.288+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:32.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:32 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:32.288+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:32.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:32 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:32.288+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:32.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:32 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:32.392+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:32.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:32 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:32.392+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:33.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:32.628+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:33.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:32.628+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:33.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:32.628+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:33.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:32.641+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:33.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:32.641+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:33.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:32.641+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:33.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:32 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:32.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:33.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:32 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:32.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:33.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:32 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:32.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:33.335 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:33 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:33.000+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:33.335 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:33 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:33.000+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:33.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:33 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:33.334+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:33.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:33 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:33.334+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:33.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:33 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:33.334+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:33.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:33 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:33.420+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:33.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:33 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:33.420+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:34.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:33 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:33.664+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:34.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:33 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:33.664+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:34.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:33 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:33.664+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:34.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:33 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:33.669+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:34.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:33 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:33.669+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:34.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:33 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:33.669+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:34.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:33 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:33.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:34.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:33 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:33.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:34.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:33 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:33.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:34.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:34 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:34.004+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:34.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:34 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:34.004+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:34.706 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:34 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:34.428+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:34.706 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:34 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:34.428+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:34.706 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:34 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:34.428+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:34.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:34 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:34.359+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:34.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:34 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:34.359+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:34.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:34 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:34.359+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:35.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:34.650+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:35.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:34.650+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:35.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:34.650+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:35.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:34.671+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:35.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:34.671+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:35.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:34 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:34.671+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:35.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:34 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:34.775+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:35.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:34 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:34.775+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:35.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:34 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:34.775+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:35.351 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:35 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:35.011+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:35.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:35 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:35.011+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:35.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:35.425+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:35.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:35.425+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:35.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:35.425+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:35.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:35 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:35.407+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:35.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:35 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:35.407+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:35.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:35 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:35.407+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:36.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:35.611+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:36.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:35.611+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:36.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:35.611+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:36.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:35.649+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:36.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:35.649+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:36.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:35.649+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:36.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:35 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:35.649+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:10.706802+0000 front 2024-09-15T22:45:10.706862+0000 (oldest deadline 2024-09-15T22:45:34.806794+0000) 2024-09-15T22:45:36.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:35.795+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:36.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:35.795+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:36.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:35.795+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:36.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:35 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:35.795+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:36.351 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:36 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:36.050+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:36.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:36 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:36.050+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:36.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:36.399+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:36.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:36.399+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:36.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:36.399+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:36.851 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:36 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:36.360+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:36.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:36 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:36.360+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:36.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:36 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:36.360+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:37.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:36.670+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:47.001843+0000 front 2024-09-15T22:44:47.001792+0000 (oldest deadline 2024-09-15T22:45:11.101930+0000) 2024-09-15T22:45:37.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:36.670+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.904657+0000 front 2024-09-15T22:44:54.904693+0000 (oldest deadline 2024-09-15T22:45:17.804854+0000) 2024-09-15T22:45:37.032 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:36.670+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.905941+0000 front 2024-09-15T22:45:01.906060+0000 (oldest deadline 2024-09-15T22:45:27.805822+0000) 2024-09-15T22:45:37.033 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6[58131]: 2024-09-15T22:45:36.670+0000 7fb1f2400640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:10.706802+0000 front 2024-09-15T22:45:10.706862+0000 (oldest deadline 2024-09-15T22:45:34.806794+0000) 2024-09-15T22:45:37.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:36.648+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:37.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:36.648+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:37.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:36.648+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:37.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:36 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:36.648+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:37.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:36.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:37.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:36.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:37.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:36.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:37.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:36.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:37.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:37.040+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:37.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:37.040+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:37.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:37.040+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:37.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:37.420+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:37.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:37.420+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:37.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:37.420+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:37.782 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:37 smithi022 podman[89350]: 2024-09-15 22:45:37.486190066 +0000 UTC m=+5.775408136 container died 51fc203608bb38194f247bc791d4683a00b0e65f0b38f86fdf622a78f2378271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:37.782 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:37.695+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:37.782 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:37.695+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:37.782 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:37.696+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:37.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:37 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:37.696+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:37.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:37.358+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:37.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:37.358+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:37.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:37 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:37.358+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:38.161 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:37 smithi022 podman[89350]: 2024-09-15 22:45:37.890737744 +0000 UTC m=+6.179955812 container cleanup 51fc203608bb38194f247bc791d4683a00b0e65f0b38f86fdf622a78f2378271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-15T22:45:38.161 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:37 smithi022 bash[89350]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6 2024-09-15T22:45:38.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:37.823+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:38.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:37.823+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:38.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:37.823+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:38.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:37 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:37.823+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:38.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:38 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:38.089+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:38.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:38 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:38.089+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:38.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:38 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:38.089+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:38.532 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:38 smithi022 podman[89368]: 2024-09-15 22:45:38.1586788 +0000 UTC m=+0.662156434 container remove 51fc203608bb38194f247bc791d4683a00b0e65f0b38f86fdf622a78f2378271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-15T22:45:38.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:38.373+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:38.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:38.373+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:38.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:38.373+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:38.851 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:38 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:38.400+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:38.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:38 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:38.400+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:38.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:38 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:38.400+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:38.938 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:38.724+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:38.938 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:38.724+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:38.938 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:38.724+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:38.938 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:38 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:38.724+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:38.939 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:38 smithi022 podman[89451]: 2024-09-15 22:45:38.523418395 +0000 UTC m=+0.027658369 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:38.939 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:38 smithi022 podman[89451]: 2024-09-15 22:45:38.701549232 +0000 UTC m=+0.205789206 container create a9a2a8046ff0de4d071929e7b5cf866735d2625d68a8c4db44044257c6bb7e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T22:45:38.939 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:38 smithi022 podman[89451]: 2024-09-15 22:45:38.937525543 +0000 UTC m=+0.441765518 container init a9a2a8046ff0de4d071929e7b5cf866735d2625d68a8c4db44044257c6bb7e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:45:39.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:38.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:39.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:38.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:39.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:38.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:39.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:38 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:38.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:39.213 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:38 smithi022 podman[89451]: 2024-09-15 22:45:38.9447209 +0000 UTC m=+0.448960875 container start a9a2a8046ff0de4d071929e7b5cf866735d2625d68a8c4db44044257c6bb7e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-15T22:45:39.214 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:39 smithi022 podman[89451]: 2024-09-15 22:45:39.029016875 +0000 UTC m=+0.533256858 container attach a9a2a8046ff0de4d071929e7b5cf866735d2625d68a8c4db44044257c6bb7e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T22:45:39.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:39 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:39.053+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:39.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:39 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:39.053+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:39.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:39 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:39.053+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:39.532 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 15 22:45:39 smithi022 podman[89451]: 2024-09-15 22:45:39.21329701 +0000 UTC m=+0.717536993 container died a9a2a8046ff0de4d071929e7b5cf866735d2625d68a8c4db44044257c6bb7e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:45:39.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:39.360+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:39.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:39.360+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:39.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:39.360+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:39.850 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:39.721+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:39.850 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:39.721+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:39.850 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:39.721+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:39.850 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:39 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:39.721+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:39.851 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:39 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:39.401+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:39.851 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:39 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:39.401+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:39.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:39 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:39.401+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:39.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T22:45:39.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:39.961 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T22:45:39.961 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T22:45:39.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.7 2024-09-15T22:45:40.205 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 systemd[1]: Stopping Ceph osd.7 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:40.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:39.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:40.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:39.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:40.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:39.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:40.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:39.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:40.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:40 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:40.095+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:40.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:40 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:40.095+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:40.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:40 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:40.095+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:40.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:40.262+0000 7f0b2099d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:40.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:40.262+0000 7f0b2099d640 -1 osd.7 84 *** Got signal Terminated *** 2024-09-15T22:45:40.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:40.262+0000 7f0b2099d640 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:40.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:40.369+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:40.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:40.369+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:40.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:40.369+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:40.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:40 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:40.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:40.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:40 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:40.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:40.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:40 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:40.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:41.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:40.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:41.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:40.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:41.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:40.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:41.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:40 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:40.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:41.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:40.856+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:41.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:40.856+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:41.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:40.856+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:41.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:40 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:40.856+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:41.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:41 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:41.126+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:41.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:41 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:41.126+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:41.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:41 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:41.126+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:41.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:41.380+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:41.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:41.380+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:41.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:41.380+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:41.853 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:41 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:41.371+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:41.853 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:41 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:41.371+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:41.853 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:41 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:41.371+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:42.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:41 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:41.701+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:42.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:41 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:41.701+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:42.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:41 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:41.701+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:42.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:41 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:41.701+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:42.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:41.859+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:42.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:41.859+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:42.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:41.859+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:42.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:41 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:41.859+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:42.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:42.078+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:42.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:42.078+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:42.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:42.078+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:42.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:42.403+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:42.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:42.403+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:42.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:42.403+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:42.851 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:42.376+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:42.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:42.376+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:42.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:42.376+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:42.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:42 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:42.376+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:43.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:42.679+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:43.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:42.679+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:43.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:42.679+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:43.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:42 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:42.679+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:43.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:42.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:43.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:42.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:43.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:42.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:43.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:42.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:43.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:42 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:42.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:43.414 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:43.119+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:43.414 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:43.119+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:43.414 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:43.119+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:43.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:43.395+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:43.706 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:43.395+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:43.706 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:43.395+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:43.706 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:43.395+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.907998+0000 front 2024-09-15T22:45:20.908123+0000 (oldest deadline 2024-09-15T22:45:43.208102+0000) 2024-09-15T22:45:43.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:43.413+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:43.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:43.413+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:43.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:43.413+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:43.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:43 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:43.413+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:44.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:43.713+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:44.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:43.713+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:44.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:43.713+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:44.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:43 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:43.713+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:44.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:43.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:44.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:43.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:44.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:43.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:44.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:43.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:44.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:43.840+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:44.393 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:44.102+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:44.393 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:44.102+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:44.393 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:44.102+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:44.393 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:44.102+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:44.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:44.437+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:53.904758+0000 front 2024-09-15T22:44:53.904783+0000 (oldest deadline 2024-09-15T22:45:19.804902+0000) 2024-09-15T22:45:44.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:44.437+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.305940+0000 front 2024-09-15T22:45:03.305922+0000 (oldest deadline 2024-09-15T22:45:28.006077+0000) 2024-09-15T22:45:44.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:44.437+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:08.006751+0000 front 2024-09-15T22:45:08.006765+0000 (oldest deadline 2024-09-15T22:45:33.906532+0000) 2024-09-15T22:45:44.705 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7[52938]: 2024-09-15T22:45:44.437+0000 7f0b18f9a640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.907998+0000 front 2024-09-15T22:45:20.908123+0000 (oldest deadline 2024-09-15T22:45:43.208102+0000) 2024-09-15T22:45:44.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:44.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:44.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:44.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:44.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:44.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:44.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:44 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:44.392+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:45.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:44 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:44.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:45.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:44 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:44.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:45.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:44 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:44.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:45.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:44 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:44.722+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:45.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:44.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:45.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:44.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:45.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:44.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:45.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:44.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:45.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:44 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:44.827+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:45.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:45.079+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:45.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:45.079+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:45.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:45.079+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:45.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:45.079+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:45.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:45.396+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:45.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:45.396+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:45.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:45.396+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:45.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:45 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:45.396+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:45.955 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:45 smithi110 podman[70028]: 2024-09-15 22:45:45.658386102 +0000 UTC m=+5.499065041 container died 960bf39753716aaa2def06b632c53e778280e0700554416cca899d15fbc6bb06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T22:45:45.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:45 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:45.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:45.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:45 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:45.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:45.956 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:45 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:45.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:45.956 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:45 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:45.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:45.956 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:45 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:45.869+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:46.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:45 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:45.737+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:46.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:45 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:45.737+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:46.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:45 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:45.737+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:46.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:45 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:45.737+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:46.289 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70028]: 2024-09-15 22:45:46.062490336 +0000 UTC m=+5.903169275 container cleanup 960bf39753716aaa2def06b632c53e778280e0700554416cca899d15fbc6bb06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-15T22:45:46.289 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 bash[70028]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:46.347+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:46.347+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:46.347+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:46.347+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:46.115+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:46.115+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:46.115+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:46.602 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:46 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:46.115+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:46.617 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70043]: 2024-09-15 22:45:46.288479584 +0000 UTC m=+0.624711018 container remove 960bf39753716aaa2def06b632c53e778280e0700554416cca899d15fbc6bb06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:45:46.917 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:46 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:46.829+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:46.917 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:46 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:46.829+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:46.917 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:46 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:46.829+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:46.917 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:46 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:46.829+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:46.917 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:46 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:46.829+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:46.917 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70133]: 2024-09-15 22:45:46.519846003 +0000 UTC m=+0.015737725 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:46.918 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70133]: 2024-09-15 22:45:46.639763418 +0000 UTC m=+0.135655185 container create 4907bcd138ab706565beb24d593bf101f5083060b0752c7b6defc6c07c866466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-15T22:45:46.918 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70133]: 2024-09-15 22:45:46.849705856 +0000 UTC m=+0.345597566 container init 4907bcd138ab706565beb24d593bf101f5083060b0752c7b6defc6c07c866466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:45:46.918 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70133]: 2024-09-15 22:45:46.852884913 +0000 UTC m=+0.348776620 container start 4907bcd138ab706565beb24d593bf101f5083060b0752c7b6defc6c07c866466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2) 2024-09-15T22:45:46.918 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:46 smithi110 podman[70133]: 2024-09-15 22:45:46.916298163 +0000 UTC m=+0.412189881 container attach 4907bcd138ab706565beb24d593bf101f5083060b0752c7b6defc6c07c866466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:45:47.205 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 15 22:45:47 smithi110 podman[70133]: 2024-09-15 22:45:47.042731703 +0000 UTC m=+0.538623418 container died 4907bcd138ab706565beb24d593bf101f5083060b0752c7b6defc6c07c866466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:45:47.282 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:46.780+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:47.282 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:46.780+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:47.282 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:46.780+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:47.282 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:46 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:46.780+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:47.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.094+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:47.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.094+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:47.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.094+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:47.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.094+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:47.635 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T22:45:47.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:47.674 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T22:45:47.674 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T22:45:47.674 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.8 2024-09-15T22:45:47.700 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:47.391+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:47.701 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:47.391+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:47.701 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:47.391+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:47.701 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:47.391+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:47.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:47.858+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:47.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:47.858+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:47.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:47.858+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:47.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:47.858+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:47.955 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:47.858+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:47.966 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 systemd[1]: Stopping Ceph osd.8 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:48.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:47 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:47.743+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:48.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:47 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:47.743+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:48.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:47 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:47.743+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:48.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:47 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:47.743+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:48.352 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.963+0000 7f3dd53e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:48.680 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.963+0000 7f3dd53e6640 -1 osd.8 84 *** Got signal Terminated *** 2024-09-15T22:45:48.681 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:47 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:47.963+0000 7f3dd53e6640 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:48.681 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:48.100+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:48.681 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:48.100+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:48.681 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:48.100+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:48.681 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:48.100+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:48.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:48.368+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:48.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:48.368+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:48.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:48.368+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:48.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:48 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:48.368+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:49.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:48 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:48.715+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:49.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:48 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:48.715+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:49.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:48 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:48.715+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:49.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:48 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:48.715+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:49.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:48 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:48.855+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:49.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:48 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:48.855+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:49.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:48 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:48.855+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:49.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:48 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:48.855+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:49.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:48 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:48.855+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:49.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:49.321+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:49.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:49.321+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:49.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:49.321+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:49.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:49.321+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:49.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:49.130+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:49.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:49.130+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:49.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:49.130+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:49.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:49 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:49.130+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:50.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:49 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:49.705+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:50.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:49 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:49.705+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:50.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:49 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:49.705+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:50.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:49 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:49.705+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:50.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:49 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:49.705+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:50.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:49.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:50.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:49.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:50.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:49.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:50.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:49.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:50.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:49.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:50.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:49 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:49.842+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:50.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:50.355+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:50.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:50.355+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:50.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:50.355+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:50.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:50.355+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:50.602 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:50.156+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:50.602 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:50.156+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:50.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:50.156+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:50.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:50 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:50.156+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:51.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:50 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:50.678+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:51.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:50 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:50.678+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:51.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:50 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:50.678+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:51.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:50 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:50.678+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:51.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:50 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:50.678+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:51.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:50 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:50.890+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:51.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:50 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:50.890+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:51.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:50 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:50.890+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:51.207 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:50 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:50.890+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:51.207 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:50 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:50.890+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:51.207 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:50 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:50.890+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:51.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:51.369+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:51.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:51.369+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:51.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:51.369+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:51.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:51.369+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:51.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:51.190+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:51.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:51.190+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:51.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:51.190+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:51.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:51 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:51.190+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:51.782 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:51 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:51.682+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:51.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:51 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:51.682+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:51.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:51 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:51.682+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:51.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:51 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:51.682+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:51.783 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:51 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:51.682+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:52.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:51.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:52.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:51.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:52.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:51.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:52.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:51.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:52.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:51.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:52.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:51 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:51.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:52.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:52.384+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:52.384+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:52.384+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:52.384+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:52.384+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:52.176+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:51.794237+0000 front 2024-09-15T22:44:51.794208+0000 (oldest deadline 2024-09-15T22:45:17.694206+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:52.176+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:01.695536+0000 front 2024-09-15T22:45:01.695626+0000 (oldest deadline 2024-09-15T22:45:27.595745+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:52.176+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.897068+0000 front 2024-09-15T22:45:12.897051+0000 (oldest deadline 2024-09-15T22:45:36.396967+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:52.176+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:20.398614+0000 front 2024-09-15T22:45:20.398701+0000 (oldest deadline 2024-09-15T22:45:43.298711+0000) 2024-09-15T22:45:52.603 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8[53926]: 2024-09-15T22:45:52.176+0000 7f3dcd9e3640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.799548+0000 front 2024-09-15T22:45:26.799605+0000 (oldest deadline 2024-09-15T22:45:52.099584+0000) 2024-09-15T22:45:53.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:52 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:52.680+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:53.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:52 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:52.680+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:53.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:52 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:52.680+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:53.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:52 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:52.680+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:53.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:52 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:52.680+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:53.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:52 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:52.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:53.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:52 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:52.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:53.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:52 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:52.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:53.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:52 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:52.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:53.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:52 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:52.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:53.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:52 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:52.925+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:53.782 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:53 smithi112 podman[71333]: 2024-09-15 22:45:53.520861586 +0000 UTC m=+5.654654754 container died c6407a3e18abfb949f2ef7d0252d6d65dab8ab2612030e105e3bdd0210312312 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T22:45:53.783 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:53 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:53.388+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:53.783 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:53 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:53.388+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:53.783 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:53 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:53.388+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:53.783 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:53 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:53.388+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:53.783 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:53 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:53.388+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:54.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:53 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:53.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:54.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:53 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:53.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:54.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:53 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:53.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:54.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:53 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:53.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:54.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:53 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:53.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:54.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:53 smithi112 podman[71333]: 2024-09-15 22:45:53.864558992 +0000 UTC m=+5.998352162 container cleanup c6407a3e18abfb949f2ef7d0252d6d65dab8ab2612030e105e3bdd0210312312 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:45:54.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:53 smithi112 bash[71333]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8 2024-09-15T22:45:54.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:53 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:53.903+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:54.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:53 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:53.903+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:54.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:53 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:53.903+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:54.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:53 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:53.903+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:54.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:53 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:53.903+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:54.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:53 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:53.903+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:54.399 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71349]: 2024-09-15 22:45:54.141063679 +0000 UTC m=+0.619515741 container remove c6407a3e18abfb949f2ef7d0252d6d65dab8ab2612030e105e3bdd0210312312 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T22:45:54.745 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71437]: 2024-09-15 22:45:54.387266987 +0000 UTC m=+0.016945369 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:45:54.745 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71437]: 2024-09-15 22:45:54.516769539 +0000 UTC m=+0.146447920 container create 0a1242fd561263fa247e9e3a5b809fa1a9a293bcba4ec4fb1a2fe1342c6998fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:45:54.745 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71437]: 2024-09-15 22:45:54.744491322 +0000 UTC m=+0.374169699 container init 0a1242fd561263fa247e9e3a5b809fa1a9a293bcba4ec4fb1a2fe1342c6998fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:45:54.745 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:54 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:54.397+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:54.745 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:54 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:54.397+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:54.745 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:54 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:54.397+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:54.746 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:54 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:54.397+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:54.746 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:54 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:54.397+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:55.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:54 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:54.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:55.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:54 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:54.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:55.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:54 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:54.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:55.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:54 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:54.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:55.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:54 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:54.644+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:55.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71437]: 2024-09-15 22:45:54.748075563 +0000 UTC m=+0.377753941 container start 0a1242fd561263fa247e9e3a5b809fa1a9a293bcba4ec4fb1a2fe1342c6998fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T22:45:55.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71437]: 2024-09-15 22:45:54.844539423 +0000 UTC m=+0.474217803 container attach 0a1242fd561263fa247e9e3a5b809fa1a9a293bcba4ec4fb1a2fe1342c6998fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:45:55.102 INFO:journalctl@ceph.osd.8.smithi112.stdout:Sep 15 22:45:54 smithi112 podman[71437]: 2024-09-15 22:45:54.938107645 +0000 UTC m=+0.567786024 container died 0a1242fd561263fa247e9e3a5b809fa1a9a293bcba4ec4fb1a2fe1342c6998fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-15T22:45:55.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:54 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:54.894+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:55.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:54 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:54.894+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:55.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:54 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:54.894+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:55.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:54 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:54.894+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:55.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:54 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:54.894+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:55.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:54 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:54.894+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:55.507 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:55.420+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:55.507 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:55.420+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:55.507 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:55.420+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:55.507 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:55.420+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:55.507 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:55.420+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:55.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T22:45:55.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:45:55.611 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T22:45:55.612 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T22:45:55.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.9 2024-09-15T22:45:56.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:55 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:55.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:56.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:55 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:55.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:56.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:55 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:55.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:56.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:55 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:55.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:56.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:55 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:55.667+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:56.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:55 smithi022 systemd[1]: Stopping Ceph osd.9 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:45:56.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:55 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:55.867+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:56.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:55 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:55.867+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:56.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:55 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:55.867+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:56.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:55 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:55.867+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:56.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:55 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:55.867+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:56.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:55 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:55.867+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:56.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.087+0000 7fc646000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:45:56.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.087+0000 7fc646000640 -1 osd.9 84 *** Got signal Terminated *** 2024-09-15T22:45:56.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.087+0000 7fc646000640 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:45:56.728 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:56 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:56.465+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:56.728 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:56 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:56.465+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:56.728 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:56 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:56.465+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:56.728 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:56 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:56.465+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:56.728 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:56 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:56.465+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:57.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.656+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:57.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.656+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:57.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.656+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:57.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.656+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:57.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:56 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:56.656+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:57.106 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:56 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:56.831+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:57.106 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:56 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:56.831+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:57.107 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:56 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:56.831+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:57.107 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:56 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:56.831+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:57.107 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:56 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:56.831+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:57.107 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:56 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:56.831+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:57.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:57 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:57.437+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:57.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:57 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:57.438+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:57.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:57 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:57.438+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:57.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:57 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:57.438+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:57.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:57 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:57.438+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:58.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:57 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:57.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:58.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:57 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:57.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:58.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:57 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:57.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:58.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:57 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:57.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:58.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:57 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:57.663+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:58.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:57.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:58.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:57.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:58.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:57.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:58.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:57.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:58.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:57.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:58.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:57 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:57.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:58.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:58 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:58.479+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:58.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:58 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:58.479+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:58.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:58 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:58.479+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:58.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:58 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:58.479+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:58.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:58 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:58.479+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:58.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:58 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:58.479+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:45:59.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:58 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:58.626+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:45:59.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:58 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:58.626+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:45:59.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:58 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:58.626+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:45:59.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:58 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:58.626+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:45:59.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:58 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:58.626+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:45:59.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:58.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:45:59.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:58.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:45:59.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:58.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:45:59.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:58.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:45:59.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:58.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:45:59.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:58 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:58.805+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:45:59.763 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:59.508+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:45:59.764 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:59.508+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:45:59.764 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:59.508+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:45:59.764 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:59.508+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:45:59.764 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:59.508+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:45:59.764 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:45:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:45:59.508+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:00.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:59 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:59.670+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:46:00.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:59 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:59.670+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:46:00.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:59 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:59.670+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:46:00.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:59 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:59.670+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:46:00.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:45:59 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:45:59.670+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:46:00.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:00.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:00.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:00.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:00.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:00.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:00.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:45:59 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:45:59.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:00.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:00 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:00.503+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:00.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:00 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:00.503+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:00.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:00 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:00.503+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:00.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:00 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:00.503+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:00.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:00 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:00.503+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:00.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:00 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:00.503+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:01.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:46:00.693+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:43.747843+0000 front 2024-09-15T22:44:43.747490+0000 (oldest deadline 2024-09-15T22:45:14.348061+0000) 2024-09-15T22:46:01.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:46:00.693+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:54.348774+0000 front 2024-09-15T22:44:54.348823+0000 (oldest deadline 2024-09-15T22:45:20.248671+0000) 2024-09-15T22:46:01.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:46:00.693+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:03.050158+0000 front 2024-09-15T22:45:03.050361+0000 (oldest deadline 2024-09-15T22:45:28.950069+0000) 2024-09-15T22:46:01.032 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:46:00.693+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.351448+0000 front 2024-09-15T22:45:12.351369+0000 (oldest deadline 2024-09-15T22:45:35.851351+0000) 2024-09-15T22:46:01.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:46:00.693+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:24.652823+0000 front 2024-09-15T22:45:24.653027+0000 (oldest deadline 2024-09-15T22:45:49.352761+0000) 2024-09-15T22:46:01.033 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:00 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9[64747]: 2024-09-15T22:46:00.693+0000 7fc63ca00640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:36.254780+0000 front 2024-09-15T22:45:36.254872+0000 (oldest deadline 2024-09-15T22:45:59.754631+0000) 2024-09-15T22:46:01.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:01.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:01.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:01.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:01.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:01.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:01.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:00 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:00.836+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:01.782 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:01 smithi022 podman[89564]: 2024-09-15 22:46:01.506543492 +0000 UTC m=+5.597317305 container died 5e3109b37640e9996b1245681683b6a38dbdcd06f8b926656f7e9f940a8e5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T22:46:01.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:01 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:01.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:01.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:01 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:01.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:01.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:01 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:01.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:01.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:01 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:01.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:01.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:01 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:01.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:01.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:01 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:01.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:02.070 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:01 smithi022 podman[89564]: 2024-09-15 22:46:01.909355538 +0000 UTC m=+6.000129351 container cleanup 5e3109b37640e9996b1245681683b6a38dbdcd06f8b926656f7e9f940a8e5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:46:02.070 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:01 smithi022 bash[89564]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9 2024-09-15T22:46:02.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:02.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:02.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:02.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:02.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:02.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:02.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:01 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:01.788+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:02.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:02 smithi022 podman[89580]: 2024-09-15 22:46:02.068987175 +0000 UTC m=+0.552999280 container remove 5e3109b37640e9996b1245681683b6a38dbdcd06f8b926656f7e9f940a8e5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-15T22:46:02.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:02 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:02.469+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:02.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:02 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:02.469+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:02.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:02 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:02.469+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:02.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:02 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:02.469+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:02.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:02 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:02.469+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:02.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:02 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:02.469+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:02.931 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:02 smithi022 podman[89667]: 2024-09-15 22:46:02.515919352 +0000 UTC m=+0.028320266 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:46:02.931 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:02 smithi022 podman[89667]: 2024-09-15 22:46:02.619698594 +0000 UTC m=+0.132099485 container create a2261de302adaf431b2d45a61be441efae1a07185318eb168cfacc5c34be1103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:46:02.931 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:02 smithi022 podman[89667]: 2024-09-15 22:46:02.838950722 +0000 UTC m=+0.351351636 container init a2261de302adaf431b2d45a61be441efae1a07185318eb168cfacc5c34be1103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-15T22:46:02.931 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:02 smithi022 podman[89667]: 2024-09-15 22:46:02.845714139 +0000 UTC m=+0.358115032 container start a2261de302adaf431b2d45a61be441efae1a07185318eb168cfacc5c34be1103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-15T22:46:02.931 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:02 smithi022 podman[89667]: 2024-09-15 22:46:02.930324108 +0000 UTC m=+0.442725000 container attach a2261de302adaf431b2d45a61be441efae1a07185318eb168cfacc5c34be1103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:46:03.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:03.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:03.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:03.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:03.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:03.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:03.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:02 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:02.818+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:03.282 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 15 22:46:03 smithi022 podman[89667]: 2024-09-15 22:46:03.107621549 +0000 UTC m=+0.620022442 container died a2261de302adaf431b2d45a61be441efae1a07185318eb168cfacc5c34be1103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T22:46:03.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:03.457+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:03.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:03.457+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:03.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:03.457+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:03.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:03.457+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:03.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:03.457+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:03.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:03.457+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:03.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T22:46:04.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:04.032 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T22:46:04.032 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T22:46:04.032 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.10 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:04.077 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:03 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:03.821+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:04.348 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 systemd[1]: Stopping Ceph osd.10 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:04.705 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.346+0000 7f3173eef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:04.705 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.346+0000 7f3173eef640 -1 osd.10 84 *** Got signal Terminated *** 2024-09-15T22:46:04.705 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.346+0000 7f3173eef640 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:46:04.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:04 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:04.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:04.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:04 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:04.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:04.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:04 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:04.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:04.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:04 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:04.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:04.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:04 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:04.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:04.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:04 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:04.489+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:05.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:05.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:05.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:05.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:05.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:05.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:05.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:04 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:04.816+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:05.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:05.515+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:05.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:05.515+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:05.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:05.515+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:05.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:05.515+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:05.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:05.515+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:05.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:05 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:05.515+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:06.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:06.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:06.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:06.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:06.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:06.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:06.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:05 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:05.817+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:06.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:06 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:06.494+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:06.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:06 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:06.494+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:06.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:06 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:06.494+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:06.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:06 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:06.494+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:06.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:06 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:06.494+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:06.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:06 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:06.494+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:07.162 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:07.163 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:07.163 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:07.163 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:07.163 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:07.163 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:07.163 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:06 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:06.801+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:07.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:07 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:07.486+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:08.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:08.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:08.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:08.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:08.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:08.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:08.206 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:07 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:07.769+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:08.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:08 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:08.488+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:45.805586+0000 front 2024-09-15T22:44:45.805803+0000 (oldest deadline 2024-09-15T22:45:11.105440+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:56.307037+0000 front 2024-09-15T22:44:56.307006+0000 (oldest deadline 2024-09-15T22:45:19.807110+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:44:59.807362+0000 front 2024-09-15T22:44:59.807379+0000 (oldest deadline 2024-09-15T22:45:25.707490+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-15T22:45:12.709159+0000 front 2024-09-15T22:45:12.709009+0000 (oldest deadline 2024-09-15T22:45:35.608829+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:19.610164+0000 front 2024-09-15T22:45:19.610110+0000 (oldest deadline 2024-09-15T22:45:42.510118+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:28.411034+0000 front 2024-09-15T22:45:28.411017+0000 (oldest deadline 2024-09-15T22:45:49.510923+0000) 2024-09-15T22:46:09.205 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:08 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10[59656]: 2024-09-15T22:46:08.741+0000 7f316c4ec640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:35.411990+0000 front 2024-09-15T22:45:35.412005+0000 (oldest deadline 2024-09-15T22:45:59.511732+0000) 2024-09-15T22:46:09.806 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:09.806 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:09.806 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:09.807 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:09.807 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:09.807 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:09.807 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:09 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:09.518+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:10.130 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:09 smithi110 podman[70247]: 2024-09-15 22:46:09.803643785 +0000 UTC m=+5.580650593 container died 5935f7db1305736cd8eebf6fb58eee3aeec6a3c1215f3234acdc19e4a50af72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-15T22:46:10.130 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 podman[70247]: 2024-09-15 22:46:10.129780361 +0000 UTC m=+5.906787158 container cleanup 5935f7db1305736cd8eebf6fb58eee3aeec6a3c1215f3234acdc19e4a50af72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-15T22:46:10.455 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 bash[70247]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10 2024-09-15T22:46:10.455 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 podman[70265]: 2024-09-15 22:46:10.322608871 +0000 UTC m=+0.520845569 container remove 5935f7db1305736cd8eebf6fb58eee3aeec6a3c1215f3234acdc19e4a50af72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:10.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:10 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:10.568+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:11.051 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 podman[70353]: 2024-09-15 22:46:10.637925362 +0000 UTC m=+0.015571792 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:46:11.051 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 podman[70353]: 2024-09-15 22:46:10.748264075 +0000 UTC m=+0.125910501 container create 98e98759995937a12ed36ac75a9fc8cba947984244bf723fbc7d90db9ed3dcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:46:11.051 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 podman[70353]: 2024-09-15 22:46:10.97550637 +0000 UTC m=+0.353152794 container init 98e98759995937a12ed36ac75a9fc8cba947984244bf723fbc7d90db9ed3dcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T22:46:11.052 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:10 smithi110 podman[70353]: 2024-09-15 22:46:10.978824409 +0000 UTC m=+0.356470839 container start 98e98759995937a12ed36ac75a9fc8cba947984244bf723fbc7d90db9ed3dcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:46:11.052 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:11 smithi110 podman[70353]: 2024-09-15 22:46:11.050374728 +0000 UTC m=+0.428021170 container attach 98e98759995937a12ed36ac75a9fc8cba947984244bf723fbc7d90db9ed3dcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:46:11.437 INFO:journalctl@ceph.osd.10.smithi110.stdout:Sep 15 22:46:11 smithi110 podman[70353]: 2024-09-15 22:46:11.162171669 +0000 UTC m=+0.539818101 container died 98e98759995937a12ed36ac75a9fc8cba947984244bf723fbc7d90db9ed3dcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T22:46:11.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T22:46:11.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:11.784 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T22:46:11.784 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T22:46:11.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.11 2024-09-15T22:46:11.811 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:11.812 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:11.812 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:11.812 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:11.812 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:11.812 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:11.812 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:11.531+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:12.101 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:11 smithi112 systemd[1]: Stopping Ceph osd.11 for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.300+0000 7fdbf9b4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.300+0000 7fdbf9b4f640 -1 osd.11 84 *** Got signal Terminated *** 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.300+0000 7fdbf9b4f640 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:12.602 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:12 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:12.501+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:13.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:13 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:13.548+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:14.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:14 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:14.570+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:15.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:15.853 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:15 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:15.576+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6820 osd.8 since back 2024-09-15T22:45:50.092232+0000 front 2024-09-15T22:45:50.092244+0000 (oldest deadline 2024-09-15T22:46:14.792200+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-15T22:44:46.583248+0000 front 2024-09-15T22:44:46.583297+0000 (oldest deadline 2024-09-15T22:45:11.283187+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6804 osd.1 since back 2024-09-15T22:44:55.984315+0000 front 2024-09-15T22:44:55.984166+0000 (oldest deadline 2024-09-15T22:45:19.484373+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6804 osd.2 since back 2024-09-15T22:45:02.385457+0000 front 2024-09-15T22:45:02.385382+0000 (oldest deadline 2024-09-15T22:45:26.485537+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6812 osd.4 since back 2024-09-15T22:45:17.587279+0000 front 2024-09-15T22:45:17.587357+0000 (oldest deadline 2024-09-15T22:45:42.287263+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6812 osd.5 since back 2024-09-15T22:45:26.388092+0000 front 2024-09-15T22:45:26.388168+0000 (oldest deadline 2024-09-15T22:45:51.688308+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-15T22:45:32.789384+0000 front 2024-09-15T22:45:32.789483+0000 (oldest deadline 2024-09-15T22:45:57.489233+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.110:6820 osd.7 since back 2024-09-15T22:45:44.891638+0000 front 2024-09-15T22:45:44.891576+0000 (oldest deadline 2024-09-15T22:46:07.191496+0000) 2024-09-15T22:46:16.852 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:16 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11[60970]: 2024-09-15T22:46:16.555+0000 7fdbf214c640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.112:6820 osd.8 since back 2024-09-15T22:45:50.092232+0000 front 2024-09-15T22:45:50.092244+0000 (oldest deadline 2024-09-15T22:46:14.792200+0000) 2024-09-15T22:46:18.035 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:17 smithi112 podman[71552]: 2024-09-15 22:46:17.747127655 +0000 UTC m=+5.769564443 container died 6703856985a5a1e1d7cef8e03cbbc58901eb711fe1ba84ee69d2d2347d2be4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:46:18.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 podman[71552]: 2024-09-15 22:46:18.116978264 +0000 UTC m=+6.139415040 container cleanup 6703856985a5a1e1d7cef8e03cbbc58901eb711fe1ba84ee69d2d2347d2be4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-15T22:46:18.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 bash[71552]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11 2024-09-15T22:46:18.728 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 podman[71569]: 2024-09-15 22:46:18.393176719 +0000 UTC m=+0.639006998 container remove 6703856985a5a1e1d7cef8e03cbbc58901eb711fe1ba84ee69d2d2347d2be4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T22:46:19.030 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 podman[71655]: 2024-09-15 22:46:18.630269374 +0000 UTC m=+0.015680642 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:46:19.030 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 podman[71655]: 2024-09-15 22:46:18.743953753 +0000 UTC m=+0.129365022 container create 1c4ce799827f7ca0d1b2853b488eb9f800c06f8f79e9ca7baa7ca33f83cd5d10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-15T22:46:19.030 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 podman[71655]: 2024-09-15 22:46:18.954708577 +0000 UTC m=+0.340119842 container init 1c4ce799827f7ca0d1b2853b488eb9f800c06f8f79e9ca7baa7ca33f83cd5d10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-15T22:46:19.031 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:18 smithi112 podman[71655]: 2024-09-15 22:46:18.957858725 +0000 UTC m=+0.343269987 container start 1c4ce799827f7ca0d1b2853b488eb9f800c06f8f79e9ca7baa7ca33f83cd5d10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T22:46:19.031 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:19 smithi112 podman[71655]: 2024-09-15 22:46:19.029698939 +0000 UTC m=+0.415110204 container attach 1c4ce799827f7ca0d1b2853b488eb9f800c06f8f79e9ca7baa7ca33f83cd5d10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T22:46:19.352 INFO:journalctl@ceph.osd.11.smithi112.stdout:Sep 15 22:46:19 smithi112 podman[71655]: 2024-09-15 22:46:19.152689587 +0000 UTC m=+0.538100858 container died 1c4ce799827f7ca0d1b2853b488eb9f800c06f8f79e9ca7baa7ca33f83cd5d10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:46:19.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T22:46:19.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:19.813 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T22:46:19.813 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T22:46:19.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.a 2024-09-15T22:46:20.207 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:19 smithi022 systemd[1]: Stopping Ceph mds.a for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:20.532 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:20 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a[71642]: 2024-09-15T22:46:20.204+0000 7fbe8ba00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:20.532 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:20 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a[71642]: 2024-09-15T22:46:20.204+0000 7fbe8ba00640 -1 mds.a *** got signal Terminated *** 2024-09-15T22:46:24.213 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:23 smithi022 podman[89768]: 2024-09-15 22:46:23.904726035 +0000 UTC m=+3.808662043 container died 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:46:24.532 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:24 smithi022 podman[89768]: 2024-09-15 22:46:24.343336032 +0000 UTC m=+4.247272036 container cleanup 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-15T22:46:24.532 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:24 smithi022 bash[89768]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a 2024-09-15T22:46:24.817 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 15 22:46:24 smithi022 podman[89792]: 2024-09-15 22:46:24.56141995 +0000 UTC m=+0.651624558 container remove 307c115a66f9eae5463de111a6dc33cbbbcbd7844932651a827b22169b08a15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:46:24.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T22:46:24.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:24.915 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T22:46:24.915 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T22:46:24.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.d 2024-09-15T22:46:25.282 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:24 smithi022 systemd[1]: Stopping Ceph mds.d for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:25.782 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:25 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d[70469]: 2024-09-15T22:46:25.477+0000 7fca8a400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:25.782 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:25 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d[70469]: 2024-09-15T22:46:25.477+0000 7fca8a400640 -1 mds.d *** got signal Terminated *** 2024-09-15T22:46:27.733 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:27 smithi022 podman[89899]: 2024-09-15 22:46:27.460881179 +0000 UTC m=+2.265075321 container died 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-15T22:46:28.032 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:27 smithi022 podman[89899]: 2024-09-15 22:46:27.847520321 +0000 UTC m=+2.651714450 container cleanup 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T22:46:28.032 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:27 smithi022 bash[89899]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d 2024-09-15T22:46:28.329 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 15 22:46:28 smithi022 podman[89911]: 2024-09-15 22:46:28.065517983 +0000 UTC m=+0.586586429 container remove 8dbe2c9d89c785ad17ef369a3e16a811c92f0e2985a6ea5f64b0c8d33b3dbd37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:46:28.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T22:46:28.429 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:28.429 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T22:46:28.429 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T22:46:28.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.g 2024-09-15T22:46:28.782 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:28 smithi022 systemd[1]: Stopping Ceph mds.g for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:29.282 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g[71234]: 2024-09-15T22:46:28.812+0000 7f0368c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:29.282 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:28 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g[71234]: 2024-09-15T22:46:28.812+0000 7f0368c00640 -1 mds.g *** got signal Terminated *** 2024-09-15T22:46:31.032 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:30 smithi022 podman[90019]: 2024-09-15 22:46:30.691998395 +0000 UTC m=+1.994204132 container died a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T22:46:31.445 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:31 smithi022 podman[90019]: 2024-09-15 22:46:31.243168101 +0000 UTC m=+2.545373845 container cleanup a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T22:46:31.446 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:31 smithi022 bash[90019]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g 2024-09-15T22:46:31.715 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 15 22:46:31 smithi022 podman[90031]: 2024-09-15 22:46:31.444657203 +0000 UTC m=+0.736399095 container remove a54f31e5ed8547ee2952b2d47a85b26613a53099ebd64acf922ac46f827cb39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:46:31.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T22:46:31.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:31.802 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T22:46:31.802 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T22:46:31.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.j 2024-09-15T22:46:32.032 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:31 smithi022 systemd[1]: Stopping Ceph mds.j for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:32.532 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j[70052]: 2024-09-15T22:46:32.191+0000 7fa048600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:32.532 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:32 smithi022 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j[70052]: 2024-09-15T22:46:32.191+0000 7fa048600640 -1 mds.j *** got signal Terminated *** 2024-09-15T22:46:35.374 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 podman[90136]: 2024-09-15 22:46:35.041453448 +0000 UTC m=+2.968046755 container died c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:46:35.694 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 podman[90136]: 2024-09-15 22:46:35.480465581 +0000 UTC m=+3.407058868 container cleanup c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-15T22:46:35.694 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 bash[90136]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j 2024-09-15T22:46:35.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T22:46:35.992 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 podman[90149]: 2024-09-15 22:46:35.693014575 +0000 UTC m=+0.640063885 container remove c683a778b962a24942a6cb5dee64ac68cbd54ab227d294154ed29b8f8d5765b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T22:46:35.992 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 systemd[1]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-15T22:46:35.992 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 systemd[1]: Stopped Ceph mds.j for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:46:35.993 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 15 22:46:35 smithi022 systemd[1]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.j.service: Consumed 1.638s CPU time. 2024-09-15T22:46:36.014 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:36.014 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T22:46:36.014 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T22:46:36.015 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.b 2024-09-15T22:46:36.314 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:36 smithi110 systemd[1]: Stopping Ceph mds.b for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:36.571 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: 2024-09-15T22:46:36.313+0000 7f07b77d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:36.571 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:36 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b[64897]: 2024-09-15T22:46:36.313+0000 7f07b77d4640 -1 mds.b *** got signal Terminated *** 2024-09-15T22:46:38.914 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:38 smithi110 podman[70456]: 2024-09-15 22:46:38.659538542 +0000 UTC m=+2.451141237 container died 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:46:38.989 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:38 smithi110 podman[70456]: 2024-09-15 22:46:38.987398707 +0000 UTC m=+2.779001399 container cleanup 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:46:38.989 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:38 smithi110 bash[70456]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b 2024-09-15T22:46:39.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T22:46:39.445 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:39 smithi110 podman[70481]: 2024-09-15 22:46:39.171906309 +0000 UTC m=+0.513650593 container remove 1f0fd074b643e0e3dff218dcbbcc796f3fa365d817e973006ff3c760e186fedc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:46:39.445 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:39 smithi110 systemd[1]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-15T22:46:39.445 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:39 smithi110 systemd[1]: Stopped Ceph mds.b for d3c50556-73b0-11ef-bceb-c7b262605968. 2024-09-15T22:46:39.446 INFO:journalctl@ceph.mds.b.smithi110.stdout:Sep 15 22:46:39 smithi110 systemd[1]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.b.service: Consumed 6.638s CPU time. 2024-09-15T22:46:39.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:39.459 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T22:46:39.459 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T22:46:39.459 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.e 2024-09-15T22:46:39.705 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:46:39 smithi110 systemd[1]: Stopping Ceph mds.e for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:40.205 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:46:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e[64285]: 2024-09-15T22:46:39.816+0000 7f9a815c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:40.205 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:46:39 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e[64285]: 2024-09-15T22:46:39.816+0000 7f9a815c9640 -1 mds.e *** got signal Terminated *** 2024-09-15T22:46:42.234 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:46:41 smithi110 podman[70592]: 2024-09-15 22:46:41.966838796 +0000 UTC m=+2.279498183 container died e2bd7e7410f4abdb60018b794200434a4453a7f6dca977183bb0e417be60a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T22:46:42.601 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:46:42 smithi110 podman[70592]: 2024-09-15 22:46:42.316215451 +0000 UTC m=+2.628874827 container cleanup e2bd7e7410f4abdb60018b794200434a4453a7f6dca977183bb0e417be60a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T22:46:42.601 INFO:journalctl@ceph.mds.e.smithi110.stdout:Sep 15 22:46:42 smithi110 bash[70592]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-e 2024-09-15T22:46:42.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T22:46:42.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:42.791 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T22:46:42.791 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T22:46:42.791 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.h 2024-09-15T22:46:43.104 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:46:42 smithi110 systemd[1]: Stopping Ceph mds.h for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:43.455 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:46:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h[64591]: 2024-09-15T22:46:43.103+0000 7f7dbc2c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:43.455 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:46:43 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h[64591]: 2024-09-15T22:46:43.103+0000 7f7dbc2c5640 -1 mds.h *** got signal Terminated *** 2024-09-15T22:46:46.929 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:46:46 smithi110 podman[70715]: 2024-09-15 22:46:46.658040479 +0000 UTC m=+3.650828508 container died 1bc68a7f27537e27ca730599adb34fa981dc538ac908c1278d39da7a43080e9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T22:46:47.188 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:46:46 smithi110 podman[70715]: 2024-09-15 22:46:46.928123428 +0000 UTC m=+3.920911466 container cleanup 1bc68a7f27537e27ca730599adb34fa981dc538ac908c1278d39da7a43080e9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-15T22:46:47.188 INFO:journalctl@ceph.mds.h.smithi110.stdout:Sep 15 22:46:46 smithi110 bash[70715]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-h 2024-09-15T22:46:47.362 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T22:46:47.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:47.395 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T22:46:47.396 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T22:46:47.396 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.k 2024-09-15T22:46:47.955 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:46:47 smithi110 systemd[1]: Stopping Ceph mds.k for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:47.955 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:46:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k[63972]: 2024-09-15T22:46:47.697+0000 7f7a9a215640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:47.955 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:46:47 smithi110 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k[63972]: 2024-09-15T22:46:47.697+0000 7f7a9a215640 -1 mds.k *** got signal Terminated *** 2024-09-15T22:46:51.149 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:46:50 smithi110 podman[70837]: 2024-09-15 22:46:50.894308272 +0000 UTC m=+3.277752308 container died 09b3a543e7f83e7e8265bdff987dd34f3c2f3e48e5ab9972d5861e3986ef8f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-15T22:46:51.455 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:46:51 smithi110 podman[70837]: 2024-09-15 22:46:51.248031438 +0000 UTC m=+3.631475477 container cleanup 09b3a543e7f83e7e8265bdff987dd34f3c2f3e48e5ab9972d5861e3986ef8f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T22:46:51.455 INFO:journalctl@ceph.mds.k.smithi110.stdout:Sep 15 22:46:51 smithi110 bash[70837]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-k 2024-09-15T22:46:51.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T22:46:51.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:51.748 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T22:46:51.748 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T22:46:51.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.c 2024-09-15T22:46:52.068 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:46:51 smithi112 systemd[1]: Stopping Ceph mds.c for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:52.328 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:46:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c[65982]: 2024-09-15T22:46:52.066+0000 7ff921494640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:52.328 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:46:52 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c[65982]: 2024-09-15T22:46:52.066+0000 7ff921494640 -1 mds.c *** got signal Terminated *** 2024-09-15T22:46:55.034 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:46:54 smithi112 podman[71758]: 2024-09-15 22:46:54.666678661 +0000 UTC m=+2.705457331 container died 67c230ee291f5e417752528825ce52d41794b937635edb686dfa70a423654284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-15T22:46:55.352 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:46:55 smithi112 podman[71758]: 2024-09-15 22:46:55.133332271 +0000 UTC m=+3.172110957 container cleanup 67c230ee291f5e417752528825ce52d41794b937635edb686dfa70a423654284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T22:46:55.352 INFO:journalctl@ceph.mds.c.smithi112.stdout:Sep 15 22:46:55 smithi112 bash[71758]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-c 2024-09-15T22:46:55.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T22:46:55.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:55.601 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T22:46:55.601 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T22:46:55.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.f 2024-09-15T22:46:55.952 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:46:55 smithi112 systemd[1]: Stopping Ceph mds.f for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:46:56.351 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:46:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f[65672]: 2024-09-15T22:46:55.950+0000 7f5d8210a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:46:56.352 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:46:55 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f[65672]: 2024-09-15T22:46:55.950+0000 7f5d8210a640 -1 mds.f *** got signal Terminated *** 2024-09-15T22:46:59.003 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:46:58 smithi112 podman[71890]: 2024-09-15 22:46:58.675743797 +0000 UTC m=+2.855108296 container died e522e7479ea1c05a55d22ceec719c6f2c2ea31cfd17d749afb0e43fa6cb63f0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:46:59.306 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:46:59 smithi112 podman[71890]: 2024-09-15 22:46:59.103851241 +0000 UTC m=+3.283215737 container cleanup e522e7479ea1c05a55d22ceec719c6f2c2ea31cfd17d749afb0e43fa6cb63f0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T22:46:59.306 INFO:journalctl@ceph.mds.f.smithi112.stdout:Sep 15 22:46:59 smithi112 bash[71890]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-f 2024-09-15T22:46:59.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T22:46:59.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:46:59.565 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T22:46:59.566 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T22:46:59.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.i 2024-09-15T22:46:59.852 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:46:59 smithi112 systemd[1]: Stopping Ceph mds.i for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:47:00.352 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:46:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i[66280]: 2024-09-15T22:46:59.891+0000 7f9e5c5f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:47:00.405 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:46:59 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i[66280]: 2024-09-15T22:46:59.891+0000 7f9e5c5f9640 -1 mds.i *** got signal Terminated *** 2024-09-15T22:47:02.961 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:47:02 smithi112 podman[72010]: 2024-09-15 22:47:02.677196567 +0000 UTC m=+2.895566780 container died d36cb64cf7c968d14c54a065297c2aa769d1313bfa3346fbc1fbe5bfca328154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-15T22:47:03.341 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:47:03 smithi112 podman[72010]: 2024-09-15 22:47:03.04994624 +0000 UTC m=+3.268316450 container cleanup d36cb64cf7c968d14c54a065297c2aa769d1313bfa3346fbc1fbe5bfca328154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T22:47:03.341 INFO:journalctl@ceph.mds.i.smithi112.stdout:Sep 15 22:47:03 smithi112 bash[72010]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-i 2024-09-15T22:47:03.487 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T22:47:03.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:47:03.526 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T22:47:03.526 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T22:47:03.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.l 2024-09-15T22:47:03.846 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:03 smithi112 systemd[1]: Stopping Ceph mds.l for d3c50556-73b0-11ef-bceb-c7b262605968... 2024-09-15T22:47:04.101 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l[65368]: 2024-09-15T22:47:03.844+0000 7f0d29f73640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:47:04.102 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:03 smithi112 ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l[65368]: 2024-09-15T22:47:03.844+0000 7f0d29f73640 -1 mds.l *** got signal Terminated *** 2024-09-15T22:47:08.162 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:07 smithi112 podman[72131]: 2024-09-15 22:47:07.858840739 +0000 UTC m=+4.115980996 container died 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:47:08.162 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:08 smithi112 podman[72131]: 2024-09-15 22:47:08.161734588 +0000 UTC m=+4.418874835 container cleanup 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:47:08.491 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:08 smithi112 bash[72131]: ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l 2024-09-15T22:47:08.491 INFO:journalctl@ceph.mds.l.smithi112.stdout:Sep 15 22:47:08 smithi112 podman[72144]: 2024-09-15 22:47:08.379502499 +0000 UTC m=+0.523231377 container remove 5dce3efe8ece9c22b29b611705635603430883c524ce20a58a5ab824c114001c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d3c50556-73b0-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-15T22:47:08.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3c50556-73b0-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T22:47:08.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:47:08.545 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T22:47:08.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:47:08.830 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:47:12.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:47:13.087 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting cluster with fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:47:15.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:47:15.793 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:47:18.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:47:18.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:47:18.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:47:18.424 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T22:47:18.425 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi022/crash 2024-09-15T22:47:18.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:47:18.482 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:47:18.483 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:47:18.486 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi110/crash 2024-09-15T22:47:18.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:47:18.527 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:47:18.527 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:47:18.529 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi112/crash 2024-09-15T22:47:18.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:47:18.572 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:47:18.573 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:47:18.574 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T22:47:18.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T22:47:18.658 INFO:tasks.cephadm:Compressing logs... 2024-09-15T22:47:18.658 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:47:18.662 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:47:18.665 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:47:18.689 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:47:18.690 INFO:teuthology.orchestra.run.smithi112.stderr:: No such file or directory 2024-09-15T22:47:18.690 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:47:18.690 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T22:47:18.690 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:: No such file or directory 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T22:47:18.696 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T22:47:18.697 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T22:47:18.697 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:47:18.697 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:47:18.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:47:18.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T22:47:18.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr: 82.4% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr: 90.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log: 87.2% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T22:47:18.699 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T22:47:18.703 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:47:18.703 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T22:47:18.703 INFO:teuthology.orchestra.run.smithi110.stderr: 94.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T22:47:18.703 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.5%gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:47:18.703 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:47:18.703 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T22:47:18.704 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log: 87.1% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:47:18.704 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T22:47:18.705 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T22:47:18.705 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T22:47:18.705 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:47:18.707 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.9% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T22:47:18.707 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 90.9% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:47:18.707 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T22:47:18.707 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:47:18.708 INFO:teuthology.orchestra.run.smithi112.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T22:47:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T22:47:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:47:18.712 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T22:47:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T22:47:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:: No such file or directory 2024-09-15T22:47:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T22:47:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:47:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:47:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T22:47:18.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:47:18.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T22:47:18.719 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:47:18.720 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T22:47:18.720 INFO:teuthology.orchestra.run.smithi022.stderr: 90.3% 82.6% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:47:18.720 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:47:18.721 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T22:47:18.722 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:47:18.723 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.6.log: 94.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T22:47:18.723 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T22:47:18.724 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:47:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T22:47:18.728 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1%/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.x.log: -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:47:18.730 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:47:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T22:47:18.733 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T22:47:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.j.log: /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:47:18.739 INFO:teuthology.orchestra.run.smithi022.stderr: 94.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T22:47:18.740 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T22:47:18.750 INFO:teuthology.orchestra.run.smithi022.stderr: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:47:18.777 INFO:teuthology.orchestra.run.smithi112.stderr: 94.6% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T22:47:18.778 INFO:teuthology.orchestra.run.smithi112.stderr: 94.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T22:47:18.788 INFO:teuthology.orchestra.run.smithi112.stderr: 92.4% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T22:47:18.840 INFO:teuthology.orchestra.run.smithi022.stderr: 92.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T22:47:18.967 INFO:teuthology.orchestra.run.smithi110.stderr: 94.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T22:47:19.042 INFO:teuthology.orchestra.run.smithi022.stderr: 90.3% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T22:47:19.156 INFO:teuthology.orchestra.run.smithi112.stderr: 91.6% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T22:47:19.183 INFO:teuthology.orchestra.run.smithi110.stderr: 91.8% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T22:47:20.000 INFO:teuthology.orchestra.run.smithi022.stderr: 90.3% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T22:47:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T22:47:21.032 INFO:teuthology.orchestra.run.smithi112.stderr: 92.8% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T22:47:21.041 INFO:teuthology.orchestra.run.smithi112.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T22:47:21.130 INFO:teuthology.orchestra.run.smithi022.stderr: 92.8% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T22:47:21.397 INFO:teuthology.orchestra.run.smithi110.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T22:47:21.613 INFO:teuthology.orchestra.run.smithi110.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T22:47:21.617 INFO:teuthology.orchestra.run.smithi112.stderr: 92.9% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T22:47:21.919 INFO:teuthology.orchestra.run.smithi110.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T22:47:21.980 INFO:teuthology.orchestra.run.smithi110.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T22:47:21.982 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-15T22:47:21.982 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m3.303s 2024-09-15T22:47:21.982 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m14.402s 2024-09-15T22:47:21.983 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.528s 2024-09-15T22:47:21.999 INFO:teuthology.orchestra.run.smithi112.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T22:47:22.001 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-15T22:47:22.001 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m3.321s 2024-09-15T22:47:22.001 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m11.209s 2024-09-15T22:47:22.001 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.446s 2024-09-15T22:47:22.089 INFO:teuthology.orchestra.run.smithi022.stderr: 92.8% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T22:47:22.300 INFO:teuthology.orchestra.run.smithi022.stderr: 92.9% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T22:47:22.346 INFO:teuthology.orchestra.run.smithi022.stderr: 93.0% -- replaced with /var/log/ceph/d3c50556-73b0-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T22:47:22.349 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-09-15T22:47:22.349 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m3.658s 2024-09-15T22:47:22.349 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m13.587s 2024-09-15T22:47:22.349 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m1.222s 2024-09-15T22:47:22.350 INFO:tasks.cephadm:Archiving logs... 2024-09-15T22:47:22.350 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi022/log 2024-09-15T22:47:22.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:47:25.021 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi110/log 2024-09-15T22:47:25.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:47:27.172 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi112/log 2024-09-15T22:47:27.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:47:29.042 INFO:tasks.cephadm:Removing cluster... 2024-09-15T22:47:29.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --force 2024-09-15T22:47:29.329 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:47:29.801 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --force 2024-09-15T22:47:30.003 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting cluster with fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:47:30.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3c50556-73b0-11ef-bceb-c7b262605968 --force 2024-09-15T22:47:30.476 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: d3c50556-73b0-11ef-bceb-c7b262605968 2024-09-15T22:47:30.750 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T22:47:30.750 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:47:30.788 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:47:30.805 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:47:30.821 INFO:tasks.cephadm:Teardown complete 2024-09-15T22:47:30.821 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:47:30.832 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:47:30.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:47:30.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:47:30.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:47:30.965 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:47:30.981 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:47:30.981 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:47:30.986 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:47:30.989 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:47:31.001 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:47:31.004 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:47:31.006 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:47:31.006 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-15T22:47:31.006 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +1105us[+1116us] +/- 54ms 2024-09-15T22:47:31.006 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -978us[ -967us] +/- 52ms 2024-09-15T22:47:31.006 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -198us[ -187us] +/- 76ms 2024-09-15T22:47:31.006 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:47:31.008 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:47:31.008 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-15T22:47:31.008 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1082us[+1087us] +/- 54ms 2024-09-15T22:47:31.008 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -1016us[-1016us] +/- 52ms 2024-09-15T22:47:31.008 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -228us[ -228us] +/- 76ms 2024-09-15T22:47:31.008 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:47:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:47:31.024 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:47:31.024 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-15T22:47:31.024 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +1070us[+1072us] +/- 54ms 2024-09-15T22:47:31.024 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -1012us[-1012us] +/- 52ms 2024-09-15T22:47:31.025 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -227us[ -225us] +/- 76ms 2024-09-15T22:47:31.025 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:47:31.026 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:47:31.041 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:47:31.042 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:47:31.051 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:47:31.196 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:47:31.263 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:47:31.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:47:31.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:31.390 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:47:31.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:31.419 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:47:31.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:31.446 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:47:31.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:47:31.466 INFO:teuthology.task.internal:Duration was 1986.714979 seconds 2024-09-15T22:47:31.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:47:31.477 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:47:31.477 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:47:31.482 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:47:31.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:47:31.520 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:47:31.526 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:47:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:47:31.997 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:47:32.001 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-09-15T22:47:32.001 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:47:32.051 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-15T22:47:32.051 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:47:32.083 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T22:47:32.084 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:47:32.118 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:47:32.118 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:47:32.123 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:47:32.125 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:47:32.184 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:47:32.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:47:32.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:47:32.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:47:32.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:47:32.732 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:47:32.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:47:32.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:47:32.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:47:32.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:47:32.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:32.855 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:32.857 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:32.878 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-15T22:47:32.904 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-15T22:47:32.921 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-09-15T22:47:32.952 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:32.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:32.986 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:33.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:33.001 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:33.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:33.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:47:33.028 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:47:33.029 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi022 2024-09-15T22:47:33.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:47:33.109 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi110 2024-09-15T22:47:33.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:47:33.145 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906245/remote/smithi112 2024-09-15T22:47:33.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:47:33.183 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:47:33.183 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:47:33.187 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:47:33.190 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:47:33.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:47:33.242 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:47:33.242 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:47:33.254 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:47:33.254 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:47:33.263 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:47:33.265 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:47:33.278 INFO:teuthology.orchestra.run.smithi110.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:47 /home/ubuntu/cephtest 2024-09-15T22:47:33.286 INFO:teuthology.orchestra.run.smithi112.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:47 /home/ubuntu/cephtest 2024-09-15T22:47:33.294 INFO:teuthology.orchestra.run.smithi022.stdout: 393282 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:47 /home/ubuntu/cephtest 2024-09-15T22:47:33.296 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:47:33.309 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:47:33.335 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} duration: 1986.7149794101715 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:47:33.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:47:33.455 INFO:teuthology.run:pass